pyspark获取周数 [英] pyspark getting weeknumber of month

问题描述

我对从datafrme列的pyspark中的月份中获取周数感到困惑，例如，将我的数据框视为

I am stuckup with getting weeknumber from month in pyspark from a datafrme column , For Examples consider my dataframe as

WeekID,DateField,WeekNUM
1,01/JAN/2017
2,15/Feb/2017

我的输出应如下所示

WeekIDm,DateField,MOF
1,01/JAN/2017,1
2,15/FEB/2017,2

我尝试了striftime和其他无法执行的日期函数.

I tried with striftime and other date functions I was unable to do.

请帮助我解决问题.

推荐答案

您可以组合 to_date 和 date_format :

from pyspark.sql.functions import to_date, date_format

df = spark.createDataFrame(
    [(1, "01/JAN/2017"), (2, "15/FEB/2017")], ("id", "date"))

df.withColumn("week", date_format(to_date("date", "dd/MMM/yyyy"), "W")).show()
+---+-----------+----+
| id|       date|week|
+---+-----------+----+
|  1|01/JAN/2017|   1|
|  2|15/FEB/2017|   3|
+---+-----------+----+

如果您希望按年输入星期，请用 w 替换格式:

If you want week-of-year please replace format with w:

date_format(to_date("date", "dd/MMM/yyyy"), "w")

这篇关于pyspark获取周数的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！