数据框的pyspark访问列带有点“.". [英] pyspark access column of dataframe with a dot '.'

问题描述

除非首先由withColumnRenamed重命名，否则包含点的pyspark数据帧(例如"id.orig_h")将不允许进入groupby.有解决方法吗? "`a.b`"似乎无法解决.

A pyspark dataframe containing dot (e.g. "id.orig_h") will not allow to groupby upon unless first renamed by withColumnRenamed. Is there a workaround? "`a.b`" doesn't seem to solve it.

推荐答案

在我的pyspark shell中，以下代码段有效:

In my pyspark shell, the following snippets are working:

from pyspark.sql.functions import *
myCol = col("`id.orig_h`")    
result = df.groupBy(myCol).agg(...)

和

myCol = df["`id.orig_h`"]   
result = df.groupBy(myCol).agg(...)

希望对您有帮助.

这篇关于数据框的pyspark访问列带有点“.".的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！