如何在Zeppelin/Spark/Scala中漂亮地打印包装好的数组? [英] How can I pretty print a wrappedarray in Zeppelin/Spark/Scala?

问题描述

在

In this question I was told how to print a dataframe using zeppelin's z.show command. This works well except for 'WrappedArray' appearing in the lemma column:

我已经尝试过了:

z.show(dfLemma.select(concat_ws(",", $"lemma")))

但是它只是给了我一个单词列表，格式不好，我也希望在输出中添加种族主义列. 非常感谢您的帮助.

but it just gave me a list of words, not nicely formatted and I also want the racist column in my output. Any help is much appreciated.

推荐答案

以下是格式化数组列的建议:

Here's a suggestion for formatting your array column:

import org.apache.spark.sql.Column
import org.apache.spark.sql.functions._
import sqlContext.implicits._

val df = Seq(
  (1, Array("An", "Array")), (2, Array("Another", "Array"))
).toDF("first", "second")

def formatArrayColumn(arrayColumn: Column): Column = {
  concat(lit("["), concat_ws(", ", arrayColumn), lit("]")).as(s"format(${arrayColumn.expr})")
}

val result = df.withColumn("second", formatArrayColumn($"second"))

z.show(result)

这将导致:

这篇关于如何在Zeppelin/Spark/Scala中漂亮地打印包装好的数组?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！