可以通过ISNUMERIC函数过滤Spark数据帧吗? [英] Possible to filter Spark dataframe by ISNUMERIC function?

问题描述

我在SQL中有一个表的DataFrame.如果某个列的值是否为数字，我想过滤此DataFrame.

I have a DataFrame for a table in SQL. I want to filter this DataFrame if a value of a certain column is numeric or not.

val df = sqlContext.sql("select * from myTable");
val filter = df.filter("ISNUMERIC('col_a')");
//I want filter to be a dataframe of df where the values in col_a are numeric.

我当前的解决方案不起作用.我该如何实现?

My current solution doesn't work. How can I achieve this?

推荐答案

您可以filter以

df.filter(row => row.getAs[String]("col_a").matches("""\d+"""))

希望这会有所帮助！

这篇关于可以通过ISNUMERIC函数过滤Spark数据帧吗?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！