RImpala:较大数据时查询失败 [英] RImpala: Query Failed When Larger Data

问题描述

check1<-rimpala.query("select * from sum2")
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,  : 
  java.sql.SQLException: Method not supported

dim(sum2)是49501行和18列.

check1<-rimpala.query("select *from sum3")

dim(sum3)是102行6列.

它以较小的样本量工作.

抱歉，我无法为此复制示例.有人在更大数据量时遇到同样的问题吗?有解决的办法吗?谢谢.

解决方案

如 dplyrimpaladb . /p>

check1<-rimpala.query("select * from sum2")
Error in .jcall("RJavaTools", "Ljava/lang/Object;", "invokeMethod", cl,  : 
  java.sql.SQLException: Method not supported

dim(sum2) is 49501 rows and 18 columns.

check1<-rimpala.query("select *from sum3")

dim(sum3) is 102 rows and 6 columns.

It worked with smaller sample size.

sorry that I cant reproduce example to this. Is anyone encounter the same problem with larger data size? Any idea to solve this? Thanks.

解决方案

As noted elsewhere on StackOverflow, RImpala does not implement executeUpdate and so cannot run any query that modifies state. I suspect you hit your error not by running a larger SELECT query but rather because you tried to insert, update, or delete some data.

If you'd like to use Impala from R, I'd recommend using dplyrimpaladb.

这篇关于RImpala:较大数据时查询失败的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！