为什么连接终止 [英] Why connection is terminating
问题描述
我正在R上使用H2O
库尝试随机森林分类模型,该库位于具有7000万行和25个数字特征的训练集上,文件总大小为5.6 GB.
I'm trying a random forest classification model by using H2O
library inside R on a training set having 70 million rows and 25 numeric features.The total file size is 5.6 GB.
验证文件的大小为1 GB.
The validation file's size is 1 GB.
我的系统上有16 GB RAM和8核心CPU.
I have 16 GB RAM and 8 core CPU on my system.
系统成功读取了H2O对象中的两个文件.
The system successfully able to read both of the files in H2O object.
然后我在下面给出命令来构建模型:
Then I'm giving below command to build the model:
model <- h2o.randomForest(x = c(1:18,20:25), y = 19, training_frame = traindata,
validation_frame = testdata, ntrees = 150, mtries = 6)
但是几分钟(没有生成任何树)之后,出现以下错误:
But after few minutes (without generating any tree), I'm getting following error:
.h2o.doSafeREST中的错误(conn = conn,h2oRestApiVersion = h2oRestApiVersion ,:意外的CURL错误:Recv失败:对等重置连接"
"Error in .h2o.doSafeREST(conn = conn, h2oRestApiVersion = h2oRestApiVersion, : Unexpected CURL error: Recv failure: Connection reset by peer"
但是,如果我尝试将以上代码与1棵树一起使用,则其运行成功.
However If I tried above code with 1 tree, its running successfully.
是否由于内存问题而发生上述错误?任何帮助将不胜感激.
Is the above error occurring because of memory issue? Any help will be appreciated.
推荐答案
它是OutOfMemoryError.在R端此错误消息的变体是:
Its an OutOfMemoryError. A variation of this error message on the R side is:
Error in .h2o.doSafeREST(conn = conn, h2oRestApiVersion = h2oRestApiVersion, :
Unexpected CURL error: Empty reply from server
检查h2o服务器日志(您也应该这样做)会告诉您:
Checking the h2o server logs, which you should do as well, will tell you:
10-08 20:11:57.165 192.168.0.4:54321 2125 #58072-18 INFO: Total file size: 1.81 GB
10-08 20:11:57.165 192.168.0.4:54321 2125 #58072-18 INFO: Parse chunk size 4194304
onExCompletion for water.parser.ParseDataset$MultiFileParseTask@3588360e
java.lang.OutOfMemoryError: Java heap space
:
:
Exception in thread "FJ-0-11" java.lang.OutOfMemoryError: Java heap space
2015-10-08 20:13:14.493:WARN:oejut.QueuedThreadPool:1 threads could not be stopped
10-08 20:13:23.033 192.168.0.4:54321 2125 FJ-0-5 ERRR: Out of Memory, Heap Space exceeded, increase Heap Size, from /192.168.0.4:54321
10-08 20:13:23.458 192.168.0.4:54321 2125 FJ-0-3 ERRR: Out of Memory, Heap Space exceeded, increase Heap Size, from /192.168.0.4:54321
10-08 20:13:23.033 192.168.0.4:54321 2125 FJ-0-13 ERRR: Out of Memory, Heap Space exceeded, increase Heap Size, from /192.168.0.4:54321
10-08 20:13:23.033 192.168.0.4:54321 2125 FJ-0-7 ERRR: Out of Memory, Heap Space exceeded, increase Heap Size, from /192.168.0.4:54321
10-08 20:13:26.541 192.168.0.4:54321 2125 FJ-0-5 FATAL: Exiting.
10-08 20:13:26.574 192.168.0.4:54321 2125 FJ-0-7 FATAL: Exiting.
10-08 20:13:26.575 192.168.0.4:54321 2125 FJ-0-3 FATAL: Exiting.
10-08 20:13:26.575 192.168.0.4:54321 2125 FJ-0-13 FATAL: Exiting.
我正在h2o Slater(3.2.0.5)上运行此程序,因此,这可能取决于您的版本.
I am running this on h2o Slater (3.2.0.5), so depending on your version, this may vary.
这篇关于为什么连接终止的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!