bin / nutch elasticindex <$ cluser>的OutOfMemoryError -all（Nutch 2.1） [英] OutOfMemoryError for bin/nutch elasticindex <$cluser> -all (Nutch 2.1)
问题描述
我已经按照 http://wiki.apache.org/nutch/Nutch2Tutorial看看我是否可以通过ElasticSearch获得一个安装程序。我已经成功地完成了爬网，没有真正的问题，但是当我尝试将结果加载到弹性搜索中时，我遇到麻烦。
I have been following the instructions at http://wiki.apache.org/nutch/Nutch2Tutorial to see if I can get a nutch installation running with ElasticSearch. I have successfully done a crawl with no real issues, but then when I try and load the results into elasticsearch I run into trouble.
我发出命令：
bin/nutch elasticindex <$cluser> -all
它等待了很长时间，然后回来了一个错误：
线程中的异常mainjava.lang.RuntimeException：job failed：name = elastic-index [ocpnutch]，jobid = job_local_0001
And it waits around for a long time and then comes back with an error: Exception in thread "main" java.lang.RuntimeException: job failed: name=elastic-index [ocpnutch], jobid=job_local_0001
如果我查看日志：
~/apache-nutch-2.1/runtime/local/logs/hadoop.log
我看到这样的几个错误：
I see several errors like this:
捕获netty层的异常[[id：0x569764bd，/192.168.17.39:52554
=> /192.168.17.60:9300]] java.lang.OutOfMemoryError：Java堆空间
Exception caught on netty layer [[id: 0x569764bd, /192.168.17.39:52554 => /192.168.17.60:9300]] java.lang.OutOfMemoryError: Java heap space
弹性搜索中的日志中没有任何内容。
There is nothing in the logs on the elastic search.
我已经尝试更改：
弹性。 max.bulk.docs和elastic.max.bulk.size为小尺寸，并分配大量的GB到nutch，但无济于事。
I have tried changing: elastic.max.bulk.docs and elastic.max.bulk.size to small sizes and allocating large amounts of GB to nutch, but to no avail.
jvm是：
Java（TM）SE运行时环境（build 1.7.0_21-b11）
The jvm is: Java(TM) SE Runtime Environment (build 1.7.0_21-b11)
有没有人有任何想法t我做错了 - 其他诊断信息对解决这个问题有帮助吗？
Does anyone have any idea what I am doing wrong - what other diagnostic information would be helpful to solve this problem?
推荐答案
我有完全相同的问题。我使用弹性搜索0.90.2。
我找到一个解决方案：with elasticsearch 0.19.4它的作品！
I have exactly the same problem. I work with elasticsearch 0.90.2. I found a solution : with elasticsearch 0.19.4 it works !
这篇关于bin / nutch elasticindex <$ cluser>的OutOfMemoryError -all（Nutch 2.1）的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
