可能的内存问题使Hbase Thrift Server崩溃 [英] Possible memory issue crashing Hbase Thrift Server

问题描述

我正在将Hera和Hbase Thrift Server与Cloudera CDH4一起运行.一天几次，Thrift服务器都会崩溃.

I'm running Cloudera CDH4 with Hbase and Hbase Thrift Server. Several times a day, the Thrift Server crashes.

在/var/log/hbase/hbase-hbase-thrift-myserver.out中，有以下内容:

In /var/log/hbase/hbase-hbase-thrift-myserver.out, there is this:

#
# java.lang.OutOfMemoryError: Java heap space
# -XX:OnOutOfMemoryError="kill -9 %p"
#   Executing /bin/sh -c "kill -9 8151"...

在/var/log/hbase/hbase-hbase-thrift-myserver.log中，文件末尾没有错误消息.仅有大量的DEBUG消息表明其中一个节点正在缓存特定文件.

In /var/log/hbase/hbase-hbase-thrift-myserver.log, there are no error messages at the end of the file. There are only a lot of DEBUG messages stating that one of the nodes is caching a particular file.

我无法确定Hbase Thrift Server的任何配置选项. /etc/中没有明显的文件.只是/etc/hbase/conf及其Hbase文件.

I can't figure out any configuration options for the Hbase Thrift Server. There are no obvious files in /etc/. Just /etc/hbase/conf and its Hbase files.

关于调试的任何想法吗?

Any ideas on debugging?

推荐答案

使用/etc/hbase/conf/hbase-env.sh，我增加了堆大小，这解决了崩溃的问题.

Using /etc/hbase/conf/hbase-env.sh, I increased my heap size, and this addressed the crashing issue.

# The maximum amount of heap to use, in MB. Default is 1000.
export HBASE_HEAPSIZE=8000

感谢苛刻CDH用户邮件列表以帮助我弄清楚.正如他指出的那样，我缺少日志消息表明可能正在发生kill -9:

Thanks to Harsh J on the CDH Users mailing list for helping me figure out. As he pointed out, my lack of log messages indicates a kill -9 is probably taking place:

表示在日志尾部是否缺少关闭处理程序消息 崩溃前，可能有一个kill -9通过 OOM处理程序.

Indeed if a shutdown handler message is missing in the log tail pre-crash, there may have been a kill -9 passed to the process via the OOM handler.

这篇关于可能的内存问题使Hbase Thrift Server崩溃的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！