增加水槽MaxHeap [英] Increase Flume MaxHeap

问题描述

下午好，我无法增加Flume的堆大小.结果，我得到:

Good Afternoon, I'm having trouble increasing the Heap Size for Flume. As a result, I get:

Exception in thread "main" java.lang.OutOfMemoryError: Java heap space

我增加了在"flume-env.sh"以及Hadoop/Yarn中定义的堆.没有运气.

I've increased the heap defined in "flume-env.sh" as well as Hadoop/Yarn. No luck.

需要注意的一点是，在启动水槽时，Exec(processbuilder?)似乎将堆定义为20Mb.关于如何覆盖它的任何想法?

One thing to notice, on starting flume, the Exec (processbuilder?) seems to be defining heap as 20Mb. Any ideas on how to override it?

Info: Including Hadoop libraries found via (/usr/local/hadoop/bin/hadoop) for HDFS access
Info: Including Hive libraries found via () for Hive access
+ exec /usr/lib/jvm/java-9-openjdk-amd64/bin/java -Xmx20m -cp 'conf:/usr/local/flume/lib/* :
........

最终，我试图将Heapsize设置为1512MB.

Ultimately I'm trying to set Heapsize to 1512MB.

推荐答案

增加"flume_env.sh"中的堆应该可行.您也可以尝试执行Flume代理，如下所示:

Increasing the heap in "flume_env.sh" should work. You can also try executing your Flume agent as follows:

flume-ng代理-n myagent -Xmx512m

flume-ng agent -n myagent -Xmx512m

Flume能够从命令行读取-D和-X选项.

Flume is able to read -D and -X options from the command line.

这篇关于增加水槽MaxHeap的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！