MapReduce作业卡住在Accepted状态 [英] MapReduce jobs get stuck in Accepted state

问题描述

我有我自己的MapReduce代码，我试图运行，但它只停留在Accepted状态。我试着运行另一份我以前运行过，样本成功的MR作业。但现在，这两个工作都保持Accepted状态。我尝试更改mapred-site.xml和yarn-site.xml中的各种属性，如这里和这里，但这也没有帮助。有人能指出什么可能会出错。我正在使用hadoop-2.2.0

I have my own MapReduce code that I'm trying to run, but it just stays at Accepted state. I tried running another sample MR job that I'd run previously and which was successful. But now, both the jobs stay in Accepted state. I tried changing various properties in the mapred-site.xml and yarn-site.xml as mentioned here and here but that didn't help either. Can someone please point out what could possibly be going wrong. I'm using hadoop-2.2.0

我已经为各种属性尝试了很多值，这里是一组值 -
在mapred-site .xml

I've tried many values for the various properties, here is one set of values- In mapred-site.xml

<property>
<name>mapreduce.job.tracker</name>
<value>localhost:54311</value>
</property> 

<property>
<name>mapreduce.job.tracker.reserved.physicalmemory.mb</name>
<value></value>
</property>

<property>
<name>mapreduce.map.memory.mb</name>
<value>256</value>
</property>

<property>
<name>mapreduce.reduce.memory.mb</name>
<value>256</value>
</property>


<property>
<name>yarn.app.mapreduce.am.resource.mb</name>
<value>400</value>
<source>mapred-site.xml</source>
</property>

在yarn-site.xml中

In yarn-site.xml

<property>
<name>yarn.nodemanager.resource.memory-mb</name>
<value>400</value>
<source>yarn-site.xml</source>
</property>
<property>
<name>yarn.scheduler.capacity.maximum-am-resource-percent</name>
<value>.3</value>
</property>

推荐答案

我有同样的效果，该系统为每个工作节点提供更多内存，并减少应用程序所需的内存。

I've had the same effect and found that making the system have more memory available per worker node and reduce the memory required for an application helped.

在我的yarn-site.xml文件中有我的设置（在我非常小的实验箱上）：

The settings I have (on my very small experimental boxes) in my yarn-site.xml:

<property>
  <name>yarn.nodemanager.resource.memory-mb</name>
  <value>2200</value>
  <description>Amount of physical memory, in MB, that can be allocated for containers.</description>
</property>

<property>
  <name>yarn.scheduler.minimum-allocation-mb</name>
  <value>500</value>
</property>

这篇关于MapReduce作业卡住在Accepted状态的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！