从节点不在 Yarn ResourceManager 中 [英] Slave nodes not in Yarn ResourceManager

问题描述

我已经建立了一个 3 节点的 Apache Hadoop 集群.在主节点上，我可以看到

I've set up a 3 node Apache Hadoop cluster. On master node, I can see

[hadoop-conf]$ jps
16856 DataNode
17051 SecondaryNameNode
16701 NameNode
21601 ResourceManager
21742 NodeManager
18335 JobHistoryServer

在从节点上，我看到了

[fedora20-template dfs]$ jps
28677 Jps
28510 NodeManager
27449 DataNode

我可以看到来自 master:50070 的三个活动节点.但是，在 ResourceManager Web UI (http://master:8088/cluster/nodes) 中，我只能看到主节点.为什么两个从节点不在资源管理器中?这是否意味着它们不是用于执行 mapreduce 的资源的一部分?

I can see three live nodes from master:50070. However, in the ResourceManager Web UI (http://master:8088/cluster/nodes), I can see only master node. Why are the two slave nodes not in the resource manager? Does that mean they are not part of resources that are used to do mapreduce?

推荐答案

问题解决了.应该在 yarn-site.xml 中进行一些配置，让 nodemanager 知道资源管理器在哪里.具体来说，我在 yarn-site.xml 中添加了这个属性:

Problem solved. Some configuration should be done in yarn-site.xml to let the nodemanager know where is the resource manager. Specifically, I added this property into yarn-site.xml:

  <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>master</value>
  </property>

原因:yarn-default.xml中的默认值是0.0.0.0，很多属性使用这个主机名来联系资源管理器，比如

Reason: the default value in yarn-default.xml is 0.0.0.0, and many properties use this hostname to contact resource manager, such as

<property>
    <name>yarn.resourcemanager.address</name>
    <value>${yarn.resourcemanager.hostname}:8032</value>
</property>

答案学分:https://stackoverflow.com/a/22125279/3209177

这篇关于从节点不在 Yarn ResourceManager 中的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！