从属节点不在Yarn ResourceManager中 [英] Slave nodes not in Yarn ResourceManager

问题描述

我建立了一个3节点的Apache Hadoop集群。在主节点上，我可以看到

I've set up a 3 node Apache Hadoop cluster. On master node, I can see

[hadoop-conf]$ jps
16856 DataNode
17051 SecondaryNameNode
16701 NameNode
21601 ResourceManager
21742 NodeManager
18335 JobHistoryServer

在slave节点上，我看到

and on slave nodes, I see

[fedora20-template dfs]$ jps
28677 Jps
28510 NodeManager
27449 DataNode

我可以看到来自master：50070的三个活动节点。但是，在ResourceManager Web UI（ http：// master：8088 / cluster / nodes ）中，我只能看到主节点。为什么两个从节点不在资源管理器中？这是否意味着它们不是用于执行mapreduce的资源的一部分？解决方案

I can see three live nodes from master:50070. However, in the ResourceManager Web UI (http://master:8088/cluster/nodes), I can see only master node. Why are the two slave nodes not in the resource manager? Does that mean they are not part of resources that are used to do mapreduce?

解决方案

一些配置应该在yarn-site.xml中完成，让nodemanager知道资源管理器在哪里。具体来说，我将这个属性添加到yarn-site.xml中：

Problem solved. Some configuration should be done in yarn-site.xml to let the nodemanager know where is the resource manager. Specifically, I added this property into yarn-site.xml:

  <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>master</value>
  </property>

原因：yarn-default.xml中的默认值是0.0.0.0，许多属性都使用这个hostname联系资源管理器，比如

Reason: the default value in yarn-default.xml is 0.0.0.0, and many properties use this hostname to contact resource manager, such as

<property>
    <name>yarn.resourcemanager.address</name>
    <value>${yarn.resourcemanager.hostname}:8032</value>
</property>

答案： https://stackoverflow.com/a/22125279/3209177

这篇关于从属节点不在Yarn ResourceManager中的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！