Hadoop2- YARN-ApplicationMaster UI-连接被拒绝的问题 [英] Hadoop2- YARN - ApplicationMaster UI - Connection refused issue

问题描述

从RM WebUI(hadoop 2.6.0)访问ApplicationMaster UI时遇到以下问题.没有运行独立的WebProxy服务器.代理作为ResourceManager的一部分运行.

I'm getting below issue while accessing ApplicationMaster UI from the RM WebUI (hadoop 2.6.0). There is no standalone WebProxy server running. The Proxy is running as a part of ResourceManager.

"HTTP ERROR 500
Problem accessing /proxy/application_1431357703844_0004/. Reason:
    Connection refused"

resourcemanager日志中的日志条目:

Log entries in resourcemanager logs:

2015-05-11 19:25:01,837 INFO  webproxy.WebAppProxyServlet (WebAppProxyServlet.java:doGet(330)) - ubuntu is accessing unchecked http://slave1:51704/ which is the app master GUI of application_1431357703844_0004 owned by ubuntu
2015-05-11 19:25:01,845 WARN  mortbay.log (Slf4jLog.java:warn(76)) - /proxy/application_1431357703844_0004/: java.net.ConnectException: Connection refused

当我从RM中获取AppMaster Url时，输出如下

When I do wget of the AppMaster Url from RM, below is the output

ubuntu@resource-manager:/mnt/logs/yarn$ wget -O- "http://slave1:51704/"
--2015-05-11 19:26:47--  http://slave1:51704/
HTTP request sent, awaiting response... 302 Found
Location: http://slave1:51704/mapreduce [following]
--2015-05-11 19:26:47--  http://slave1:51704/mapreduce
HTTP request sent, awaiting response... 302 Found
Location: http://slave1:8088/proxy/application_1431357703844_0004/mapreduce [following]
--2015-05-11 19:26:47--  http://slave1:8088/proxy/application_1431357703844_0004/mapreduce
Connecting to slave1|:8088... failed: Connection refused.

当我从运行appMaster的节点上获取相同的AppMaster URL时，得到200条响应.

When i do wget of same AppMaster URL from the node where appMaster is running, I got 200 response.

ubuntu@slave1:~$ wget -O- http://slave1:51704/
--2015-05-11 19:31:13--  http://slave1:51704/
Connecting to slave1|:51704... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://slave1:51704/mapreduce [following]
--2015-05-11 19:31:13--  http://slave1:51704/mapreduce
HTTP request sent, awaiting response... 200 OK
Length: 6846 (6.7K) [text/html]

这里要注意的主要区别是，当从RM发出请求时，nodemanager重定向到另一个URL"

The main difference to note here is, when the request was made from RM, the nodemanager redirected to a different URL "http://slave1:8088/proxy/application_1431357703844_0004/mapreduce" which resulted in "Connection refused". But when the request was made from where NM was running, it didn't redirect to above URL, but resulted in 200 response.

请帮助我了解重定向的不同行为并解决问题.

Please help me understand the differential behaviour of redirection and resolve the issue.

推荐答案

您可以在NodeManager设备上的yarn-site.xml中将yarn.resourcemanager.webapp.address指定为RM的主机地址.

You can specify the yarn.resourcemanager.webapp.address to your RM's host address in yarn-site.xml on NodeManager device.

<property>
    <name>yarn.resourcemanager.webapp.address</name>
    <value>rm.hostname.com:8088</value>
</property>

不是

<property>
    <name>yarn.resourcemanager.webapp.address</name>
    <value>0.0.0.0:8088</value>
</property>

这篇关于Hadoop2- YARN-ApplicationMaster UI-连接被拒绝的问题的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！