运行mapreduce hadoop作业时,纱线UI中未显示应用程序? [英] Applications not shown in yarn UI when running mapreduce hadoop job?

查看:91
本文介绍了运行mapreduce hadoop作业时,纱线UI中未显示应用程序?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我正在使用Hadoop2.2.我看到我的工作成功完成了.我可以浏览文件系统以找到输出.但是,当我浏览http://NNode:8088/cluster/apps时,无法看到到目前为止已完成的任何应用程序(我运行了3个wordcount作业,但此处未显示任何作业).

I am using Hadoop2.2. I see that my jobs are completed with success. I can browse the filesystem to find the output. However, when I browse http://NNode:8088/cluster/apps, I am unable to see any applications that have been completed so far ( I ran 3 wordcount jobs, but none of it is seen here).

是否需要考虑任何配置?

Are there any configurations that need to be taken into account?

这是yarn-site.xml

<property>
        <name>yarn.resourcemanager.hostname</name>
        <value>NNode</value>
    </property>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
<!--
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>
-->

这里是mapred-site.xml:

<property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>

我也正在运行作业历史记录服务器:

I have job history server running too:

jps
4422 NameNode
5452 Jps
4695 SecondaryNameNode
4924 ResourceManager
72802 Jps
5369 JobHistoryServer

推荐答案

您可以参考

我在集群中进行了测试.可行!

I tested in my cluster. It works!

这篇关于运行mapreduce hadoop作业时,纱线UI中未显示应用程序?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆