Hadoop作业和任务跟踪器不工作 [英] Hadoop Job and Task Tracker not working

查看:182
本文介绍了Hadoop作业和任务跟踪器不工作的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

当我开始hadoop作业跟踪器和任务跟踪器不工作。

when i start hadoop job tracker and task tracker not working.

我使用两台电脑。 master- furkanb @ master 192.168.2.135和slave-detay @ slave
192.168.2.250。

I'm working with two computers. master- furkanb@master 192.168.2.135 and slave- detay@slave 192.168.2.250.

xml并在两台计算机上托管相同的文件。

xml and hosts files the same on 2 computers.

我已写入控制台jps。

I have written to the console jps.

15568 Jps
12126 SecondaryNameNode
11812 NameNode
11934 DataNode
12314 ResourceManager

15568 Jps 12126 SecondaryNameNode 11812 NameNode 11934 DataNode 12314 ResourceManager

我的主机文件



/ etc / hosts



My host file


127.0.0.1 localhost

127.0.0.1 localhost

127.0.1.1 ubuntu.ubuntu-domain ubuntu

127.0.1.1 ubuntu.ubuntu-domain ubuntu

192.168.2.135主

192.168.2.135 master

192.168.2.250 slave

192.168.2.250 slave



core-site.xml



core-site.xml

<configuration>

<property>
   <name>fs.default.name</name>
   <value>hdfs://master:54310</value>
</property>

</configuration>



hdfs-site.xml



hdfs-site.xml

<configuration>
<property>
   <name>dfs.replication</name>
   <value>2</value>
</property>
</configuration>



mapred-site.xml



mapred-site.xml

<configuration>

<property>
   <name>mapred.job.tracker</name>
   <value>master:54311</value>
</property>

<property>
   <name>mapreduce.framework.name</name>
   <value>yarn</value>
</property>

</configuration>



yarn-site.xml



yarn-site.xml

<configuration>
 <property>
 <name>yarn.nodemanager.aux-services</name>
 <value>mapreduce.shuffle</value>
 </property>
 <property>
 <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
 <value>org.apache.hadoop.mapred.ShuffleHandler</value>
 </property>
</configuration>

主机:


/ etc / hadoop / masters furkanb @ master

/etc/hadoop/masters furkanb@master

/ etc / hadoop / slaves furkanb @ master detay @ slave

/etc/hadoop/slaves furkanb@master detay@slave

奴隶机器:


/ etc / hadoop / slaves localhost

/etc/hadoop/slaves localhost

当我在控制台上写start-all.sh:

When i write start-all.sh on console :

This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
14/04/09 14:52:58 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [master]
master: starting namenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-namenode-master.out
furkanb@master: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-datanode-master.out
detay@slave: starting datanode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-detay-datanode-slave.out
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop-2.3.0/logs/hadoop-furkanb-secondarynamenode-master.out
14/04/09 14:53:19 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-resourcemanager-master.out
furkanb@master: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-furkanb-nodemanager-master.out
detay@slave: starting nodemanager, logging to /usr/local/hadoop-2.3.0/logs/yarn-detay-nodemanager-slave.out

我可以达到localhost:50070和master:50070。但我不能到达localhost:50030或master:50030

I can reach localhost:50070 and master:50070. But i can't reach localhost:50030 or master:50030

推荐答案

您使用Yarn不是经典mapreduce。你在这里找不到Jobtracker。要检查正在运行的应用程序的状态,您需要使用资源管理器的http端口。即8088

You are using Yarn not classic mapreduce. You cannot find Jobtracker here. For checking the status of running applications you need to use resource manager's http port. ie 8088

查看以下网址
localhost:8088

Check out the following URL localhost:8088

这篇关于Hadoop作业和任务跟踪器不工作的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆