hadoop 2.2 - datanode不启动 [英] hadoop 2.2 - datanode doesn't start up

问题描述

今天早上我有Hadoop 2.4（参见我以前的2个问题）。现在我删除它，并安装2.2，因为我有问题与2.4，也因为我认为2.2是最新的稳定版本。现在我在这里跟着教程：

http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html?m=1

当我运行jps时，我确实做了所有事情，但我仍然面临类似的问题。很显然，数据节点没有启动。

我又在做什么错了？

$
$ b

  hduser @ test02：〜$ start-dfs.sh 
 
任何帮助都会得到很多赞赏。 b $ b 14/06/06 18:12:45 WARN util.NativeCodeLoader：无法为您的平台加载native-hadoop库......在适用的情况下使用builtin-java类
不正确的配置：namenode address dfs.namenode .servicerpc-address或dfs.namenode.rpc-address未配置。 
在[]上启动namenodes 
 localhost：启动namenode，记录到/usr/local/hadoop/logs/hadoop-hduser-namenode-test02.out 
 localhost：启动datanode，记录到/ usr / local / hadoop / logs / hadoop-hduser-datanode-test02.out 
 localhost：Java HotSpot（TM）64位服务器VM警告：您已经加载了/ usr / local / hadoop / lib / native / libhadoop.so.1.0.0可能会禁用堆栈后卫。虚拟机现在会尝试修复堆栈后卫。 
 localhost：强烈建议您使用'execstack -c< libfile>'修复库，或者将其与'-z noexecstack'链接。 
启动辅助名称节点[0.0.0.0] 
 0.0.0.0：启动secondarynamenode，记录到/usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-test02.out 
 0.0.0.0 ：Java HotSpot（TM）64位服务器VM警告：您已加载可能已禁用堆栈后卫的库/usr/local/hadoop/lib/native/libhadoop.so.1.0.0。虚拟机现在会尝试修复堆栈后卫。 
 0.0.0.0：强烈建议您使用'execstack -c< libfile>'来修复库，或者使用'-z noexecstack'链接它。 
 14/06/06 18:13:01 WARN util.NativeCodeLoader：无法为您的平台加载native-hadoop库......在适用的情况下使用builtin-java类
 hduser @ test02：〜$ jps 
 2201 Jps 
 hduser @ test02：〜$ jps 
 2213 Jps 
 hduser @ test02：〜$ start-yarn 
 start-yarn：找不到命令
 hduser @ test02：〜$ start-yarn.sh 
启动yarn daemons 
启动resourcemanager，记录到/usr/local/hadoop/logs/yarn-hduser-resourcemanager-test02.out 
 localhost：启动nodemanager，记录到/usr/local/hadoop/logs/yarn-hduser-nodemanager-test02.out 
 hduser @ test02：〜$ jps 
 2498 NodeManager 
 2264 ResourceManager 
 2766 Jps 
 hduser @ test02：〜$ jps 
 2784 Jps 
 2498 NodeManager 
 2264 ResourceManager 
 hduser @ test02：〜$ jps 
 2498 NodeManager 
 2264 ResourceManager 
 2796 Jps 
 hduser @ test02：〜$ 
  

解决方案

我的问题是，我从教程中将这些说明放在了太亮的位置
$ b

在<配置>
$ b $之间粘贴以下内容b fs.default.name

hdfs：// localhost：9000

我怀疑这是错误的它仍然是我做到的。

由于 core-site.xml 文件是XML格式，因此看起来不正确。

实际上，它需要看起来像这样。

 <属性> 
<名称> fs.default.name< /名称> 
< value> hdfs：// localhost：9000< / value> 
< / property> 
  

将其更改为此可解决我的问题。

I had Hadoop 2.4 this morning (see my previous 2 questions). Now I removed it and installed 2.2 as I had issues with 2.4, and also as I think 2.2 is the latest stable release. Now I followed the tutorial here:

http://codesfusion.blogspot.com/2013/10/setup-hadoop-2x-220-on-ubuntu.html?m=1

I am pretty sure I did everything right but I am facing similar issues again.

When I run jps it is obvious that the data node is not starting up.

What am I doing wrong again?

Any help would be much much appreciated.

hduser@test02:~$ start-dfs.sh
14/06/06 18:12:45 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.
Starting namenodes on []
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-test02.out
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-test02.out
localhost: Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
localhost: It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
Starting secondary namenodes [0.0.0.0]
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-test02.out
0.0.0.0: Java HotSpot(TM) 64-Bit Server VM warning: You have loaded library /usr/local/hadoop/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
0.0.0.0: It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
14/06/06 18:13:01 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
hduser@test02:~$ jps
2201 Jps
hduser@test02:~$ jps
2213 Jps
hduser@test02:~$ start-yarn
start-yarn: command not found
hduser@test02:~$ start-yarn.sh
starting yarn daemons
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn-hduser-resourcemanager-test02.out
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-hduser-nodemanager-test02.out
hduser@test02:~$ jps
2498 NodeManager
2264 ResourceManager
2766 Jps
hduser@test02:~$ jps
2784 Jps
2498 NodeManager
2264 ResourceManager
hduser@test02:~$ jps
2498 NodeManager
2264 ResourceManager
2796 Jps
hduser@test02:~$

解决方案

My problem was that I took these instructions from the tutorial too literally.

Paste following between <configuration>
fs.default.name
hdfs://localhost:9000

I suspected this was wrong while doing it but still I did it.
It seemed incorrect as the core-site.xml file is in XML format.
So actually, it needs to look like this.

<property>
<name>fs.default.name</name>
<value>hdfs://localhost:9000</value>
</property>

Changing it to this fixed my problem.

这篇关于hadoop 2.2 - datanode不启动的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！