Hadoop Nodemanager和Resourcemanager无法启动 [英] Hadoop Nodemanager and Resourcemanager not starting

问题描述

我试图在Ubuntu 13.10 64位上设置最新的Hadoop 2.2单节点群集。操作系统是全新的安装，并且我尝试了使用java-6 64位和java-7 64位。

按照这个，失败后从这个链接，我无法使用以下命令启动 nodemanager 和 resourcemanager ：

  sbin / yarn-daemon.sh start nodemanager 
 sudo sbin / yarn-daemon.sh start nodemanager 
  

和资源管理器

  sbin / yarn-daemon.sh start resourcemanager 
 sudo sbin / yarn-daemon.sh start resourcemanager 
  

并且都会失败并显示错误：

 启动nodemanager，记录到/home/hduser/yarn/hadoop-2.2.0/logs/yarn-hduser-nodeman ager-ubuntu.out 
线程main中的异常java.lang.NoClassDefFoundError：org / apache / hadoop / service / CompositeService $ b在java.lang.ClassLoader.defineClass1（本地方法）
在java.lang.ClassLoader.defineClass（ClassLoader.java:788）$ java.util.SecureClassLoader.defineClass（SecureClassLoader.java:142）
在java.net.URLClassLoader.defineClass（$ URBlassLoader.java ：447）在java.net.URLClassLoader.access处
（URLClassLoader.java:71）在java.net.URLClassLoader处
 $ 1.run（URLClassLoader.java:361）在java处
。 net.URLClassLoader $ 1.run（URLClassLoader.java:355）
 at java.security.AccessController.doPrivileged（Native Method）$ b $ at java.net.URLClassLoader.findClass（URLClassLoader.java:354）
  

资源管理器失败并出现类似错误： NoClassDefFoundError

我一直在尝试这个好几个小时，并尝试过Google，但没有任何成效。请让我知道我错过了什么。 a>和此链接，但搜索解决方案无效。

我曾尝试使用java-6和java-7 64位，但没有成功。

编辑 接受的答案设法消除了异常，所有的守护进程现在都开始了，但运行作业时仍然存在异常，这在这个问题

解决方案

这些指令很陈旧，似乎反映了早期alpha版本之一。进行此更改：YARN_HOME - > HADOOP_YARN_HOME。该环境变量在一段时间后重新命名。这应该可以解决您的问题。

您可以使用Apache Ambari 1.4.1来简化Hadoop及其许多生态系统组件的安装。您可以参阅 http://docs.hortonworks.com/#2.0 了解如何使用Ambari进行安装。

I am trying to setup the latest Hadoop 2.2 single node cluster on Ubuntu 13.10 64 bit. the OS is a fresh installation, and I have tried using both java-6 64 bit and java-7 64 bit.

After following the steps from this and after failing, from this link, I am not able to start nodemanager and resourcemanager with the command:

sbin/yarn-daemon.sh start nodemanager
sudo sbin/yarn-daemon.sh start nodemanager

and resource manager with

sbin/yarn-daemon.sh start resourcemanager
sudo sbin/yarn-daemon.sh start resourcemanager

and both fails with error:

starting nodemanager, logging to /home/hduser/yarn/hadoop-2.2.0/logs/yarn-hduser-nodemanager-ubuntu.out
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/service/CompositeService
    at java.lang.ClassLoader.defineClass1(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:788)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:447)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)

Resource Manager fails with similar error: NoClassDefFoundError

I have been trying this for many hours and have tried Google and nothing worked. Please let me know what I have missed. This and this link while searching for a solution didn't work.

I have tried using both java-6 and java-7 64 bit, with no success.

Edit

The accepted answer managed to get rid of the exception and all the daemons are now starting but there is still an exception while running jobs, mentioned in this question

解决方案

Those instructions are stale and seem to reflecting one of the very early alpha releases. Make this change: YARN_HOME -> HADOOP_YARN_HOME. The environment variable got renamed a while back. This should fix it for you.

You can use Apache Ambari 1.4.1 that eases installation of Hadoop and many of its ecosystem components. You can see http://docs.hortonworks.com/#2.0 on how to install using Ambari.

这篇关于Hadoop Nodemanager和Resourcemanager无法启动的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！