Hadoop安装问题： [英] Hadoop installation Issue:

问题描述

我遵循这个教程来安装Hadoop。不幸的是，当我运行 start-all.sh 脚本时 - 在控制台上输出以下错误：

  hduser @ dennis-HP：/ usr / local / hadoop / sbin $ start-all.sh 
此脚本已弃用。请使用start-dfs.sh和start-yarn.sh 
 hadoop配置脚本运行... 
 hdfs脚本运行... 
配置参数：
 16/04 / 10 23:45:40 WARN util.NativeCodeLoader：无法为您的平台加载native-hadoop库......在适用的情况下使用builtin-java类
在[localhost]上启动namenodes 
 localhost：mkdir：无法创建目录'/ usr / local / hadoop / logs'：权限被拒绝
 localhost：chown：无法访问'/ usr / local / hadoop / logs'：没有这样的文件或目录
 localhost：named namenode ，登录到/usr/local/hadoop/logs/hadoop-hduser-namenode-dennis-HP.out 
 localhost：/usr/local/hadoop/sbin/hadoop-daemon.sh：第159行：/ usr / local / hadoop / logs / hadoop-hduser-namenode-dennis-HP.out：没有这样的文件或目录
 localhost：head：阅读：-HP.out'：没有这样的文件或目录
 localhost：/usr/local/hadoop/sbin/hadoop-daemon.sh：第177行：/ usr / local / hadoop / logs / hadoop-hduser-namenode-dennis-HP.out：没有这样的文件或目录
 localhost：/usr/local/hadoop/sbin/hadoop-daemon.sh：第178行：/ usr / local / hadoop / logs / hadoop-hduser-namenode-dennis-HP.out：没有这样的文件或目录
 localhost：mkdir：无法创建目录'/ usr / local / hadoop / logs'：Permission denied 
 localhost：chown：can not访问'/ usr / local / hadoop / logs'：没有这样的文件或目录
 localhost：启动datanode，记录到/usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out 
 localhost：/usr/local/hadoop/sbin/hadoop-daemon.sh：第159行：/usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out：没有这样的文件或目录
 localhost：head：无法打开'/usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out'阅读：没有这样的文件或目录
 localhost：/ usr / local / hadoop /sbin/hadoop-daemon.sh：第177行：/usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out：没有这样的文件或目录
 localhost：/ usr / local / hadoop / sbin目录/公顷doop-daemon.sh：第178行：/usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out：没有这样的文件或目录
启动辅助名称节点[0.0.0.0] 
 0.0.0.0：mkdir：无法创建目录'/ usr / local / hadoop / logs'：权限被拒绝
 0.0.0.0：chown：无法访问'/ usr / local / hadoop / logs'：没有这样的文件或目录
 0.0.0.0：启动secondarynamenode，记录到/usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out 
 0.0.0.0：/ usr / local / hadoop / sbin /hadoop-daemon.sh：第159行：/usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out：没有这样的文件或目录
 0.0.0.0：head：can not open'/阅读：usr / local / hadoop / logs / hadoop-hduser-secondarynamenode-dennis-HP.out'没有这样的文件或目录
 0.0.0.0：/usr/local/hadoop/sbin/hadoop-daemon.sh ：第177行：/usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out：没有这样的文件或目录
 0.0.0.0：/ usr / local / hadoop / sbin / hadoop-daemon .sh：第178行：/ usr /local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out：没有这样的文件或目录
 16/04/10 23:45:55 WARN util.NativeCodeLoader：无法加载native-hadoop库for your platform ...在适用的地方使用builtin-java类
 yarn脚本运行... 
启动yarn守护进程
 mkdir：无法创建目录'/ usr / local / hadoop / logs' ：权限被拒绝
 chown：无法访问'/ usr / local / hadoop / logs'：没有这样的文件或目录
启动resourcemanager，登录到/ usr / local / hadoop / logs / yarn-hduser-resourcemanager -dennis -HP.out 
 /usr/local/hadoop/sbin/yarn-daemon.sh：line 124：/usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out：No这样的文件或目录
头：无法打开'/usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out'阅读：没有这样的文件或目录
 / usr / local /hadoop/sbin/yarn-daemon.sh：第129行：/usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out：没有这样的文件或目录
 /usr/local/hadoop/sbin/yarn-daemon.sh：第130行：/usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out：没有这样的文件或目录
 localhost ：mkdir：无法创建目录'/ usr / local / hadoop / logs'：权限被拒绝
 localhost：chown：无法访问'/ usr / local / hadoop / logs'：没有这样的文件或目录
 localhost ：启动nodemanager，记录到/usr/local/hadoop/logs/yarn-hduser-nodemanager-dennis-HP.out 
 localhost：/usr/local/hadoop/sbin/yarn-daemon.sh：第124行： / usr / local / hadoop / logs / yarn-hduser -n / nodemanager-dennis-HP.out'用于阅读：没有这样的文件或目录
 localhost：/usr/local/hadoop/sbin/yarn-daemon.sh：第129行：/ usr / local / hadoop / logs / yarn -hduser-nodemanager-dennis-HP.out：没有这样的文件或目录
 localhost：/usr/local/hadoop/sbin/yarn-daemon.sh：第130行：/ usr / local / hadoop / logs / yarn -hduser-节点管理器-d ennis-HP.out：没有这样的文件或目录
  

当我执行JPS命令时，以下错误被抛出

  hduser @ dennis-HP：/ usr / local / hadoop / sbin $ jps 
 3802 Jps 
  

我是hadoop的新手，所以请向我指出一篇能够帮助我安装hadoop而没有问题的文章

或者如果可能的话（更可取的是）解决这个问题，请让我知道出了什么问题以及如何解决问题？

解决方案

请使用命令chmod或chown检查文件夹上的权限是否正确。

Hadoop提供单个节点来启动和停止服务，即
Hadoop-daemon.sh start [Node]

同样有脚​​本来启动/停止纱线。
下面的文章详细介绍了安装Apache Hadoop
http：// www.hadoopstrata.com/staticpost?postNbr=7

I followed this tutorial for installation of Hadoop. Unfortunately, when I run the start-all.sh script - The following error was printed on console:

hduser@dennis-HP:/usr/local/hadoop/sbin$ start-all.sh
This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh
hadoop config script is run...
hdfs script is run...
Config parameter : 
16/04/10 23:45:40 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Starting namenodes on [localhost]
localhost: mkdir: cannot create directory ‘/usr/local/hadoop/logs’: Permission denied
localhost: chown: cannot access ‘/usr/local/hadoop/logs’: No such file or directory
localhost: starting namenode, logging to /usr/local/hadoop/logs/hadoop-hduser-namenode-dennis-HP.out
localhost: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 159: /usr/local/hadoop/logs/hadoop-hduser-namenode-dennis-HP.out: No such file or directory
localhost: head: cannot open ‘/usr/local/hadoop/logs/hadoop-hduser-namenode-dennis-HP.out’ for reading: No such file or directory
localhost: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 177: /usr/local/hadoop/logs/hadoop-hduser-namenode-dennis-HP.out: No such file or directory
localhost: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 178: /usr/local/hadoop/logs/hadoop-hduser-namenode-dennis-HP.out: No such file or directory
localhost: mkdir: cannot create directory ‘/usr/local/hadoop/logs’: Permission denied
localhost: chown: cannot access ‘/usr/local/hadoop/logs’: No such file or directory
localhost: starting datanode, logging to /usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out
localhost: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 159: /usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out: No such file or directory
localhost: head: cannot open ‘/usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out’ for reading: No such file or directory
localhost: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 177: /usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out: No such file or directory
localhost: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 178: /usr/local/hadoop/logs/hadoop-hduser-datanode-dennis-HP.out: No such file or directory
Starting secondary namenodes [0.0.0.0]
0.0.0.0: mkdir: cannot create directory ‘/usr/local/hadoop/logs’: Permission denied
0.0.0.0: chown: cannot access ‘/usr/local/hadoop/logs’: No such file or directory
0.0.0.0: starting secondarynamenode, logging to /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out
0.0.0.0: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 159: /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out: No such file or directory
0.0.0.0: head: cannot open ‘/usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out’ for reading: No such file or directory
0.0.0.0: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 177: /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out: No such file or directory
0.0.0.0: /usr/local/hadoop/sbin/hadoop-daemon.sh: line 178: /usr/local/hadoop/logs/hadoop-hduser-secondarynamenode-dennis-HP.out: No such file or directory
16/04/10 23:45:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
yarn script is run...
starting yarn daemons
mkdir: cannot create directory ‘/usr/local/hadoop/logs’: Permission denied
chown: cannot access ‘/usr/local/hadoop/logs’: No such file or directory
starting resourcemanager, logging to /usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out
/usr/local/hadoop/sbin/yarn-daemon.sh: line 124: /usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out: No such file or directory
head: cannot open ‘/usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out’ for reading: No such file or directory
/usr/local/hadoop/sbin/yarn-daemon.sh: line 129: /usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out: No such file or directory
/usr/local/hadoop/sbin/yarn-daemon.sh: line 130: /usr/local/hadoop/logs/yarn-hduser-resourcemanager-dennis-HP.out: No such file or directory
localhost: mkdir: cannot create directory ‘/usr/local/hadoop/logs’: Permission denied
localhost: chown: cannot access ‘/usr/local/hadoop/logs’: No such file or directory
localhost: starting nodemanager, logging to /usr/local/hadoop/logs/yarn-hduser-nodemanager-dennis-HP.out
localhost: /usr/local/hadoop/sbin/yarn-daemon.sh: line 124: /usr/local/hadoop/logs/yarn-hduser-nodemanager-dennis-HP.out: No such file or directory
localhost: head: cannot open ‘/usr/local/hadoop/logs/yarn-hduser-nodemanager-dennis-HP.out’ for reading: No such file or directory
localhost: /usr/local/hadoop/sbin/yarn-daemon.sh: line 129: /usr/local/hadoop/logs/yarn-hduser-nodemanager-dennis-HP.out: No such file or directory
localhost: /usr/local/hadoop/sbin/yarn-daemon.sh: line 130: /usr/local/hadoop/logs/yarn-hduser-nodemanager-dennis-HP.out: No such file or directory

And when I executed the JPS command, the following error was thrown

hduser@dennis-HP:/usr/local/hadoop/sbin$ jps
3802 Jps

I am new to hadoop so please point me to an article that will help me to install hadoop without issues

Or if possible (and more preferable) to resolve the issue faced, please let me know what went wrong and how to fix it?

解决方案

Please check permission are properly set on the folder using commands chmod or chown.

Hadoop provides individual nodes to start and stop services viz., Hadoop-daemon.sh start [Node]

Similarly there are scripts to start/stop yarn. Below post has step by stem details Install Apache Hadoop http://www.hadoopstrata.com/staticpost?postNbr=7

这篇关于Hadoop安装问题：的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！