无法正常启动hadoop datanode [英] Couldn't start hadoop datanode normally

问题描述

我正试图安装hadoop 2.2.0，我在启动dataenode服务时遇到了以下类型的错误，请帮我解决这个问题。感谢提前。

2014-03-11 08：48：16,406 INFO org.apache.hadoop.hdfs.server.common.Storage：锁定/home/prassanna/usr/local/hadoop/yarn_data/hdfs/datanode/in_use.lock获取by nodename 3627 @ prassanna-Studio-1558
2014-03-11 08：48：16,426 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode：块池初始化失败块池BP-611836968-127.0 .1.1-1394507838610（存储ID DS-1960076343-127.0.1.1-50010-1394127604582）service localhost / 127.0.0.1：9000
java.io.IOException：/ home / prassanna / usr / local / hadoop / yarn_data / hdfs / datanode：namenode clusterID = CID-fb61aa70-4b15-470e-a1d0-12653e357a10; datanode clusterID = CID-8bf63244-0510-4db6-a949-8f74b50f2be9
at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition（DataStorage.java:391）
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead（DataStorage.java:219）$ org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead（DataStorage.java:191）
b $ b at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage（DataNode.java:837）
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool（DataNode.java ：808）
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo（BPOfferService.java:280）
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake （BPServiceActor.java:222）
在org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run（BPServiceActor.java:664）
在java.lang.Thread.run（Thread.java ：662）
2014-03-11 08:48:16,427 WARN org.apache.hadoop.hdfs .server.datanode.DataNode：结束块池服务用于：块池BP-611836968-127.0.1.1-1394507838610（存储标识DS-1960076343-127.0.1.1-50010-1394127604582）service localhost / 127.0.0.1：9000
2014-03-11 08:48:16,532 INFO org.apache.hadoop.hdfs.server.datanode.DataNode：已删除块池BP-611836968-127.0.1.1-1394507838610（存储ID DS-1960076343-127.0.1.1- 50010-1394127604582）
2014-03-11 08:48:18,532 WARN org.apache.hadoop.hdfs.server.datanode.DataNode：退出Datanode
2014-03-11 08:48:18,534 INFO org.apache.hadoop.util.ExitUtil：以状态0退出
2014-03-11 08：48：18,536 INFO org.apache.hadoop.hdfs.server.datanode.DataNode：SHUTDOWN_MSG：
/的 * ** * ** * ** * ** * ** * ** * ** * ** * ** * ** * ***
SHUTDOWN_MSG：在prassanna-Studio-1558 / 127.0.1.1关闭DataNode

解决方案

这只是表明datan请检查hadoop安装文件夹下的日志文件夹下的datanode日志（除非您更改了该配置）以查看异常情况。它通常指向某种配置问题，特别是。网络设置（/ etc / hosts）相关，但有很多可能性。

i am trying to install hadoop 2.2.0 i am getting following kind of error while starting dataenode services please help me resolve this issue.Thanks in Advance.

2014-03-11 08:48:16,406 INFO org.apache.hadoop.hdfs.server.common.Storage: Lock on /home/prassanna/usr/local/hadoop/yarn_data/hdfs/datanode/in_use.lock acquired by nodename 3627@prassanna-Studio-1558 2014-03-11 08:48:16,426 FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for block pool Block pool BP-611836968-127.0.1.1-1394507838610 (storage id DS-1960076343-127.0.1.1-50010-1394127604582) service to localhost/127.0.0.1:9000 java.io.IOException: Incompatible clusterIDs in /home/prassanna/usr/local/hadoop/yarn_data/hdfs/datanode: namenode clusterID = CID-fb61aa70-4b15-470e-a1d0-12653e357a10; datanode clusterID = CID-8bf63244-0510-4db6-a949-8f74b50f2be9 at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:391) at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:191) at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:219) at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:837) at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:808) at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:280) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:222) at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:664) at java.lang.Thread.run(Thread.java:662) 2014-03-11 08:48:16,427 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool BP-611836968-127.0.1.1-1394507838610 (storage id DS-1960076343-127.0.1.1-50010-1394127604582) service to localhost/127.0.0.1:9000 2014-03-11 08:48:16,532 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: Removed Block pool BP-611836968-127.0.1.1-1394507838610 (storage id DS-1960076343-127.0.1.1-50010-1394127604582) 2014-03-11 08:48:18,532 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Exiting Datanode 2014-03-11 08:48:18,534 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 0 2014-03-11 08:48:18,536 INFO org.apache.hadoop.hdfs.server.datanode.DataNode: SHUTDOWN_MSG: /********************************** SHUTDOWN_MSG: Shutting down DataNode at prassanna-Studio-1558/127.0.1.1

解决方案

That simply shows that the datanode tried to startup but took some exception and died.

Please check the datanode log under the logs folder in the hadoop installation folder (unless you changed that config) for exceptions. It usually points to a configuration issue of some kind, esp. network settings (/etc/hosts) related but there are quite a few possibilities.

这篇关于无法正常启动hadoop datanode的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！