无法启动CDH伪群集中的Jobtracker和Tasktracker [英] Failed to start Jobtracker and Tasktracker in CDH pseudo cluster
本文介绍了无法启动CDH伪群集中的Jobtracker和Tasktracker的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！
问题描述
当我试图在R中执行map reduce并且未能与JT和TT交谈时，我注意到了这个问题。发生这种情况后，我改变了一些配置文件，但不幸的是，我忘了如何改回它（我的坏）!!
<1> JT日志：
2013-08-05 15：14：09,335 INFO org.apache.hadoop.mapred.JobTracker：STARTUP_MSG：
/ *** ************************************************** *******
STARTUP_MSG：启动JobTracker
STARTUP_MSG：host = rhadoop / 172.16.1.39
STARTUP_MSG：args = []
STARTUP_MSG：version = 2.0.0- mr1-cdh4.3.0
STARTUP_MSG：classpath = /etc/hadoop/conf:/usr/local/java/jdk1.7.0_15/lib/tools.jar:/usr/lib/hadoop-0.20-mapreduce:/ usr / lib中/ Hadoop的0.20-的MapReduce / Hadoop的芯2.0.0-MR1-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar：/ usr / lib中/ Hadoop的0.20-映射精简/ LIB /蚂蚁的contrib-1.0b3.jar：/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/avro -1.7.4.jar：/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0的.jar：在/ usr / LIB / Hadoop的0.20-映射精简/ LIB /公地BeanUtils的核 - 1.8.0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar：/ usr / lib中/ hadoop- 0.20-映射精简/ LIB /公地编解码器-1.4.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/公地压缩-1.4.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8。罐子：/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar：/ usr / lib中/ Hadoop的-0.20-MapReduce的/ lib目录/公地IO-2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons -logging-1.1.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1。 8.0.10.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8。 8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8。罐子：/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar：在/ usr /lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar:/usr/lib /hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib /jersey-server-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar:/ usr / lib中/ Hadoop的0.20-映射精简/ LIB /码头-6.1.26.cloudera.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar：/ usr / lib中/ Hadoop的0.20-映射精简/ LIB / JSP-API-2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar：/usr/lib/hadoop-0.20-mapreduce/lib/ JUnit的-4.8.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar：在/ usr /lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop-0.20 -mapreduce / LIB / paranamer-2.3.jar：/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar：/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api -2.5.jar：/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar：/ usr / lib中/ hadoop- 0.20-映射精简/ LIB / XZ-1.0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/ JSP-2.1 / JSP-2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar：在/ etc / hadoop的/ CONF：/ usr / lib中/ hadoop的/ lib中/ CO MMONS-数学2.1.jar：/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar：/usr/lib/hadoop/lib/commons-net-3.1.jar：/ usr / lib中/ Hadoop的/lib/jsr305-1.3.9.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/ Hadoop的/ lib目录/ JSP-API-2.1.jar：/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar：/usr/lib/hadoop/lib/commons-collections-3.2.1。罐子：/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar：/usr/lib/hadoop/lib/commons-el-1.0.jar：/ usr / lib中/ Hadoop的/ lib目录/公地的BeanUtils -1.7.0.jar：/usr/lib/hadoop/lib/log4j-1.2.17.jar：/usr/lib/hadoop/lib/commons-lang-2.5.jar：/ usr / lib中/ Hadoop的/ lib目录/ XZ-1.0.jar：/usr/lib/hadoop/lib/jsch-0.1.42.jar：/usr/lib/hadoop/lib/commons-httpclient-3.1.jar：/ usr / lib中/ hadoop的/ LIB /的JetS3t -0.6.1.jar：/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar：/usr/lib/hadoop/lib/activation-1.1.jar：/ usr / lib中/ Hadoop的/ lib目录/码头-UTIL-6.1.26.cloudera.2.jar：/usr/lib/hadoop/lib/commons-digester-1.8.jar：/usr/lib/hadoop/lib/avro-1.7.4.jar：在/ usr /lib/hadoop/lib/stax-api-1.0.1.jar:/usr/lib/hadoop/lib/commons-beanut ILS-核心1.8.0.jar：/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar：/usr/lib/hadoop/lib/mockito-all-1.8.5.jar：在/ usr /lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/ LIB / Hadoop的/ lib目录/公地压缩-1.4.1.jar：/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar：/usr/lib/hadoop/lib/jersey-server-1.8。罐子：/usr/lib/hadoop/lib/jline-0.9.94.jar：/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar：/ usr / lib中/ Hadoop的/ lib目录/ xmlenc -0.52.jar：/usr/lib/hadoop/lib/junit-4.8.2.jar：/usr/lib/hadoop/lib/jersey-core-1.8.jar：/ usr / lib中/ Hadoop的/ lib目录/ guava- 11.0.2.jar：/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar：/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar：/ usr / lib目录/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar ：/usr/lib/hadoop/lib/commons-io-2.1.jar：/usr/lib/hadoop/lib/commons-codec-1.4.jar：/usr/lib/hadoop/lib/jettison-1.1.jar： /usr/lib/hadoop/lib/jersey-json-1.8.jar:/usr/lib/hadoop/lib/kfs-0.3.j AR：/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar：/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.3.0.jar：/ usr / lib中/ Hadoop的/ lib目录/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop/.//hadoop-annotations-2.0.0-cdh4.3.0.jar:/usr/lib/hadoop/.//hadoop-common -2.0.0-cdh4.3.0.jar：/ usr / lib中/ hadoop的/.// Hadoop的common.jar：/ usr / lib中/ hadoop的/.// Hadoop的共2.0.0-cdh4.3.0检验的.jar：/ usr / lib中/ hadoop的/.// Hadoop的annotations.jar：/ usr / lib中/ hadoop的/.// Hadoop的auth.jar：/ usr / lib中/ hadoop的/.//的hadoop-AUTH-2.0 0.0-cdh4.3.0.jar：/ usr / lib中/ Hadoop的HDFS /./:/ usr / lib中/ Hadoop的HDFS / LIB / jsr305-1.3.9.jar：/ usr / lib中/ Hadoop的HDFS / lib中/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/ LIB / Hadoop的HDFS / LIB /杰克逊映射器-ASL-1.8.8.jar：/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar：/ usr / lib中/ Hadoop的HDFS / LIB /公共-EL-1.0.jar：/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar：/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar：在/ usr /lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2的.jar：/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar：/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar：/ usr / lib中/ hadoop- HDFS / lib中/的JLine-0.9.94.jar：/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar：/usr/lib/hadoop-hdfs/lib/xmlenc-0.52。罐子：/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar：/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar：/ usr / lib中/ Hadoop的HDFS / lib目录/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar:/ usr / lib目录/ Hadoop的HDFS / lib目录/公地编解码器1.4.jar：/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.3.0.jar：/ usr / lib中/ Hadoop的HDFS / LIB /杰克逊核-ASL-1.8.8.jar：/ usr / lib中/ Hadoop的HDFS /.// Hadoop的HDFS-2.0.0-cdh4.3.0.jar：/ usr / lib中/ Hadoop的HDFS /。 //hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.0-cdh4.3.0-tests.jar:/usr/lib/hadoop-yarn/.//*： /usr/lib/hadoop-0.20-mapreduce/./:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-编译器5.5.23.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3 .1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar：/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar：/ usr / lib中/ Hadoop的0.20-映射精简/ LIB /碧玉运行时5.5.23.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar：/usr/lib/hadoop-0.20-mapreduce/ LIB /杰克逊映射器-ASL-1.8.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/活泼的Java-1.0.4.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7。 0.jar：/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar：/ usr / lib目录/hadoop-0.20-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons -httpclient-3.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1。 26.cloudera.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar： /usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar:/usr/lib /hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop -0.20-映射精简/ LIB / paranamer-2.3.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli -1.2.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar：/ usr / lib中/ hadoop- 0.20-映射精简/ LIB /的JLine-0.9.94.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar：/usr/lib/hadoop-0.20-mapreduce/ LIB / xmlenc-0.52.jar：/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar：/ usr / lib中/ h的adoop-0.20-映射精简/ LIB /球衣核-1.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar：/usr/lib/hadoop-0.20-mapreduce/lib /guava-11.0.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api -1.6.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar ：/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar：/ usr / lib中/ Hadoop的0.20-映射精简/ LIB /公地-IO-2.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar：/usr/lib/hadoop-0.20-mapreduce/lib/抛弃-1.1.jar：/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar：/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar：/ usr / lib目录/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar:/usr /lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-cor的e-ASL-1.8.8.jar：/usr/lib/hadoop-0.20-mapreduce /.// Hadoop的蚂蚁2.0.0-MR1-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce /.//hadoop-ant.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-tools.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-tools-2.0。 0-MR1-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce /.// Hadoop的芯2.0.0-MR1-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce /.//hadoop-test.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-core.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-test-2.0。 0-MR1-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce /.// Hadoop的例子-2.0.0-MR1-cdh4.3.0.jar：/usr/lib/hadoop-0.20-mapreduce /.//hadoop-examples.jar
STARTUP_MSG：build = file：///data/1/jenkins/workspace/generic-package-ubuntu64-10-04/CDH4.3.0-Packaging-Hadoop-2013- 05-27_19-02-30 / hadoop-2.0.0 + 1357-1.cdh4.3.0.p0.21〜lucid / src / hadoop-mapreduce1-project -r未知;由'jenkins'于5月27日星期一19:57:14 PDT 2013
STARTUP_MSG：java = 1.7.0_15
编译******************* ***************************************** /
2013-08- 05 15：14：09,342 INFO org.apache.hadoop.mapred.JobTracker：为[TERM，HUP，INT]注册的UNIX信号处理程序
2013-08-05 15:14:14,823 INFO org.apache.hadoop。 security.token.delegation.AbstractDelegationTokenSecretManager：更新当前主密钥以生成委托令牌
2013-08-05 15：14：14,836 INFO org.apache.hadoop.mapred.JobTracker：使用（memSizeForMapSlotOnJT，memSizeForReduceSlotOnJT， limitMaxMemForMapTasks，limitMaxMemForReduceTasks）（-1，-1，-1，-1）
2013-08-05 15：14：14,837 INFO org.apache.hadoop.util.HostsFileReader：刷新主机（包含/排除）列表
2013-08-05 15：14：14,838 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager：启动过期的代理令牌卸妆线程，tokenRemoverScanInterval = 60分钟
2013-08-05 15：14：14,850 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager：更新当前主密钥以生成委托令牌
2013-08-05 15：14：15,081 INFO org .apache.hadoop.mapred.JobTracker：启动与所有者作为mapred的jobtracker
2013-08-05 15：14：15,230信息org.apache.hadoop.ipc.Server：启动Socket读取器＃1端口8021
2013-08-05 15：14：15,361 WARN org.apache.hadoop.ipc.RPC：接口接口org.apache.hadoop.mapred.TaskTrackerManager被忽略，因为它没有延伸VersionedProtocol
2013-08-05 15：14：22,145 INFO org.mortbay.log：通过org.mortbay.log.Slf4jLog记录到org.slf4j.impl.Log4jLoggerAdapter（org.mortbay.log）
2013-08-05 15：14：22,306 INFO org.apache.hadoop.http.HttpServer：添加全局过滤器'safety'（class = org.apache.hadoop.http.HttpServer $ QuotingInputFilter）
2013-08-05 15：14：22,310 INFO org.apache .hadoop.http.HttpServer：添加过滤器static_user_filter（class = org.apache.hadoo p.http.lib.StaticUserWebFilter $ StaticUserFilter）到上下文作业
2013-08-05 15：14：22,314 INFO org.apache.hadoop.http.HttpServer：添加了过滤器static_user_filter（class = org.apache.hadoop。 http.lib.StaticUserWebFilter $ StaticUserFilter）到上下文日志
2013-08-05 15：14：22,314 INFO org.apache.hadoop.http.HttpServer：添加了过滤器static_user_filter（class = org.apache.hadoop.http。 lib.StaticUserWebFilter $ StaticUserFilter）上下文静态
2013-08-05 15：14：22,689 INFO org.apache.hadoop.http.HttpServer：Jetty绑定到端口50030
2013-08-05 15： 14：22,689信息org.mortbay.log：jetty-6.1.26.cloudera.2
2013-08-05 15：14：23,908信息org.mortbay.log：已启动SelectChannelConnector@0.0.0.0：50030
2013-08-05 15：14：24,065 WARN org.apache.hadoop.conf.Configuration：session.id已弃用。相反，使用dfs.metrics.session-id
2013-08-05 15：14：24,075 INFO org.apache.hadoop.metrics.jvm.JvmMetrics：使用processName = JobTracker，sessionId = $ b $初始化JVM度量标准b 2013-08-05 15：14：24,117 INFO org.apache.hadoop.mapred.JobTracker：JobTracker最高为：8021
2013-08-05 15：14：24,117 INFO org.apache.hadoop.mapred。 JobTracker：JobTracker webserver：50030
2013-08-05 15：14：25,374 FATAL org.apache.hadoop.mapred.JobTracker：java.lang.IllegalArgumentException：错误的FS：file：/ var / lib / hadoop-hdfs / cache / mapred / mapred / system，期望：hdfs：// rhadoop：8020
at org.apache.hadoop.fs.FileSystem.checkPath（FileSystem.java:625）
at org.apache。 hadoop.fs.FileSystem.makeQualified（FileSystem.java:445）
位于org.apache.hadoop.mapred.JobTracker.getSystemDir（JobTracker.java:4174）
位于org.apache.hadoop.mapred。 < init>（JobTracker.java:1941）
at org.apache.hadoop.mapred.JobTracker。< init>（JobTracker.java:1747）
at org.apache.ha doop.mapred.JobTracker.startTracker（JobTracker.java:305）
位于org.apache.hadoop.mapred.JobTracker.startTracker（JobTracker.java:297）
位于org.apache.hadoop.mapred。 JobTracker.main（JobTracker.java:4538）
2013-08-05 15：14：25,383 INFO org.apache.hadoop.mapred.JobTracker：SHUTDOWN_MSG：
/ **** ************************************************** ******
SHUTDOWN_MSG：关闭rhadoop的JobTracker / 172.16.1.39
**
** * ** * ** * ** * ** * ** * ** * ** * ** * ** /
<2> TT记录（超过身体限制，所以只有我'b
2013-08-05 14：55：07,215 WARN org.apache.hadoop.mapred .TaskTracker：TaskTracker本地目录文件：/// var / lib / hadoop-hdfs / cache / mapred / mapred / local error目录不可读：file：/// var / lib / hadoop-hdfs / cache / mapred / mapred /本地，从本地dirs
2中删除013-08-05 14：55：07,217错误org.apache.hadoop.mapred.TaskTracker：无法启动任务跟踪器，因为org.apache.hadoop.util.DiskChecker $ DiskErrorException：没有mapred本地目录可写
at org.apache.hadoop.mapred.TaskTracker $ LocalStorage.checkDirs（TaskTracker.java:279）
at org.apache.hadoop.mapred.TaskTracker。< init>（TaskTracker.java:1710）
在org.apache.hadoop.mapred.TaskTracker.main（TaskTracker.java:4041）
2013-08-05 14：55：07,225 INFO org.apache.hadoop.mapred.TaskTracker：SHUTDOWN_MSG：
/ ********************************************* ***************
SHUTDOWN_MSG：关闭rhadoop上的TaskTracker / 172.16.1.39
**************** ******************************************** /
3）以下是我的/ etc / hosts文件：
127.0.0.1 localhost
172.16.1.39 rhadoop
4）以及我在core-site.xml中的配置：
<性>
<名称> fs.default.name< /名称>
< value> hdfs：// rhadoop：8020< / value>
< / property>
5）和我的mapred-site.xml：
< configuration>
<属性>
<名称> mapred.job.tracker< / name>
<值> rhadoop：8021< /值>
< / property>
<！ - 启用Hue插件 - >
<属性>
<名称> mapred.jobtracker.plugins< / name>
< value> org.apache.hadoop.thriftfs.ThriftJobTrackerPlugin< / value>
< description>要激活的jobtracker插件的逗号分隔列表。
< / description>
< / property>
<属性>
<名称> jobtracker.thrift.address< / name>
< value> 0.0.0.0：9290< /值>
< / property>
< / configuration>
有一点需要提及的是我在线查看了错误的FS错误，但其中大部分都是例如：
$ b
错误的FS：hdfs：xxxxxxxxxxxxx，预计：xxxxxxxxx
ked但我的错误FS：文件：XXXXXXXXXXX。
任何人都可以在这里配置一些东西吗？
解决方案
我发现了这个问题。在文件/etc/hadoop/conf/hdfs-site.xml中，有一个属性：
< property>
< name> hadoop.tmp.dir< / name>
< value> / var / lib / hadoop-hdfs / cache / $ {user.name}< /值>
< / property>
当我做了一些更改后，我不小心将值更改为：
file：/// var / lib / hadoop-hdfs / cache / $ {user.name}
导致我的问题！
I noticed this problem when I tried to execute map reduce in R and failed to talk to JT and TT. This happened after I changed some config files, but unfortunately, I forgot how to change it back (my bad)!!
1) JT log:
2013-08-05 15:14:09,335 INFO org.apache.hadoop.mapred.JobTracker: STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host = rhadoop/172.16.1.39
STARTUP_MSG: args = []
STARTUP_MSG: version = 2.0.0-mr1-cdh4.3.0
STARTUP_MSG: classpath = /etc/hadoop/conf:/usr/local/java/jdk1.7.0_15/lib/tools.jar:/usr/lib/hadoop-0.20-mapreduce:/usr/lib/hadoop-0.20-mapreduce/hadoop-core-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-2.1/jsp-api-2.1.jar:/etc/hadoop/conf:/usr/lib/hadoop/lib/commons-math-2.1.jar:/usr/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop/lib/commons-net-3.1.jar:/usr/lib/hadoop/lib/jsr305-1.3.9.jar:/usr/lib/hadoop/lib/asm-3.2.jar:/usr/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop/lib/jsp-api-2.1.jar:/usr/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop/lib/commons-el-1.0.jar:/usr/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop/lib/log4j-1.2.17.jar:/usr/lib/hadoop/lib/commons-lang-2.5.jar:/usr/lib/hadoop/lib/xz-1.0.jar:/usr/lib/hadoop/lib/jsch-0.1.42.jar:/usr/lib/hadoop/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop/lib/jets3t-0.6.1.jar:/usr/lib/hadoop/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop/lib/activation-1.1.jar:/usr/lib/hadoop/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop/lib/commons-digester-1.8.jar:/usr/lib/hadoop/lib/avro-1.7.4.jar:/usr/lib/hadoop/lib/stax-api-1.0.1.jar:/usr/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop/lib/slf4j-log4j12-1.6.1.jar:/usr/lib/hadoop/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop/lib/paranamer-2.3.jar:/usr/lib/hadoop/lib/commons-configuration-1.6.jar:/usr/lib/hadoop/lib/commons-cli-1.2.jar:/usr/lib/hadoop/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop/lib/jersey-server-1.8.jar:/usr/lib/hadoop/lib/jline-0.9.94.jar:/usr/lib/hadoop/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop/lib/xmlenc-0.52.jar:/usr/lib/hadoop/lib/junit-4.8.2.jar:/usr/lib/hadoop/lib/jersey-core-1.8.jar:/usr/lib/hadoop/lib/guava-11.0.2.jar:/usr/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop/lib/slf4j-api-1.6.1.jar:/usr/lib/hadoop/lib/servlet-api-2.5.jar:/usr/lib/hadoop/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop/lib/commons-io-2.1.jar:/usr/lib/hadoop/lib/commons-codec-1.4.jar:/usr/lib/hadoop/lib/jettison-1.1.jar:/usr/lib/hadoop/lib/jersey-json-1.8.jar:/usr/lib/hadoop/lib/kfs-0.3.jar:/usr/lib/hadoop/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop/lib/zookeeper-3.4.5-cdh4.3.0.jar:/usr/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop/.//hadoop-annotations-2.0.0-cdh4.3.0.jar:/usr/lib/hadoop/.//hadoop-common-2.0.0-cdh4.3.0.jar:/usr/lib/hadoop/.//hadoop-common.jar:/usr/lib/hadoop/.//hadoop-common-2.0.0-cdh4.3.0-tests.jar:/usr/lib/hadoop/.//hadoop-annotations.jar:/usr/lib/hadoop/.//hadoop-auth.jar:/usr/lib/hadoop/.//hadoop-auth-2.0.0-cdh4.3.0.jar:/usr/lib/hadoop-hdfs/./:/usr/lib/hadoop-hdfs/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-hdfs/lib/asm-3.2.jar:/usr/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/usr/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/lib/commons-daemon-1.0.3.jar:/usr/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/usr/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/usr/lib/hadoop-hdfs/lib/commons-lang-2.5.jar:/usr/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/usr/lib/hadoop-hdfs/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-hdfs/lib/jersey-server-1.8.jar:/usr/lib/hadoop-hdfs/lib/jline-0.9.94.jar:/usr/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/usr/lib/hadoop-hdfs/lib/jersey-core-1.8.jar:/usr/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/usr/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/usr/lib/hadoop-hdfs/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-hdfs/lib/commons-io-2.1.jar:/usr/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/usr/lib/hadoop-hdfs/lib/zookeeper-3.4.5-cdh4.3.0.jar:/usr/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.0-cdh4.3.0.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs.jar:/usr/lib/hadoop-hdfs/.//hadoop-hdfs-2.0.0-cdh4.3.0-tests.jar:/usr/lib/hadoop-yarn/.//*:/usr/lib/hadoop-0.20-mapreduce/./:/usr/lib/hadoop-0.20-mapreduce/lib/commons-math-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-compiler-5.5.23.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-net-3.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsr305-1.3.9.jar:/usr/lib/hadoop-0.20-mapreduce/lib/asm-3.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jasper-runtime-5.5.23.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsp-api-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-collections-3.2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/snappy-java-1.0.4.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-el-1.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-1.7.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/log4j-1.2.17.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-lang-2.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/xz-1.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jsch-0.1.42.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-httpclient-3.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jets3t-0.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-api-2.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/activation-1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-util-6.1.26.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-digester-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/avro-1.7.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/avro-compiler-1.7.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/stax-api-1.0.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-beanutils-core-1.8.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/mockito-all-1.8.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/paranamer-2.3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-configuration-1.6.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-cli-1.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-compress-1.4.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/protobuf-java-2.4.0a.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hsqldb-1.8.0.10.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-server-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jline-0.9.94.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jetty-6.1.26.cloudera.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/xmlenc-0.52.jar:/usr/lib/hadoop-0.20-mapreduce/lib/junit-4.8.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-core-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/ant-contrib-1.0b3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/guava-11.0.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jaxb-impl-2.2.3-1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/slf4j-api-1.6.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/servlet-api-2.5.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-logging-1.1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-jaxrs-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.2.2.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-io-2.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/commons-codec-1.4.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jettison-1.1.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jersey-json-1.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/kfs-0.3.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-xc-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/lib/hadoop-fairscheduler-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/zookeeper-3.4.5-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/lib/jackson-core-asl-1.8.8.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-ant-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-ant.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-tools.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-tools-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-core-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-test.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-core.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-test-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-examples-2.0.0-mr1-cdh4.3.0.jar:/usr/lib/hadoop-0.20-mapreduce/.//hadoop-examples.jar
STARTUP_MSG: build = file:///data/1/jenkins/workspace/generic-package-ubuntu64-10-04/CDH4.3.0-Packaging-Hadoop-2013-05-27_19-02-30/hadoop-2.0.0+1357-1.cdh4.3.0.p0.21~lucid/src/hadoop-mapreduce1-project -r Unknown; compiled by 'jenkins' on Mon May 27 19:57:14 PDT 2013
STARTUP_MSG: java = 1.7.0_15
************************************************************/
2013-08-05 15:14:09,342 INFO org.apache.hadoop.mapred.JobTracker: registered UNIX signal handlers for [TERM, HUP, INT]
2013-08-05 15:14:14,823 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2013-08-05 15:14:14,836 INFO org.apache.hadoop.mapred.JobTracker: Scheduler configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT, limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2013-08-05 15:14:14,837 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
2013-08-05 15:14:14,838 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Starting expired delegation token remover thread, tokenRemoverScanInterval=60 min(s)
2013-08-05 15:14:14,850 INFO org.apache.hadoop.security.token.delegation.AbstractDelegationTokenSecretManager: Updating the current master key for generating delegation tokens
2013-08-05 15:14:15,081 INFO org.apache.hadoop.mapred.JobTracker: Starting jobtracker with owner as mapred
2013-08-05 15:14:15,230 INFO org.apache.hadoop.ipc.Server: Starting Socket Reader #1 for port 8021
2013-08-05 15:14:15,361 WARN org.apache.hadoop.ipc.RPC: Interface interface org.apache.hadoop.mapred.TaskTrackerManager ignored because it does not extend VersionedProtocol
2013-08-05 15:14:22,145 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2013-08-05 15:14:22,306 INFO org.apache.hadoop.http.HttpServer: Added global filter 'safety' (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2013-08-05 15:14:22,310 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context job
2013-08-05 15:14:22,314 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context logs
2013-08-05 15:14:22,314 INFO org.apache.hadoop.http.HttpServer: Added filter static_user_filter (class=org.apache.hadoop.http.lib.StaticUserWebFilter$StaticUserFilter) to context static
2013-08-05 15:14:22,689 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50030
2013-08-05 15:14:22,689 INFO org.mortbay.log: jetty-6.1.26.cloudera.2
2013-08-05 15:14:23,908 INFO org.mortbay.log: Started SelectChannelConnector@0.0.0.0:50030
2013-08-05 15:14:24,065 WARN org.apache.hadoop.conf.Configuration: session.id is deprecated. Instead, use dfs.metrics.session-id
2013-08-05 15:14:24,075 INFO org.apache.hadoop.metrics.jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId=
2013-08-05 15:14:24,117 INFO org.apache.hadoop.mapred.JobTracker: JobTracker up at: 8021
2013-08-05 15:14:24,117 INFO org.apache.hadoop.mapred.JobTracker: JobTracker webserver: 50030
2013-08-05 15:14:25,374 FATAL org.apache.hadoop.mapred.JobTracker: java.lang.IllegalArgumentException: Wrong FS: file:/var/lib/hadoop-hdfs/cache/mapred/mapred/system, expected: hdfs://rhadoop:8020
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:625)
at org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:445)
at org.apache.hadoop.mapred.JobTracker.getSystemDir(JobTracker.java:4174)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1941)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1747)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:305)
at org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:297)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:4538)
2013-08-05 15:14:25,383 INFO org.apache.hadoop.mapred.JobTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down JobTracker at rhadoop/172.16.1.39
**
********************************/
2)TT log(exceed body limit, so only I'll only show show errors):
2013-08-05 14:55:07,215 WARN org.apache.hadoop.mapred.TaskTracker: TaskTracker local dir file:///var/lib/hadoop-hdfs/cache/mapred/mapred/local error Dir is not readable: file:///var/lib/hadoop-hdfs/cache/mapred/mapred/local, removing from local dirs
2013-08-05 14:55:07,217 ERROR org.apache.hadoop.mapred.TaskTracker: Can not start task tracker because org.apache.hadoop.util.DiskChecker$DiskErrorException: No mapred local directories are writable
at org.apache.hadoop.mapred.TaskTracker$LocalStorage.checkDirs(TaskTracker.java:279)
at org.apache.hadoop.mapred.TaskTracker.<init>(TaskTracker.java:1710)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:4041)
2013-08-05 14:55:07,225 INFO org.apache.hadoop.mapred.TaskTracker: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down TaskTracker at rhadoop/172.16.1.39
************************************************************/
3) And here is my /etc/hosts file:
127.0.0.1 localhost
172.16.1.39 rhadoop
4) And my config in core-site.xml:
<property>
<name>fs.default.name</name>
<value>hdfs://rhadoop:8020</value>
</property>
5) And my mapred-site.xml:
<configuration>
<property>
<name>mapred.job.tracker</name>
<value>rhadoop:8021</value>
</property>
<!-- Enable Hue plugins -->
<property>
<name>mapred.jobtracker.plugins</name>
<value>org.apache.hadoop.thriftfs.ThriftJobTrackerPlugin</value>
<description>Comma-separated list of jobtracker plug-ins to be activated.
</description>
</property>
<property>
<name>jobtracker.thrift.address</name>
<value>0.0.0.0:9290</value>
</property>
</configuration>
And one thing to mention is I checked the Wrong FS error for JT online, but most of them are like:
Wrong FS: hdfs:xxxxxxxxxxxxx, expected: xxxxxxxxx
ked But mine is like Wrong FS: file:xxxxxxxxxxx.
Can anyone help me with the configuration thing here?
解决方案
I found the problem. In file /etc/hadoop/conf/hdfs-site.xml, there is one attribute:
<property>
<name>hadoop.tmp.dir</name>
<value>/var/lib/hadoop-hdfs/cache/${user.name}</value>
</property>
When I made some change, I carelessly changed the value to:
file:///var/lib/hadoop-hdfs/cache/${user.name}
which caused my problem!
这篇关于无法启动CDH伪群集中的Jobtracker和Tasktracker的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
查看全文
