CDH5上的启动/停止hadoop hdfs / mapred脚本在哪里? [英] Where are the start/stop hadoop hdfs/mapred scripts on CDH5
问题描述
CDH4的文档引用 /etc/init.d/hadoop - * 脚本,但这些脚本不再存在于CDH5中。
<我已经加入了文档,但没有成功找到/理解什么是CDH5等价物。最近我可以找到SCM经理:
新的流程指针和解释(/ es)将不胜感激。
他们在Cloudera用户的邮件列表中收到了一封回复:
仍然位于同一位置,但只有在
遵循非CM指南时才能安装。 CM依赖于它自己的脚本。
我正在跟进Harsh,以确定如何改进当前安装以包含这些脚本。 b
$ b
更新在邮件列表上进一步讨论:
来自Jarek:
不要被我们没有使用master分支的事实所欺骗
- 您必须查看特定分支的发行版。例如,稍微多于一个老的5.0.1源在分支中可用:
https://github.com/cloudera/hadoop-common/tree/cdh5-2.3.0_5.0.1
基于Jark的指针,下面的技巧就是这样做的:
git clone -b cdh5-2.3.0_5.0.1 https://github.com/cloudera/hadoop-common.git
让我们看看结果:
hadoop-common $ git status
分支cdh5-2.3.0_5.0.1
您的分支与'origin / cdh5-2.3.0_5.0.1'保持同步。
看起来像我正在寻找的脚本是为了获取:
07:41:00 / hadoop-common $ find。 -name st\ * .sh
./hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
./hadoop-common-project /hadoop-common/src/main/bin/stop-all.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
./hadoop -hdfs-project / hadoop-hdfs / src / main / bin / start-dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop- dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
./hadoop-mapreduce1-project/bin/start-mapred。 sh
./hadoop-mapreduce1-project/bin/stop-mapred.sh
./hadoop-mapreduce1-project/src/contrib/thriftfs/scripts/start_thrift_server.sh
./hadoop -yarn-project / hadoop-yarn / bin / start-yarn.sh
./hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
这就是我正在寻找的东西。
The documentation for CDH4 refers to the /etc/init.d/hadoop-* scripts, but these no longer exist in CDH5.
I have waded into the documentation but was not successful in finding/understanding what is the CDH5 equivalent. Closest I could find was for the SCM manager:
Pointers to and explanation of the new process(/es) would be appreciated.
解决方案I received a response on the Cloudera users' mailing list from Harsh:
They are still in the same location, but only installed if you followed the non-CM guide. CM relies on its own scripts.
I am following up with Harsh to determine how to retrofit the current installation to include those scripts.
UPDATE Further discussion on the mailing list:
From Jarek:
Don't be deceived by the fact that we are not using "master" branches - you have to check out release specific branches. For example slightly more then one moth old 5.0.1 sources are available in branch:
https://github.com/cloudera/hadoop-common/tree/cdh5-2.3.0_5.0.1
Based on the pointer from Jark, the following did the trick:
git clone -b cdh5-2.3.0_5.0.1 https://github.com/cloudera/hadoop-common.git
Let us take a look at the results:
hadoop-common $git status On branch cdh5-2.3.0_5.0.1 Your branch is up-to-date with 'origin/cdh5-2.3.0_5.0.1'.
And looks like the scripts I was seeking are there for the taking:
07:41:00/hadoop-common $find . -name st\*.sh ./hadoop-common-project/hadoop-common/src/main/bin/start-all.sh ./hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh ./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh ./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh ./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh ./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh ./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh ./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh ./hadoop-mapreduce1-project/bin/start-mapred.sh ./hadoop-mapreduce1-project/bin/stop-mapred.sh ./hadoop-mapreduce1-project/src/contrib/thriftfs/scripts/start_thrift_server.sh ./hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh ./hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh
That's what I was looking for.
这篇关于CDH5上的启动/停止hadoop hdfs / mapred脚本在哪里?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!