CDH5上的启动/停止hadoop hdfs / mapred脚本在哪里? [英] Where are the start/stop hadoop hdfs/mapred scripts on CDH5

查看:729
本文介绍了CDH5上的启动/停止hadoop hdfs / mapred脚本在哪里?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

CDH4的文档引用 /etc/init.d/hadoop - * 脚本,但这些脚本不再存在于CDH5中。



<我已经加入了文档,但没有成功找到/理解什么是CDH5等价物。最近我可以找到SCM经理:



http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM5/latest/Cloudera-Manager-管理指南/ cm5ag_agents.html



新的流程指针和解释(/ es)将不胜感激。


他们在Cloudera用户的邮件列表中收到了一封回复:

仍然位于同一位置,但只有在
遵循非CM指南时才能安装。 CM依赖于它自己的脚本。



我正在跟进Harsh,以确定如何改进当前安装以包含这些脚本。 b
$ b

更新在邮件列表上进一步讨论:

来自Jarek:


不要被我们没有使用master分支的事实所欺骗
- 您必须查看特定分支的发行版。例如,稍微多于一个老的5.0.1源在分支中可用:

https://github.com/cloudera/hadoop-common/tree/cdh5-2.3.0_5.0.1


基于Jark的指针,下面的技巧就是这样做的:

  git clone -b cdh5-2.3.0_5.0.1 https://github.com/cloudera/hadoop-common.git 

让我们看看结果:

  hadoop-common $ git status 

分支cdh5-2.3.0_5.0.1
您的分支与'origin / cdh5-2.3.0_5.0.1'保持同步。

看起来像我正在寻找的脚本是为了获取:

  07:41:00 / hadoop-common $ find。 -name st\ * .sh 

./hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
./hadoop-common-project /hadoop-common/src/main/bin/stop-all.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
./hadoop -hdfs-project / hadoop-hdfs / src / main / bin / start-dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop- dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
./hadoop-mapreduce1-project/bin/start-mapred。 sh
./hadoop-mapreduce1-project/bin/stop-mapred.sh
./hadoop-mapreduce1-project/src/contrib/thriftfs/scripts/start_thrift_server.sh
./hadoop -yarn-project / hadoop-yarn / bin / start-yarn.sh
./hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh



这就是我正在寻找的东西。


The documentation for CDH4 refers to the /etc/init.d/hadoop-* scripts, but these no longer exist in CDH5.

I have waded into the documentation but was not successful in finding/understanding what is the CDH5 equivalent. Closest I could find was for the SCM manager:

http://www.cloudera.com/content/cloudera-content/cloudera-docs/CM5/latest/Cloudera-Manager-Administration-Guide/cm5ag_agents.html

Pointers to and explanation of the new process(/es) would be appreciated.

解决方案

I received a response on the Cloudera users' mailing list from Harsh:

They are still in the same location, but only installed if you followed the non-CM guide. CM relies on its own scripts.

I am following up with Harsh to determine how to retrofit the current installation to include those scripts.

UPDATE Further discussion on the mailing list:

From Jarek:

Don't be deceived by the fact that we are not using "master" branches - you have to check out release specific branches. For example slightly more then one moth old 5.0.1 sources are available in branch:

https://github.com/cloudera/hadoop-common/tree/cdh5-2.3.0_5.0.1

Based on the pointer from Jark, the following did the trick:

git clone -b  cdh5-2.3.0_5.0.1 https://github.com/cloudera/hadoop-common.git

Let us take a look at the results:

hadoop-common $git status

On branch cdh5-2.3.0_5.0.1
Your branch is up-to-date with 'origin/cdh5-2.3.0_5.0.1'.

And looks like the scripts I was seeking are there for the taking:

07:41:00/hadoop-common $find . -name st\*.sh

./hadoop-common-project/hadoop-common/src/main/bin/start-all.sh
./hadoop-common-project/hadoop-common/src/main/bin/stop-all.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-balancer.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/start-secure-dns.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-balancer.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-dfs.sh
./hadoop-hdfs-project/hadoop-hdfs/src/main/bin/stop-secure-dns.sh
./hadoop-mapreduce1-project/bin/start-mapred.sh
./hadoop-mapreduce1-project/bin/stop-mapred.sh
./hadoop-mapreduce1-project/src/contrib/thriftfs/scripts/start_thrift_server.sh
./hadoop-yarn-project/hadoop-yarn/bin/start-yarn.sh
./hadoop-yarn-project/hadoop-yarn/bin/stop-yarn.sh

That's what I was looking for.

这篇关于CDH5上的启动/停止hadoop hdfs / mapred脚本在哪里?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆