如何找到JAR:/home/hadoop/contrib/streaming/hadoop-streaming.jar [英] how to find JAR: /home/hadoop/contrib/streaming/hadoop-streaming.jar

问题描述

我正在从多元化的角度练习有关Amazon EMR的视频教程.我被卡住了，因为遇到此错误我无法继续

I'm practicing a video tutorial from plural sight about Amazon EMR. I am stuck as i cannot proceed as i am getting this error

Not a valid JAR: /home/hadoop/contrib/streaming/hadoop-streaming.jar

请注意，该教程较旧，并且使用的是Emr较旧的版本.我使用的是最新版本吗?

Please note that tutorial is old and it is using a older Emr version. I am using the latest version is that a problem ?

我采取的步骤是在腻子中输入凭据后

The steps that i took are after entering the credentials in putty

1)Hadoop

1) Hadoop

2)mkdir StreamingCode`

2) mkdir streamingCode`

3)wget -o ./streamingCode/wordSplitter.py s3://elasticmapreduce/samples/wordcount/wordSplitter.py

3) wget -o ./streamingCode/wordSplitter.py s3://elasticmapreduce/samples/wordcount/wordSplitter.py

4)hadoop jar contrib/streaming/hadoop-streaming.jar-文件 StreamingCode/wordSplitter.py -mapper wordSplitter.py输入 s3://elasticmapreduce/samples/wordcount/input -output StreamingCode/wordCountOut -reducer聚合`

4) hadoop jar contrib/streaming/hadoop-streaming.jar -files streamingCode/wordSplitter.py -mapper wordSplitter.py input s3://elasticmapreduce/samples/wordcount/input -output streamingCode/wordCountOut -reducer aggregate`

由于出现以下错误，我无法执行第4步

I cannot execute step 4 as i am getting the below error

Not a valid JAR: /home/hadoop/contrib/streaming/hadoop-streaming.jar

推荐答案

最新版本的EMR Hadoop中仍提供Hadoop流媒体jar.从EMR 4.0.0版开始，可以在/usr/lib/hadoop-mapreduce/hadoop-streaming.jar上找到.

The Hadoop streaming jar is still available in the latest release of EMR Hadoop. Starting with EMR release 4.0.0 it can be found at /usr/lib/hadoop-mapreduce/hadoop-streaming.jar.

有关版本之间差异的另一个很好的资源可以在 http://docs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-release-differences.html .

Another good resource for differences between versions can be found at http://docs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-release-differences.html.

这篇关于如何找到JAR:/home/hadoop/contrib/streaming/hadoop-streaming.jar的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！