Mahout错误与Hadoop2.2 [英] Mahout error with Hadoop2.2
问题描述
我试图在Hadoop 2.2上使用mahout 0.9库来执行XML解析的mapreduce作业。
但是我收到以下错误:
I'm trying to execute a mapreduce job for XML parsing using mahout 0.9 library on Hadoop 2.2.
But I'm getting following error :
14/02/24 16:03:02 INFO mapreduce.Job: Task Id : attempt_1393235568433_0004_m_000000_0, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
14/02/24 16:03:12 INFO mapreduce.Job: Task Id : attempt_1393235568433_0004_m_000000_1, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
14/02/24 16:03:31 INFO mapreduce.Job: Task Id : attempt_1393235568433_0004_m_000000_2, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
14/02/24 16:03:53 INFO mapreduce.Job: map 100% reduce 100%
14/02/24 16:03:53 INFO mapreduce.Job: Job job_1393235568433_0004 failed with state FAILED due to: Task failed task_1393235568433_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0
我尝试搜索解决方案,但获得链接 http://osdir.com/ml/general/2014-02/msg39414.html ,其中声明Hadoop 2.2不支持Mahout 0.8或0.9。
任何可能的工作方式??
I tried to search for solution but got the link http://osdir.com/ml/general/2014-02/msg39414.html , which states that Mahout 0.8 or 0.9 is not supported for Hadoop 2.2.
Any workaroung possible??
推荐答案
大约一个小时之前Mahout已正式在主分支中添加对Hadoop 2.x的支持(请参阅 MAHOUT-1329 )
About an hour ago Mahout has officially added support to Hadoop 2.x in the master branch (see MAHOUT-1329)
在此检查代码 https:// github.com/apache/mahout 并重新编译使用:
Checkout the code here https://github.com/apache/mahout and recompile using:
mvn clean package -Dhadoop2.version=2.2.0
试试看看是否有效。
这篇关于Mahout错误与Hadoop2.2的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!