Mahout错误与Hadoop2.2 [英] Mahout error with Hadoop2.2

查看:189
本文介绍了Mahout错误与Hadoop2.2的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述


我试图在Hadoop 2.2上使用mahout 0.9库来执行XML解析的mapreduce作业。
但是我收到以下错误:


I'm trying to execute a mapreduce job for XML parsing using mahout 0.9 library on Hadoop 2.2. But I'm getting following error :

14/02/24 16:03:02 INFO mapreduce.Job: Task Id : attempt_1393235568433_0004_m_000000_0, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
14/02/24 16:03:12 INFO mapreduce.Job: Task Id : attempt_1393235568433_0004_m_000000_1, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
14/02/24 16:03:31 INFO mapreduce.Job: Task Id : attempt_1393235568433_0004_m_000000_2, Status : FAILED
Error: Found interface org.apache.hadoop.mapreduce.TaskAttemptContext, but class was expected
14/02/24 16:03:53 INFO mapreduce.Job:  map 100% reduce 100%
14/02/24 16:03:53 INFO mapreduce.Job: Job job_1393235568433_0004 failed with state     FAILED due to: Task failed task_1393235568433_0004_m_000000
Job failed as tasks failed. failedMaps:1 failedReduces:0

我尝试搜索解决方案,但获得链接 http://osdir.com/ml/general/2014-02/msg39414.html ,其中声明Hadoop 2.2不支持Mahout 0.8或0.9。
任何可能的工作方式??

I tried to search for solution but got the link http://osdir.com/ml/general/2014-02/msg39414.html , which states that Mahout 0.8 or 0.9 is not supported for Hadoop 2.2.
Any workaroung possible??

推荐答案

大约一个小时之前Mahout已正式在主分支中添加对Hadoop 2.x的支持(请参阅 MAHOUT-1329

About an hour ago Mahout has officially added support to Hadoop 2.x in the master branch (see MAHOUT-1329)

在此检查代码 https:// github.com/apache/mahout 并重新编译使用:

Checkout the code here https://github.com/apache/mahout and recompile using:

mvn clean package -Dhadoop2.version=2.2.0

试试看看是否有效。

这篇关于Mahout错误与Hadoop2.2的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆