auxService：mapreduce_shuffle不存在 [英] The auxService:mapreduce_shuffle does not exist

问题描述

当我尝试运行下面的命令时：

When I am trying to run the below command:

# sqoop import --connect jdbc:mysql://IP Address/database --username root --password PASSWORD --table table_name --m 1

从mysql数据库到HDFS的数据，我收到错误：

for importing the data from mysql database to HDFS, I am getting the error:

auxService：mapreduce_shuffle不存在。

搜索并浏览了很多网站，没有任何帮助。

Searched and browsed many sites, nothing helped.

如何获取摆脱这个问题？请让我知道是否需要更多的输入。

How to get rid of this issue? Please let me know if any more inputs are required.

推荐答案

它是yarn-site.xml中缺少的条目。在名称节点和数据节点中应用这些条目。如果您阅读 http://dataheads.wordpress.com/2013/11/21/hadoop-2-setup-on-64-bit-ubuntu-12-04-part-1/ ，你会看到那个yarn-site.xml 必须有这个条目：

Its an entry that you are missing in yarn-site.xml. Apply those entries in both namenodes and datanodes. If you read this http://dataheads.wordpress.com/2013/11/21/hadoop-2-setup-on-64-bit-ubuntu-12-04-part-1/ , you will see that yarn-site.xml must have this entries:

 <property>
     <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
  </property>
  <property>
    <name>yarn.nodemanager.aux-services.mapreduce_shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
  </property>

在编写 aux-services 时要小心，因为 - 在中间它可能让你遇到这个问题。

Be careful when you write aux-services, because the "-" in the middle it's probably getting you that problem.

这篇关于auxService：mapreduce_shuffle不存在的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！