Hadoop：减速器的数量与我在程序中设置的数量不相等 [英] Hadoop: Number of reducer is not equal to what I have set in program

问题描述

我在 mapred-site.xml 中设置了mapred.tasktracker.reduce.tasks.maximum为10，并且我还写了 jobConf.setNumReduceTasks （5）在我的工作中。

I have set mapred.tasktracker.reduce.tasks.maximum to 10 in mapred-site.xml, and I also write jobConf.setNumReduceTasks(5) in my job.

如果我在Shell中运行作业，一切都可以。

Everything is ok if I run the job in Shell.

但是当我通过eclipse运行相同的工作时，只有一个reducer被启动。

But when I run the same job by eclipse, only one reducer was launched.

我尝试在eclipse中编辑Map / Reduce Locations，并设置 mapred.reduce.tasks 为10.但这仍然不起作用。

I try to edit Map/Reduce Locations in eclipse, and set mapred.reduce.tasks to 10. But that still doesn't work.

是否有其他参数可以在eclipse中调整？

Is there any other parameters I can adjust in eclipse?

推荐答案

这篇关于Hadoop：减速器的数量与我在程序中设置的数量不相等的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！