为什么hadoop mapper任务的持续时间总是3秒的倍数？ [英] Why are the durations of hadoop mapper tasks always a multiple of 3 seconds?

问题描述

$ b

.imgur.com / LvmAU.pngalt =

当我查看更长时间运行的作业的日志时，请参阅相同的内容：

这背后的原因是什么？

解决方案

Hadoop的 Task.PROGRESS_INTERVAL 被硬编码为3000毫秒

Looking over my task logs I noticed all of the mapper tasks finish after a multiple of 3 seconds:

When I look at the logs for some longer running jobs see the same thing:

What is the reason behind this?

解决方案

Because in older versions of Hadoop the Task.PROGRESS_INTERVAL is hard coded to 3000 milliseconds

这篇关于为什么hadoop mapper任务的持续时间总是3秒的倍数？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！