Hadoop 错误 - 所有数据节点都在中止 [英] Hadoop Error - All data nodes are aborting

问题描述

我使用的是 Hadoop 2.3.0 版本.有时当我执行 Map reduce 作业时，会显示以下错误.

I am using Hadoop 2.3.0 version. Sometimes when I execute the Map reduce job, the below errors will get displayed.

14/08/10 12:14:59 INFO mapreduce.Job: Task Id : attempt_1407694955806_0002_m_000780_0, Status : FAILED
Error: java.io.IOException: All datanodes 192.168.30.2:50010 are bad. Aborting...
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.setupPipelineForAppendOrRecovery(DFSOutputStream.java:1023)
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.processDatanodeError(DFSOutputStream.java:838)
    at org.apache.hadoop.hdfs.DFSOutputStream$DataStreamer.run(DFSOutputStream.java:483)

当我尝试检查这些失败任务的日志文件时，此任务的日志文件夹将为空.

When I try to check the log files for these failed tasks, the log folder for this task will be empty.

我无法理解此错误背后的原因.有人可以让我知道如何解决这个问题.感谢您的帮助.

I am not able to understand the reason behind this error. Could someone please let me know how to resolve this issue. Thanks for your help.

推荐答案

您似乎达到了用户的打开文件句柄限制.这是一个很常见的问题，在大多数情况下可以通过增加 ulimit 值(默认情况下大部分是 1024，很容易像你这样的多出工作会筋疲力尽).

You seem to be hitting the open file handles limit of your user. This is a pretty common issue, and can be cleared in most cases by increasing the ulimit values (its mostly 1024 by default, easily exhaustible by multi-out jobs like yours).

您可以按照这个简短的指南来增加它:http://blog.cloudera.com/blog/2009/03/configuration-parameters-what-c​​an-you-just-ignore/[文件描述符限制"部分]

You can follow this short guide to increase it: http://blog.cloudera.com/blog/2009/03/configuration-parameters-what-can-you-just-ignore/ [The section "File descriptor limits"]

由 Harsh J 回答 - https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/kJRUkVxmfhw

Answered by Harsh J - https://groups.google.com/a/cloudera.org/forum/#!topic/cdh-user/kJRUkVxmfhw

这篇关于Hadoop 错误 - 所有数据节点都在中止的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！