Hadoop任务:“execvp:permission denied” [英] Hadoop tasks: "execvp: permission denied"

查看:1112
本文介绍了Hadoop任务:“execvp:permission denied”的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

在许多开发人员工作站(即它们具有不同的本地配置)上建立的小型Hadoop集群中,我有一个6的TaskTracker存在问题。无论何时接收任务,该任务立即以 ChildError 失败:

In a small Hadoop cluster set up on a number of developer workstations (i.e., they have different local configurations), I have one TaskTracker of 6 that is being problematic. Whenever it receives a task, that task immediately fails with ChildError:

java.lang.Throwable: Child Error
    at org.apache.hardoop.mapred.TaskRunner.run(TaskRunner.java:242)
Caused by: java.io.IOException: Task process exit with nonzero status of 1.
    at org.apache.hardoop.mapred.TaskRunner.run(TaskRunner.java:229)

当我查看任务的 stdout stderr 日志时, stdout log是空的, stderr log只有:

When I look at the stdout and stderr logs for the task, the stdout log is empty, and the stderr log only has:

execvp: Permission denied

我的工作完成了,因为tasktracker最终被列入黑名单,在运行任务没有问题的其他节点上运行。我无法在任何一个节点上运行任何任务,因此这是一个普遍问题。

My jobs complete because the tasktracker eventually gets blacklisted and runs on the other nodes that have no problem running a task. I am not able to get any tasks running on this one node, from any number of jobs, so this is a universal problem.

我在此节点上运行DataNode没有任何问题。

I have a DataNode running on this node with no issues.

我想这里可能会出现某种Java问题,它很难生成JVM或其他东西......

I imagine there might some sort of Java issue here where it is having a hard time spawning a JVM or something...

推荐答案

我们有同样的问题。我们通过在下面的文件中添加'execute'来修复它。

We have same problem. we fix it by adding 'execute' to below file.

$JAVA_HOME/jre/bin/java

由于hadoop使用$ JAVA_HOME / jre / bin / java来产生任务程序,而不是$ JAVA_HOME / bin / java。

Because hadoop use $JAVA_HOME/jre/bin/java to spawn task program instead of $JAVA_HOME/bin/java.

如果您在更改文件模式后仍然遇到此问题,建议您使用远程调试来查找产生任务的shell cmd,请参阅调试hadoop任务

If you still have this issue after change the file mode, suggest you use remote debug to find the shell cmd which spawning the task, see debugging hadoop task

这篇关于Hadoop任务:“execvp:permission denied”的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆