YARN应用程序已退出,退出代码为:-1000无法初始化用户目录 [英] YARN Application exited with exitCode: -1000 Not able to initialize user directories

查看:185
本文介绍了YARN应用程序已退出,退出代码为:-1000无法初始化用户目录的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我得到:

Application application_1427711869990_0001 failed 2 times due to AM Container for appattempt_1427711869990_0001_000002 exited with exitCode: -1000 due to: Not able to initialize user directories in any of the configured local directories for user kailash
.Failing this attempt.. Failing the application.

我找不到与该退出代码和相关原因有关的任何东西。我正在使用Hadoop 2.5.0(Cloudera 5.3.2)。

I couldn`t find anything related to this exit code and the associated reason. I am using Hadoop 2.5.0 (Cloudera 5.3.2).

推荐答案

实际上,这是由于某些功能的权限问题yarn本地目录。我开始使用 LinuxContainerExecutor (在非安全模式下,nonsecure-mode.local-user作为kailash)进行了相应的更改。但是由于某种(未知的)原因,NodeManager无法为用户清除本地目录,并且以前的用户仍然存在目录(在我的情况下是yarn)。

Actually this is due to the permission issues on some of the yarn local directories. I started using LinuxContainerExecutor (in non secure mode with nonsecure-mode.local-user as kailash) and made corresponding changes. However due to some (unknown) reason NodeManager failed to clean local directories for users, and there still existed directories with previous user (in my case yarn).

因此,为此,我首先必须找到属性 yarn.nodemanager.local-dirs 的值(使用Cloudera使用搜索选项来为YARN服务找到此属性,否则请查看yarn -hadoop conf目录中的-site.xml),然后为所有节点管理器节点定义usercache下的文件/目录。就我而言,我使用的是:

So to solve this, I first had to find the value of the property yarn.nodemanager.local-dirs (with Cloudera use search option to find this property for YARN service, otherwise look into yarn-site.xml in hadoop conf directory), and then delate the files/directories under usercache for all the node manager nodes. In my case, I used:

rm -rf /yarn/nm/usercache/*

这篇关于YARN应用程序已退出,退出代码为:-1000无法初始化用户目录的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆