如何在yarn中更改tmp目录 [英] How to change tmp directory in yarn
问题描述
我写了一个MR作业,并使用以下配置设置在本地模式下运行它
I have written a MR job and have run it in local mode with following configuration settings
mapred.local.dir=<<local directory having good amount of space>>
fs.default.name=file:///
mapred.job.tracker=local
在Hadoop 1.x上
on Hadoop 1.x
现在我正在使用Hadoop 2.x,并且使用相同的Configuration设置运行相同的Job,但是出现错误:
Now I am using Hadoop 2.x and the same Job I am running with the same Configuration settings, but I am getting error :
Disk Out of Space
如果我从Hadoop 1.x切换到2.x(使用Hadoop-2.6 jar),是相同的配置设置来更改Tmp Dir是行不通的吗??
Is it that If I switch from Hadoop 1.x to 2.x (using Hadoop-2.6 jars), the same Configuration Settings to change the Tmp Dir not work.??
在Hadoop 2.6上配置MR1(映射API)的"tmp"目录的新设置是什么.
What are the new Settings to configure the "tmp" directory of MR1 (mapred API) on Hadoop 2.6.
请忠告.
问候 欢呼声:))
推荐答案
1.x中的许多属性已被弃用,并由2.x中的新属性替换.
Many properties in 1.x have been deprecated and replaced with new properties in 2.x.
mapred.child.tmp 已替换为 mapreduce.task.tmp.dir
mapred.local.dir 已替换为 mapreduce.cluster.local.dir
这篇关于如何在yarn中更改tmp目录的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!