mapred-site.xml中的mapreduce.framework.name的经典本地区别是什么? [英] What is the difference between classic, local for mapreduce.framework.name in mapred-site.xml?

查看:1802
本文介绍了mapred-site.xml中的mapreduce.framework.name的经典本地区别是什么?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

这个参数的官方描述如下:

The official description for this parameter is as follows:

The runtime framework for executing MapReduce jobs. Can be one of local, classic or yarn.

我知道'yarn'的值是针对MRv2的,它会将mapreduce作业提交给resourcemanager。但本地和古典有什么区别?哪一个对应于MRv1?

I know that the value 'yarn' is for MRv2, which will submit the mapreduce job to resourcemanager. But what is the difference between local and classic? Which one is corresponding to MRv1?

非常感谢!

Thanks a lot!

推荐答案

你说得对,纱代表MRv2。 经典用于MRv1,本地用于MR作业的本地运行。但为什么你需要MRv1? Yarn现在不在测试阶段,它比旧的MRv1框架更稳定,而您的MapReduce作业仍然可以使用旧的mapredAPI

You are right, "yarn" stands for MRv2. "classic" is for MRv1 and "local" for local runs of the MR jobs. But why do you need MRv1? Yarn is out of the beta now and it is more stable than old MRv1 framework, while your MapReduce jobs still can use old "mapred" API

这篇关于mapred-site.xml中的mapreduce.framework.name的经典本地区别是什么?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆