mapred-site.xml 中的 mapreduce.framework.name 的经典本地有什么区别? [英] What is the difference between classic, local for mapreduce.framework.name in mapred-site.xml?

问题描述

这个参数的官方说明如下:

The official description for this parameter is as follows:

The runtime framework for executing MapReduce jobs. Can be one of local, classic or yarn.

我知道 'yarn' 的值适用于 MRv2，它会将 mapreduce 作业提交给资源管理器.但是本地和经典之间有什么区别?哪个对应MRv1?

I know that the value 'yarn' is for MRv2, which will submit the mapreduce job to resourcemanager. But what is the difference between local and classic? Which one is corresponding to MRv1?

非常感谢！

推荐答案

你说得对，yarn"代表MRv2.经典"适用于 MRv1，本地"适用于 MR 作业的本地运行.但为什么需要 MRv1?Yarn 现在已经退出测试版，它比旧的 MRv1 框架更稳定，而您的 MapReduce 作业仍然可以使用旧的mapred"API

You are right, "yarn" stands for MRv2. "classic" is for MRv1 and "local" for local runs of the MR jobs. But why do you need MRv1? Yarn is out of the beta now and it is more stable than old MRv1 framework, while your MapReduce jobs still can use old "mapred" API

这篇关于mapred-site.xml 中的 mapreduce.framework.name 的经典本地有什么区别?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！