Hadoop gen1 与 Hadoop gen2 [英] Hadoop gen1 vs Hadoop gen2

问题描述

我对 tasktracker 在 Hadoop-2.x 中的位置有点困惑.

I am a bit confused about place of tasktracker in Hadoop-2.x.

Hadoop-1.x 中的守护进程是 namenode、datanode、jobtracker、taskracker 和 secondarynamenode

Hadoop-2.x 中的守护进程是 namenode、datanode、resourcemanager、applicationmaster、secondarynamenode.

这意味着Jobtracker已经分裂成:resourcemanager和applicationmaster

那么tasktracker在哪里?

推荐答案

在 YARN(Hadoop 2 中的新执行框架)中，MapReduce 不像以前那样存在.

In YARN (the new execution framework in Hadoop 2), MapReduce doesn't exist in the way it did before.

YARN 是一种更通用的在集群上分配资源的方式.ResourceManager、ApplicationMaster 和 NodeManager 现在由新的 YARN 执行框架组成.NodeManager 是每个节点上的守护进程，所以我猜你可以说它取代了 TaskTracker.但现在它只提供流程，而不仅仅是 map 任务和 reduce 任务.

YARN is a more general purpose way to allocate resources on the cluster. ResourceManager, ApplicationMaster, and NodeManager now consist of the new YARN execution framework. The NodeManager is the daemon on every node, so I guess you could say that replaced the TaskTracker. But now it just gives processes instead of just map tasks and reduce tasks.

MapReduce 仍然存在，但它现在是 YARN 的应用程序".

MapReduce is still there, but it is now an "application" of YARN.

这里是对 YARN 的介绍，会更深入:http://hortonworks.com/blog/introducing-apache-hadoop-yarn/

Here is an introduction to YARN, which will go into much more depth: http://hortonworks.com/blog/introducing-apache-hadoop-yarn/

这篇关于Hadoop gen1 与 Hadoop gen2的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！