Hadoop-common、Hadoop-core 和 Hadoop-client 之间的区别? [英] Differences between Hadoop-common, Hadoop-core and Hadoop-client?

问题描述

我是 Hadoop 的新手，想知道 Hadoop-common、Hadoop-core 和 之间的区别是什么Hadoop 客户端?

I am newer to Hadoop, and want to know what is the differences between Hadoop-common, Hadoop-core and Hadoop-client?

顺便说一下，对于给定的类，我如何知道 Maven 中包含哪个工件?例如，哪个包含 org.apache.hadoop.io.Text?

By the way,for a given class, how do I know which artifact contains it in Maven ? For example, which one contains the org.apache.hadoop.io.Text?

推荐答案

从高层次的角度帮助提供有关 Hadoop-common、Hadoop-core 和 Hadoop-client 之间差异的一些额外细节:

To help provide some additional details regarding the differences between Hadoop-common, Hadoop-core and Hadoop-client, from a high-level perspective:

• Hadoop-common 是指支持 Hadoop 模块的常用实用程序和库.
• Hadoop-core 与 Hadoop-common 相同；根据 https://hadoop.apache.org/，它于 2009 年 7 月更名为 Hadoop-common.
• Hadoop-client 是指用于与 Hadoop 的通用组件(HDFS、MapReduce、YARN)通信的客户端库，包括但不限于日志记录和编解码器.

• Hadoop-common refers to the commonly used utilities and libraries that support the Hadoop modules.
• Hadoop-core is the same as Hadoop-common; It was renamed to Hadoop-common in July 2009, per https://hadoop.apache.org/.
• Hadoop-client refers to the client libraries used to communicate with Hadoop's common components (HDFS, MapReduce, YARN) including but not limited to logging and codecs for example.

一般来说，对于构建提交到 YARN 的应用程序、运行 MR 作业或从 HDFS 访问文件的开发人员，使用 Hadoop 客户端库.

Generally speaking, for developers who build apps that submit to YARN, run a MR job, or access files from HDFS use Hadoop-client libraries.

这篇关于Hadoop-common、Hadoop-core 和 Hadoop-client 之间的区别?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！