Hadoop-common，Hadoop-core和Hadoop-client之间的区别？ [英] Differences between Hadoop-common, Hadoop-core and Hadoop-client?

问题描述

Hadoop 更新，并且想知道 Hadoop-common ， Hadoop-core 和 Hadoop-client ？

顺便说一下，对于一个给定的类，我怎么知道哪个工件包含在 Maven 中？例如，哪一个包含 org.apache.hadoop.io.Text ？

解决方案

为帮助提供关于Hadoop-common，Hadoop-core和Hadoop-client之间差异的更多细节，级透视图：

• Hadoop-common是指支持Hadoop模块的常用实用程序和库。


• Hadoop-core与Hadoop-common相同;根据 https://hadoop.apache.org/ ，它于2009年7月重新命名为Hadoop-common。


• Hadoop-client指用于与Hadoop常用组件（HDFS，MapReduce，YARN）通信的客户端库，包括但不限于日志记录和编解码器。

一般而言，对于构建提交给YARN的应用程序，运行MR作业或从HDFS访问文件的开发人员，使用Hadoop客户端库。 b $ b

I am newer to Hadoop, and want to know what is the differences between Hadoop-common, Hadoop-core and Hadoop-client?

By the way,for a given class, how do I know which artifact contains it in Maven ? For example, which one contains the org.apache.hadoop.io.Text?

解决方案

To help provide some additional details regarding the differences between Hadoop-common, Hadoop-core and Hadoop-client, from a high-level perspective:

• Hadoop-common refers to the commonly used utilities and libraries that support the Hadoop modules.
• Hadoop-core is the same as Hadoop-common; It was renamed to Hadoop-common in July 2009, per https://hadoop.apache.org/.
• Hadoop-client refers to the client libraries used to communicate with Hadoop's common components (HDFS, MapReduce, YARN) including but not limited to logging and codecs for example.

Generally speaking, for developers who build apps that submit to YARN, run a MR job, or access files from HDFS use Hadoop-client libraries.

这篇关于Hadoop-common，Hadoop-core和Hadoop-client之间的区别？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！