Hive 和 Hadoop MapReduce 的关系? [英] Relationship between Hive and Hadoop MapReduce?

问题描述

是否有任何 Hive 内部进程连接到减少或映射任务?

补充一下！

• Hive 如何与 MapReduce 相关联?
• 如何安排作业?
• 查询结果如何返回给hive驱动?

解决方案

对于 HIVE，没有直接沟通 Map/Reduce 任务的过程.它与 Jobtracker(YARN 中的 Application Master)通信(流程 6.3)，仅用于在调度后与作业处理相关的事情.

这张图片会让你清楚地了解，

<块引用>

1. HIVE 如何使用 MapReduce 作为执行引擎?
2. 如何安排作业?
3. 结果如何返回给驱动程序?

由 dennis-jaheruddin 建议

<块引用>

Hive 通常通过 HQL(Hive 查询语言)进行控制通常方便地缩写为 Hive.

来源

Is there any Hive internal process that connects to reduce or map tasks?

Adding to that!

• How does Hive work in relation with MapReduce?
• How is the job getting scheduled?
• How does the query result return to the hive driver?

解决方案

For HIVE there is no process to communicate Map/Reduce tasks directly. It's communicates (flow 6.3) with Jobtracker(Application Master in YARN) only for job processing related things once it got scheduled.

This image will give clear understanding about,

1. How HIVE uses MapReduce as execution engine?
2. How is the job getting scheduled?
3. How does the result return to the driver?

Edit: suggested by dennis-jaheruddin

Hive is typically controlled by means of HQL (Hive Query Language) which is often conveniently abbreviated to Hive.

source

这篇关于Hive 和 Hadoop MapReduce 的关系?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！