MapReduce框架如何实现排序阶段? [英] How does MapReduce framework implement the sort phase?

问题描述

我对MapReduce排序阶段的实现感兴趣；它似乎非常有效.有人可以提供一些参考吗?谢谢！

I am interested in the implementation of the MapReduce sort phase; it seems to be very efficient. Could someone provide some references about it please? Thanks!

推荐答案

这指向 ReduceTask. java 作为排序阶段的编码位置.参见 ReduceTask.java .如果您需要更多信息，请下载整个源文件并进行深入研究

This points to ReduceTask.java as the place where sort phase is coded. See lines 393-408 in ReduceTask.java. If you need more info, download the entire source and dig into it.

已编辑

排序"阶段属于ReduceTask，如下图所示，该图来自 hadoop book . (页码:163)

"Sort" phase falls under ReduceTask as shown in this figure below from hadoop book. (Page no: 163)

这篇关于MapReduce框架如何实现排序阶段?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！