如何跟踪hadoop中哪个数据节点中的哪个数据块? [英] How to track which data block is in which data node in hadoop?

问题描述

如果复制数据块，它将复制到哪个数据节点? 有什么工具可以显示复制的块在哪里?

If a data block is replicated, in which data node will it be replicated to? Is there any tool to show where the replicated blocks are present?

推荐答案

如果知道文件名，则可以通过DFS浏览器进行查找.

If you know the filename, you can look this up through the DFS browser.

转到您的namenode Web界面，说浏览文件系统"并导航到您感兴趣的文件.在页面底部，将显示文件中所有块的列表，以及每个块的位置这些块位于.

Go to your namenode web interface, say "browse the filesystem" and navigate to the file you're interested in. In the bottom of the page, there will be a list of all blocks in the file, and where each of those blocks is located.

注意::当您单击HDFS文件系统中的实际文件时，它看起来像这样.

NOTE: It looks like this when you click on an actual file within the HDFS filesystem.

或者，您可以运行:

hadoop fsck / -files -blocks -locations

将报告所有街区及其所有位置.

Which will report on all blocks and all their locations.

这篇关于如何跟踪hadoop中哪个数据节点中的哪个数据块?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！