HDFS容量：如何读取“dfsadmin报告” [英] HDFS Capacity: how to read "dfsadmin report"

问题描述

我使用Hadoop 2.6.0。当我运行hdfs dfsadmin -report时，我得到了类似这样的内容（简化）：

 配置容量：3 TB 
现有容量：400GB 
剩余的DFS：300 GB 
使用的DFS：100 GB 
  

我想知道配置容量是什么以及目前容量是多少。它看起来像现在的容量是有效的。我怎样才能增加这个？

解决方案

已配置容量是用于数据目录的磁盘/容量的总可用容量。

例如：我有三个1TB磁盘安装在 / Hadoop / sdb1，/ Hadoop / sdc1，/ Hadoop / sdd1 ，并且我将这些卷上的HDFS数据目录配置为 / Hadoop / sdb1 / dfs / dn，/ Hadoop / sdc1 / dfs / dn，/ Hadoop / sdd1 / dfs / dn ，我还将其他非HDFS数据保存在 / Hadoop / sdb1 / nonhadoop，/ Hadoop / sdc1 / nonhadoop，/ Hadoop / sdd1 / nonhadoop ，非hadoop目录中的数据大小为（800 + 900 + 900）GB。

HDFS的剩余空间为（200 + 100 + 100）GB，即目前的容量，目前的容量可能会有所不同，取决于其他非HDFS目录的使用情况在相同的卷/磁盘中，但是在HDFS中添加/删除卷/磁盘之前，配置的容量保持不变。

I am using Hadoop 2.6.0. When I run "hdfs dfsadmin -report" I got something like this (simplified):

Configured Capacity: 3 TB
Present Capacity: 400GB
DFS Remaining: 300 GB
DFS Used: 100 GB

I am wondering what "configured capacity" is and what "present capacity" is. It looks like "Present Capacity" is the one in effect. How can I increase this?

解决方案

Configured Capacity is the total available capacity of the disks/voulmes used for data directory.

Eg: I've three 1TB disks mounted on /Hadoop/sdb1, /Hadoop/sdc1, /Hadoop/sdd1 and I configured HDFS data directory on these volumes as /Hadoop/sdb1/dfs/dn, /Hadoop/sdc1/dfs/dn, /Hadoop/sdd1/dfs/dn, I also keep other non HDFS data in other directories in the same volume in /Hadoop/sdb1/nonhadoop, /Hadoop/sdc1/nonhadoop, /Hadoop/sdd1/nonhadoop, Size of data in the non hadoop directories is (800+900+900)GB.

Remaining space for HDFS will be (200+100+100)GB, Which will be the present capacity, Present capacity may vary depends on the usage of other Non HDFS directories in the same volume/disk, However configured capacity remains same until you add/remove volume/disks from HDFS.

这篇关于HDFS容量：如何读取“dfsadmin报告”的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！