namenode ha故障转移时间 [英] namenode ha failover time

查看:199
本文介绍了namenode ha故障转移时间的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

Namenode HA(NFS,QJM)可用于hadoop 2.x(HDFS-1623)。它为Namenode提供了快速故障转移功能,但是我无法从故障中找到多久的描述。任何人都可以告诉我?




感谢您的回答。事实上,我想知道两个节点(活动的名称节点和备用名称节点)的转换。你能告诉我多久吗?

解决方案

以下是一些合适的示例使用备用NameNode进行故障转移的时间:


具有600万个块的60个节点群集使用300TB原始存储和100K个文件:30秒。因此,总故障切换时间范围为1-3分钟。

一个200万个节点的群集占用1PB原始存储空间和100万个文件:110秒。因此,总故障切换时间范围为2.5到4.5分钟。

对于小型到中型群集,冷故障转移速度只有30到120秒。


发件人: http://hortonworks.com/blog/ha-namenode-for-hdfs-with-hadoop-1-0-part-1/


Namenode HA (NFS, QJM) is available in hadoop 2.x (HDFS-1623). It provides fast failover for Namenode, but I can't find any description on how long does it take to recover from a failure. Can any one tell me?


Thanks for your answer.As the matter of fact,I want to know the time between the transformation of two nodes(active namenode and standby namenode).can you tell me how long?

解决方案

Here are some qualified examples of times for failover with a standby NameNode:

A 60 node cluster with 6 million blocks using 300TB raw storage, and 100K files: 30 seconds. Hence total failover time ranges from 1-3 minutes.

A 200 node cluster with 20 million blocks occupying 1PB raw storage and 1 million files: 110 seconds. Hence total failover time ranges from 2.5 to 4.5 minutes.

For small to medium clusters cold failover is only 30 to 120 seconds slower.

From: http://hortonworks.com/blog/ha-namenode-for-hdfs-with-hadoop-1-0-part-1/

这篇关于namenode ha故障转移时间的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆