将Kafka集群迁移到新数据中心 [英] Migrating a kafka cluster to new datacenter

问题描述

我有一个小型的3节点kafka集群，每个节点约有20GB数据.我们正在迁移到新的数据中心，因此需要移动集群.目前两个DC都在运行.

I have a small 3 node kafka cluster with about 20GB data per node. We're moving to a new datacenter so need to move the cluster; both DC's are currently operational.

DC之间的往返时间为:

Round trip times between the DC's are:

35 packets transmitted, 35 received, 0% packet loss, time 34048ms
rtt min/avg/max/mdev = 2.265/14.883/86.126/22.047 ms

在新DC中设置新节点，复制到它们，然后删除旧节点是否可行?延迟会太高吗?

Would it be practical to set up new nodes in the new DC, replicate to them and then remove the old nodes? Would the latency be too high?

非常感谢您的建议.如果这种方法行不通，欢迎提出建议！谢谢.

I'd appreciate your advice. If this method wouldn't work, I welcome suggestions! Thanks.

推荐答案

尝试使用MirrorMaker在群集之间复制数据，并为与超时相关的所有配置设置一个适中的较大值.

Try to use MirrorMaker to replicate data between clusters and set a moderately larger value for all configs that relate to the timeout.

这篇关于将Kafka集群迁移到新数据中心的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！