当我添加新节点时，Cassandra集群将花费大量时间 [英] Cassandra cluster it taking lot of time When I add new node

问题描述

我有5个节点的Cass集群，每个集群目前拥有1 TB的数据。当我尝试添加另一个节点时，将其花费到联合国州几乎要花15个多小时。

I've 5 node Cass cluster and each one currently owning 1 TB of data. When I tried adding another node, it almost took 15+ Hours to bring to 'UN' State.

有没有办法使其变得更快？

Is there a way to make it fast?

Cassandra版本：3.0.13
环境：AWS，m4.2xlarge机器。

Cassandra version: 3.0.13 Environment : AWS , m4.2xlarge machines.

推荐答案

1 TB是每个节点大量的数据。由于您有5个节点的群集，并且要添加一个新节点，因此该节点将占用0833 TB的数据，该数据必须从所有节点进行流式传输。这相当于6,67 Tbit或6990507 Mbit。 Cassandra的stream_throughput_outbound_megabits_per_sec的默认值为200。6990507÷200 = 34952,535秒= 9.7小时，以传输所有数据。由于您可能同时运行其他流量，这可能需要15个小时。

1 TB is a lot of data per node. Since you have a 5 node cluster and you're adding a new node that node will take 0,833 TB data that has to be streamed from all nodes. That is the equivalent of 6,67 Tbit, or 6990507 Mbit. Cassandra has a default value for stream_throughput_outbound_megabits_per_sec of 200. 6990507÷200 = 34952,535 seconds = 9,7 hours to transfer all data. Since you're probably running other traffic at the same time etc. this could very well take 15 hours.

解决方案：将所有节点上的stream_throughput_outbound_megabits_per_sec更改为更高的值。

Solution: Change the stream_throughput_outbound_megabits_per_sec on all nodes to a higher value.

注意：不要忘记运行 nodetool清理。

这篇关于当我添加新节点时，Cassandra集群将花费大量时间的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！