如何星火主在Datastax企业集群产生的呢？ [英] How is the Spark master elected in a Datastax Enterprise cluster?

问题描述

如何星火主在Datastax企业集群产生的呢？我在 /etc/dse/dse-env.sh 看了一下配置和 /etc/dse/spark/spark-defaults.conf 和 /etc/dse/spark/spark-env.sh 。但我找不到它的任何这些位置的？

How is the Spark master elected in a Datastax Enterprise cluster? I have looked at the configurations in /etc/dse/dse-env.sh and /etc/dse/spark/spark-defaults.conf and /etc/dse/spark/spark-env.sh. But I cannot find it any of those locations?

在我们的集群中的星火主不断从一个节点移动到另一个服务的重新启动后？

On our cluster the Spark master keeps on moving from one node to another after the restart of the services?

推荐答案

在DSE 4.6，星火主/ Hadoop的作业跟踪器（通常在同一节点上）通过循环算法确定，并存储在表中的JobTracker。这可能会在未来的版本中改变。

In DSE 4.6, the Spark Master / Hadoop Job Tracker (always on the same node) are determined by a round robin algorithm and are stored in jobtracker table. This may change in future releases.

您可以检查，看看你目前掌握的是什么，是通过使用：

You can check and see what your current master is is by using:

dsetool listjt

这将输出当前的主如果已配置储备的主人。

This will output your current master and the reserve master if one has been configured.

要配置储备大师使用：

dsetool reservejt

输出可能是这个样子：

Output might look something like this:

 $ dsetool listjt DC                             JobTracker   
 --                             --            
 Analytics-Analytics            192.168.101.122 
 ------ Reserve-JT = 192.168.101.121

这篇关于如何星火主在Datastax企业集群产生的呢？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！