所有的主人都反应迟钝！ ？ Spark Master没有响应datastax体系结构 [英] All masters are unresponsive ! ? Spark master is not responding with datastax architecture

问题描述

尝试同时使用Spark Shell和Spark提交，是否遇到此异常？

Tried using both Spark shell and Spark submit, getting this exception?

Initializing SparkContext with MASTER: spark://1.2.3.4:7077
    ERROR 2015-06-11 14:08:29 org.apache.spark.scheduler.cluster.SparkDeploySchedulerBackend: Application has been killed. Reason: All masters are unresponsive! Giving up.
    WARN  2015-06-11 14:08:29 org.apache.spark.scheduler.cluster.SparkDeploySchedulerBackend: Application ID is not initialized yet.
    ERROR 2015-06-11 14:08:30 org.apache.spark.scheduler.TaskSchedulerImpl: Exiting due to error from cluster scheduler: All masters are unresponsive! Giving up.

推荐答案

确保主服务器的URL正确，并且

Make sure the URL for the master is correct, and that the master is still alive.

您可以通过转到浏览器中的spark Web UI来检查正确的URL。如果您在本地运行主服务器，请尝试在任何浏览器窗口中键入localhost：8080。

You can check what the correct URL should be by going to the spark web UI in your browser. If you are running the master locally try typing localhost:8080 into any browser window.

此处是有关Web UI https://spark.apache.org/docs/1.2.0/monitoring.html

Here is more about the web UI https://spark.apache.org/docs/1.2.0/monitoring.html

这篇关于所有的主人都反应迟钝！ ？ Spark Master没有响应datastax体系结构的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！