星火集群:工人的信息没有显示在网页UI [英] Spark Clusters: worker info doesn't show on web UI

查看:130
本文介绍了星火集群:工人的信息没有显示在网页UI的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我已经安装了一组集群的火花独立。我试图通过集群启动脚本启动集群。我已经加入群集IP地址的conf /奴隶文件。主通过密码ssh连接到所有的奴隶。
运行 ./斌/ start-slaves.sh 剧本后,我得到以下信息:

I have installed spark standalone on a set of clusters. And I tried to launch clusters through the cluster launch script. I have added cluster's IP address into conf/slaves file. The master connects to all slaves through password-less ssh. After running ./bin/start-slaves.sh script, I get the following message:

开始org.apache.spark.deploy.worker.Worker,记录到/root/spark-0.8.0-incubating/bin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-jbosstest2.out

starting org.apache.spark.deploy.worker.Worker, logging to /root/spark-0.8.0-incubating/bin/../logs/spark-root-org.apache.spark.deploy.worker.Worker-1-jbosstest2.out

但主人在WebUI(本地主机:8080)未显示对工人的任何信息。但是,当我加入localhost条目到我的conf /奴隶文件本地主机的工人信息显示。

But the webUI of the master (localhost:8080) is not showing any information about the worker. But when I add localhost entry onto my conf/slaves file the worker info of localhost is shown.

有没有错误消息,在终端的消息说,工人起家,但在WebUI没有显示任何工人。

There are no error messages, the message on terminal says the worker is started, but the WebUI is not showing any workers.

推荐答案

我有同样的问题。我注意到当我无法远程登录师傅:从奴隶端口。在我的etc / hosts文件(在主站)我有一个127.0.0.1主入口(我的主人192.168.0.X之前)。当我删除从我等方面的127.0.0.1进入/ hosts文件,我可以远程登录,当我start-slaves.sh(从主)我的奴隶连接

I had the same problem. I noticed when I could not telnet master:port from the slaves. In my etc/hosts file (on master) I had a 127.0.0.1 master entry (before my 192.168.0.x master). When I removed the 127.0.0.1 entry from my etc/hosts file I could telnet and when I start-slaves.sh (from the master) my slaves connected

这篇关于星火集群:工人的信息没有显示在网页UI的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆