Spark History用户界面不起作用| Ambari |纱 [英] Spark History UI not working | Ambari | YARN

问题描述

我有一个使用Ambari的hadoop群集设置，该主机具有在主机上运行的HDFS，YARN，spark之类的服务. 当我在群集模式下作为主纱线运行样本spark pi时，该应用程序将成功执行，并且我可以从资源管理器日志中查看相同内容.

I have a hadoop cluster setup using Ambari which has services like HDFS,YARN,spark running on the hosts. When i run the sample spark pi in cluster mode as master yarn, the application gets successfully executed and I can view the same from resource manager logs.

但是当我单击历史记录链接时，它不显示火花历史记录UI.如何启用/查看相同的内容?

But when i click on the history link, it does not show the spark history UI. How to enable/view the same?

推荐答案

首先，通过在 spark-defaults.conf 文件中查找spark.yarn.historyServer.address，检查您的火花历史记录服务器是否已配置.

First, check if your spark-history server is already configured by looking for spark.yarn.historyServer.address in spark-defaults.conf file.

如果未配置，则此链接应可帮助您配置服务器: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.6/bk_installing_manually_book/content/ch19s04s01.html

If not configured, this link should help you configure the server: https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.6/bk_installing_manually_book/content/ch19s04s01.html

如果已配置，请检查历史服务器主机是否可从群集中的所有节点访问，并且端口是否已打开.

If already configured, check if the history server host is accessible from all the nodes in the cluster, and also the port is open.

这篇关于Spark History用户界面不起作用| Ambari |纱的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！