Zeppelin:如何在Zeppelin中重新启动sparkContext [英] Zeppelin: How to restart sparkContext in zeppelin

查看:337
本文介绍了Zeppelin:如何在Zeppelin中重新启动sparkContext的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我正在使用Zeppelins Spark解释器的隔离"模式,在此模式下,它将为Spark集群中的每个笔记本启动一个新作业.我想在笔记本执行完毕后通过齐柏林飞艇取消工作.为此,我做了sc.stop这停止了sparkContext,并且作业也从spark集群中停止了.但是下一次当我尝试运行笔记本时,它不会再次启动sparkContext.那怎么办呢?

I am using Isolated mode of zeppelins spark interpreter, with this mode it will start a new job for each notebook in spark cluster. I want to kill the job via zeppelin when the notebook execution is completed. For this I did sc.stop this stopped the sparkContext and the job is also stopped from spark cluster. But next time when I try to run the notebook its not starting the sparkContext again. So how to do that?

推荐答案

有点直观,但是您需要访问解释器菜单选项卡,而不是直接停止SparkContext:

It's a bit counter intuitive but you need to access the interpreter menu tab instead of stopping SparkContext directly:

  • 转到解释器列表.

  • go to interpreter list.

找到Spark解释器,然后单击右上角的重新启动:

find Spark interpreter and click restart in the right upper corner:

这篇关于Zeppelin:如何在Zeppelin中重新启动sparkContext的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆