Apache的飞艇和放大器;星火流：Twitter的例子​​只能本地 [英] Apache Zeppelin & Spark Streaming: Twitter Example only works local

问题描述

我刚刚从 HTTP添加的示例项目到我的笔记本飞艇：//飞艇项目.ORG /文档/教程/ tutorial.html （节教程与流数据）。这个问题我现在已经是应用程序似乎只对本地工作。如果我改变了星火间preTER从本地[*]，以设置主，火花：//主：7077的应用程序不会当我做同样的SQL语句带来任何结果了。难道我做错了什么？我已经重新启动了齐柏林间preTER，也是整个飞艇守护进程和星火产业集群，没有解决的问题！有人可以提供帮助。

I just added the example project to my Zeppelin Notebook from http://zeppelin-project.org/docs/tutorial/tutorial.html (section "Tutorial with Streaming Data"). The problem I now have is that the application seems only to work local. If I change the Spark interpreter setting "master" from "local[*]" to "spark://master:7077" the application won't bring any result anymore when I'm doing the same SQL statement. Am I doing anything wrong? I already restarted the Zeppelin interpreter, also the whole Zeppelin daemon and the Spark cluster, nothing solved the issue! Can someone help.

我用下面的安装：

• 星火1.5.1（prebuild Hadoop的2.6+），法师+ 2X奴隶


• 齐柏林0.5.5（安装星火的主节点上）

修改
另外下面的安装不会为我工作：

EDIT Also the following installation won't work for me:

• 星火1.5.0（prebuild Hadoop的2.6+），法师+ 2X奴隶


• 齐柏林0.5.5（安装星火的主节点上）

截图：本地设置（作品！）

Screenshot: local setting (works!)

截图：集群设置（将无法工作！）

Screenshot: cluster setting (won't work!)

这项工作似乎在集群模式下正确运行：

The job seems to run correctly in cluster mode:

推荐答案

我之后尝试2天左右了吧！

I got it after 2 days of trying around!

本地齐柏林之间的差火花间preTER和火花群集似乎是，本地一个人包括需要哪些用于执行该微流例如微的Utils和火花群集不具有这个库默认情况下。

The difference between the local Zeppelin Spark interpreter and the Spark Cluster seems to be, that the local one has included the Twitter Utils which are needed for executing the Twitter Streaming example, and the Spark Cluster doesn't have this library by default.

因此​​，你必须手动添加依赖于齐柏林笔记本开始星火集群作为主应用程序之前。因此，笔记本电脑的第一款一定是：

Therefore you have to add the dependency manually in the Zeppelin Notebook before starting the application with Spark cluster as master. So the first paragraph of the Notebook must be:

%dep
z.reset
z.load("org.apache.spark:spark-streaming-twitter_2.10:1.5.1")

如果一个错误上运行这款occures，只是试图重新启动通过./bin/zeppelin-daemon.sh停止齐柏林服务器（安培;开始）！

If an error occures on running this paragraph, just try to restart the Zeppelin server via ./bin/zeppelin-daemon.sh stop (& start)!

这篇关于Apache的飞艇和放大器;星火流：Twitter的例子​​只能本地的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！