Zeppelin 0.7.2 版本不支持 spark 2.2.0 [英] Zeppelin 0.7.2 version does not support spark 2.2.0
问题描述
如何降级spark版本?其他解决方案是什么?我必须使用 spark 会话将我的配置单元表连接到 spark.但是 zeppelin 不支持 spark 版本.
这里有两个原因.
[1] Zeppelin 0.7.2 将 spark 2.2+ 标记为不受支持的版本.
这是可行的,因为只有 spark 解释器(对于 2.2)需要 java 8 而 Zeppelin 不需要它.
简而言之
- 修改此处 并重建,如果您想在 Zeppelin 分支 0.7 上激发 2.2
- 并使用 JDK 8 作为 spark 解释器.
How to downgrade the spark version? What could be the other solutions? I have to connect my hive tables to spark using spark session. But the spark version is not supported by zeppelin.
Here are 2 reasons.
[1] Zeppelin 0.7.2 marked spark 2.2+ as the unsupported version.
public static final SparkVersion UNSUPPORTED_FUTURE_VERSION = SPARK_2_2_0;
[2] Even if you change the const and build again, you might fail to run Zeppelin 0.7.2 with Spark 2.2
Spark dropped support for Java 7 and Zeppelin 0.7.2 was built with JDK 7. So you need to rebuild it with JDK 8.
One work around you can use is, specifying JAVA_HOME
in the spark interpreter (for 2.2) as commented here
That works because only spark interpreter (for 2.2) requires java 8 and Zeppelin doesn't need it.
In short
- Modify here and rebuild if you want to spark 2.2 on Zeppelin branch-0.7
- And Use JDK 8 for the spark interpreter.
这篇关于Zeppelin 0.7.2 版本不支持 spark 2.2.0的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!