Topy on Jupyter for Spark 2.2.0 [英] Toree on Jupyter for Spark 2.2.0

问题描述

OS X El Capitan 10.11.6
Spark 2.2.0 (local)
Scala 2.11.8

我通过安装anaconda3使用Jupyter.我的理解是，最新的Toree生产版本不支持Spark 2.0+或Scala11.但是，我发现了一些参考资料( 2 )，您可以在其中从github克隆incubator-toree并手动设置Spark的版本.

I'm using Jupyter via my install of anaconda3. My understanding is that the latest production release of Toree does not support either Spark 2.0+ or Scala 11. However I have found several references (1, 2) where you can clone incubator-toree from github and manually set the version of Spark.

在我的Mac终端中，这是我使用的代码:

In my mac terminal, this is the code I've used:

git clone https://github.com/apache/incubator-toree
cd incubator-toree

然后，行make clean release APACHE_SPARK_VERSION=2.2.0给我以下错误:

Then, the line make clean release APACHE_SPARK_VERSION=2.2.0 gives me the following error:

rm -r dist
rm: dist: No such file or directory
make: [clean-dist] Error 1 (ignored)
APACHE_SPARK_VERSION=2.2.0 VERSION=0.2.0.dev1-incubating IS_SNAPSHOT=true sbt clean
/bin/sh: sbt: command not found
make: *** [clean] Error 127

我正在寻找有关此错误的指导.

I'm looking for guidance around this error.

推荐答案

通过运行以下命令来使用安装开发人员快照

Install the developer snapshots using by running following commands

pip install https://dist.apache.org/repos/dist/dev/incubator/toree/0.2.0/snapshots/dev1/toree-pip/toree-0.2.0.dev1.tar.gz

此版本支持spark-2.2.0

This version supports spark-2.2.0

这篇关于Topy on Jupyter for Spark 2.2.0的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！