findspark.init() IndexError: list index out of range 错误 [英] findspark.init() IndexError: list index out of range error

问题描述

在 Python 3.5 Jupyter 环境中运行以下命令时，出现以下错误.关于导致它的原因有什么想法吗?

When running the following in a Python 3.5 Jupyter environment I get the error below. Any ideas on what is causing it?

import findspark
findspark.init()

错误:

IndexError                                Traceback (most recent call
last) <ipython-input-20-2ad2c7679ebc> in <module>()
      1 import findspark
----> 2 findspark.init()
      3 
      4 import pyspark

/.../anaconda/envs/pyspark/lib/python3.5/site-packages/findspark.py in init(spark_home, python_path, edit_rc, edit_profile)
    132     # add pyspark to sys.path
    133     spark_python = os.path.join(spark_home, 'python')
--> 134     py4j = glob(os.path.join(spark_python, 'lib', 'py4j-*.zip'))[0]
    135     sys.path[:0] = [spark_python, py4j]
    136 

IndexError: list index out of range

推荐答案

这很可能是因为 SPARK_HOME 环境变量没有在您的系统上正确设置.或者，您可以在初始化 findspark 时指定它，如下所示:

This is most likely due to the SPARK_HOME environment variable not being set correctly on your system. Alternatively, you can just specify it when you're initialising findspark, like so:

import findspark
findspark.init('/path/to/spark/home')

在那之后，它应该一切正常！

After that, it should all work!

这篇关于findspark.init() IndexError: list index out of range 错误的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！