如何在 jupyter notebook 上集成 pyspark [英] how to integrate pyspark on jupyter notebook

问题描述

我已按照说明将 pyspark 与 jupyter 集成，但完成后我只能在命令提示符下运行 pyspark.

i have followed instructions to integrate pyspark with jupyter but after i was done i was only able to run pyspark on the command prompt .

基本上当我在我的命令中使用 ipython 时它正在工作，但是当我更改为 jupyter 时它说

Basically when i am using ipython in my command it is working but when i change to jupyter it says

'"Jupyter "' is not recognized as an internal or external command,
operable program or batch file.

拜托各位，我现在真的很累了，请帮忙

please SO people i am really exhausted now , please help

注意:我遵循了本教程做我的整合.

note : i followed this tutorial to do my integration .

直到现在我都遵循了这个命令:

till now i have followed this command :

  set PYSPARK_DRIVER_PYTHON=ipython 
  set PYSPARK_DRIVER_PYTHON_OPTS = notebook 
  pyspark 

它在 cmd 本身中打开 pyspark

it opens pyspark in cmd itself

推荐答案

Windows set 命令不接受 = 符号前的空格.

Windows set command does not accept spaces before the = sign.

像这样解决这个问题:

set PYSPARK_DRIVER_PYTHON=ipython 
set PYSPARK_DRIVER_PYTHON_OPTS=notebook 
pyspark

系统想要运行 "Jupyter %PYSPARK_DRIVER_PYTHON_OPTS%" 可执行文件，但尝试运行 '"Jupyter "'

The system wants to run the "Jupyter %PYSPARK_DRIVER_PYTHON_OPTS%" executable but instead tries to run '"Jupyter "'

因此你得到的错误.

这篇关于如何在 jupyter notebook 上集成 pyspark的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！