VS Code-pyspark 2.2.0版出现问题 [英] VS Code - pyspark version 2.2.0 trouble

问题描述

大家好，

我很难找到一种方法来说服Windows上的vscode，以免在向Linux提交作业时尝试再次安装Pyspark. 具有Spark版本2.2.0的集群，该集群无法成功. 相反，vscode应该使用手动安装的Pyspark版本.

I struggle to find a way to convince vscode on windows to don't try to install Pyspark again when submitting a job to a linux hdi cluster with spark version 2.2.0 which fails to succeed. Instead vscode should use the manually installed Pyspark version.

我在哪里可以看到有关hdi扩展程序背景的详细信息?

Where can i see details what goes on in the background of the hdi extension ?

我可以想象出问题的根本原因.手动安装时 PyPI中的附录非常奇怪. Python -m Pip install Pyspark = 2.2.0.post0是正确的命令.所有其他版本的格式通常为

I can imagine the root cause of the issue. When manually installing Pyspark  I noticed that the appendix in PyPI is very odd. Python -m Pip install Pyspark=2.2.0.post0 is the correct command. All other versions are regularly formated as e.g. Pyspark=2.2.1

最好的问候
奥拉夫

Best regards
Olaf

P.S.

推荐答案

Olaf:谢谢您报告此问题.我们将在下一个版本中解决此问题.同时，您能否按照VSCode HDInsight Tools的说明重新安装Python?这将解除对您的限制，并使您能够使用这些工具.更多的 有关信息，请访问https://docs.microsoft.com/zh-cn/azure/hdinsight/hdinsight-for-vscode.要安装python，请执行以下操作:1-对于Windows，请下载并安装Python(https://www.python.org/downloads/)，然后确保Python和pip位于系统路径中. 2为 有关macOS和Linux的说明，请参阅(https://docs.microsoft.com/zh-cn/azure/hdinsight/set-up-pyspark-interactive-environment)以设置PySpark交互式环境.请让我们知道问题是否仍然存在，我们很乐意与您联系 你.谢谢-Jenny

Hi, Olaf: Thanks for reporting the issue. We will be fixing this issue in our next release. Meanwhile, can you please follow the instructions from VSCode HDInsight Tools to install Python again? This will unblock you and enable you to use the tools. More information can be found at https://docs.microsoft.com/en-us/azure/hdinsight/hdinsight-for-vscode. To install python: 1-For Windows, download and install Python (https://www.python.org/downloads/), then make sure Python and pip are in your system PATH. 2-For instructions for macOS and Linux, see (https://docs.microsoft.com/en-us/azure/hdinsight/set-up-pyspark-interactive-environment) to set up the PySpark interactive environment. Please let us know if the issue persists and we will be happy to host a call with you. Thanks, -Jenny

这篇关于VS Code-pyspark 2.2.0版出现问题的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！