Ubuntu通过apt-get安装apache spark [英] Ubuntu install apache spark via apt-get

问题描述

我需要安装spark并在一台机器上以独立模式运行它，并寻找通过apt-get进行安装的直接方法

I need to install spark and run it in standalone mode on one machine and looking for a straight forward way to install it via apt-get

我找到了如何通过pip 这里

I found how to do this with pyspark via pip here

我找不到用一个终端命令安装spark的任何方法.

I can not find any way to install spark with one terminal command.

安装pyspark是否安装所有的spark软件?

Does installing pyspark install all the spark software?

我发现

I found instructions for how to install spark, and it's more complex

有没有一种方法可以通过apt-get用类似的一个终端命令安装spark?

Is there a way to install spark with a similar one terminal command via apt-get?

编辑

我发现此解释了如何使用apt-get安装spark，我得到以下错误

I found this explaining how to install spark using apt-get and i get the following error

E:无法找到包装火花芯E:无法找到包装 spark-master E:无法找到软件包spark-worker E:无法找到 找到软件包spark-history-server E:无法找到软件包 spark-python

E: Unable to locate package spark-core E: Unable to locate package spark-master E: Unable to locate package spark-worker E: Unable to locate package spark-history-server E: Unable to locate package spark-python

谢谢

推荐答案

在安装pyspark之前，您必须安装Java8.在

Before installing pyspark you must install Java8. This is described at

• http://www.webupd8.org/2014/03/how-to-install-oracle-java-8-in-debian.html
• http://www.webupd8.org/2012/09/install-oracle-java-8-in-ubuntu-via-ppa.html

• http://www.webupd8.org/2014/03/how-to-install-oracle-java-8-in-debian.html
• http://www.webupd8.org/2012/09/install-oracle-java-8-in-ubuntu-via-ppa.html

要在Ubuntu上全自动安装Java8，请执行

For a fully automatic installation of Java8 on Ubuntu do

$ apt-get update
$ apt-get -y install software-properties-common
$ add-apt-repository -y ppa:webupd8team/java
$ echo debconf shared/accepted-oracle-license-v1-1 select true | debconf-set-selections
$ echo debconf shared/accepted-oracle-license-v1-1 seen true | debconf-set-selections
$ apt-get update
$ apt-get -y install oracle-java8-installer

(请参阅 https://newfivefour.com/docker-java8-auto-install .html )

之后，您只需运行pip install pyspark.

这篇关于Ubuntu通过apt-get安装apache spark的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！