法师必须纱，火花启动 [英] Master must start with yarn,spark

问题描述

当是要运行SparkPi例子中，我得到这个错误。

I am getting this error when is want to run SparkPi example.

   beyhan@beyhan:~/spark-1.2.0-bin-hadoop2.4$ /home/beyhan/spark-1.2.0-bin-hadoop2.4/bin/spark-submit --master ego-client --class org.apache.spark.examples.SparkPi /home/beyhan/spark-1.2.0-bin-hadoop2.4/lib/spark-examples-1.jar
        Spark assembly has been built with Hive, including Datanucleus jars on classpath
        Error: Master must start with yarn, spark, mesos, or local
        Run with --help for usage help or --verbose for debug output
        Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties

此外，我已经通过另一端开始我的主人。

Also i already start my master via another terminal

>./sbin/start-master.sh 
starting org.apache.spark.deploy.master.Master, logging to /home/beyhan/spark-1.2.0-bin-hadoop2.4/sbin/../logs/spark-beyhan-org.apache.spark.deploy.master.Master-1-beyhan.out

任何建议？
谢谢你。

Any suggestion ? Thanks.

推荐答案

下载并提取星火：

$ cd ~/Downloads
$ wget -c http://archive.apache.org/dist/spark/spark-1.2.0/spark-1.2.0-bin-hadoop2.4.tgz
$ cd /tmp
$ tar zxf ~/Downloads/spark-1.2.0-bin-hadoop2.4.tgz
$ cd spark-1.2.0-bin-hadoop2.4/

启动主：

$ sbin/start-master.sh

查找文件中的记录，上面的命令打印主人的URL。让我们假设master是：火花：//自我服务器：7077

在这种情况下，您也可以通过访问该网址找到您的主网址>

In this case, you can also find your master url by visiting this URL: http://localhost:8080/

开始一个从属，并将其连接到主：

Start one slave, and connect it to master:

$ sbin/start-slave.sh --master spark://ego-server:7077

另一种方式，以确保主启动和运行开始绑定到该主壳：

Another way to ensure that master up and running start a shell bound to that master:

$ bin/spark-submit --master "spark://ego-server:7077"

如果你得到一个火花壳，然后一切似乎都很好。

If you get a spark shell, then everything seems fine.

现在执行作业：

$ find . -name "spark-example*jar"
./lib/spark-examples-1.2.0-hadoop2.4.0.jar

$ bin/spark-submit --master "spark://ego-server:7077" --class org.apache.spark.examples.SparkPi ./lib/spark-examples-1.2.0-hadoop2.4.0.jar

这篇关于法师必须纱，火花启动的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！