spark-shell - I have some question on spark.

问题描述

问 题

I'm running an example using this command:

./bin/run-example org.apache.spart.examples.SparkPi local[3]

Spark Command: /usr/lib/jvm/java-7-openjdk-amd64/bin/java -cp /usr/local/spark/spark-1.6.2-bin-hadoop2.6/conf/:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/spark-assembly-1.6.2-hadoop2.6.0.jar:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/datanucleus-api-jdo-3.2.6.jar:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/datanucleus-rdbms-3.2.9.jar:/usr/local/spark/spark-1.6.2-bin-hadoop2.6/lib/datanucleus-core-3.2.10.jar:/usr/local/hadoop-2.6.0/etc/hadoop/ -Xms1g -Xmx1g -XX:MaxPermSize=256m org.apache.spark.deploy.master.Master --ip Kirai --port 7077 --webui-port 8080
========================================
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
16/07/11 17:54:12 INFO Master: Registered signal handlers for [TERM, HUP, INT]
16/07/11 17:54:13 WARN Utils: Your hostname, Kirai resolves to a loopback address: 127.0.1.1; using 172.18.5.42 instead (on interface wlan0)
16/07/11 17:54:13 WARN Utils: Set SPARK_LOCAL_IP if you need to bind to another address
16/07/11 17:54:14 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/07/11 17:54:14 INFO SecurityManager: Changing view acls to: kirai
16/07/11 17:54:14 INFO SecurityManager: Changing modify acls to: kirai
16/07/11 17:54:14 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(kirai); users with modify permissions: Set(kirai)
16/07/11 17:54:15 INFO Utils: Successfully started service 'sparkMaster' on port 7077.
16/07/11 17:54:16 INFO Master: Starting Spark master at spark://Kirai:7077
16/07/11 17:54:16 INFO Master: Running Spark version 1.6.2
16/07/11 17:54:16 INFO Utils: Successfully started service 'MasterUI' on port 8080.
16/07/11 17:54:16 INFO MasterWebUI: Started MasterWebUI at http://172.18.5.42:8080
16/07/11 17:54:16 INFO Utils: Successfully started service on port 6066.
16/07/11 17:54:16 INFO StandaloneRestServer: Started REST server for submitting applications on port 6066
16/07/11 17:54:16 INFO Master: I have been elected leader! New state: ALIVE
16/07/11 17:54:16 INFO Master: Registering worker 172.18.5.42:40967 with 2 cores, 1024.0 MB RAM
16/07/11 17:59:13 INFO Master: localhost:53223 got disassociated, removing it.
16/07/11 17:59:15 INFO Master: localhost:53222 got disassociated, removing it.
16/07/11 18:25:02 ERROR Master: RECEIVED SIGNAL 15: SIGTERM

解决方案

so，What's your question?

这篇关于spark-shell - I have some question on spark.的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！