如何设置mesos上独立的OS / X上运行的火花 [英] How to set up mesos for running spark on standalone OS/X

问题描述

我想做一个Mac上星火计划的测试。星火正在运行，并且我的火花斯卡拉程序编译：但有一个库（ mesos 的。所以？）在运行时错误：

I want to do testing of Spark programs on a Mac. Spark is running and my spark scala program compiles: but there is a library (mesos.so ?) error at runtime:

Exception in thread "main" java.lang.UnsatisfiedLinkError: no mesos in java.library.path
    at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1758)
    at java.lang.Runtime.loadLibrary0(Runtime.java:823)
    at java.lang.System.loadLibrary(System.java:1045)
    at org.apache.mesos.MesosNativeLibrary.load(MesosNativeLibrary.java:46)
    at spark.SparkContext.<init>(SparkContext.scala:170)
    at com.blazedb.scala.ccp.spark.LoadRDD$.main(LoadRDD.scala:14)

什么设​​置上需要超越的火花服务器本身mesos OS / X来运行的火花客户端程序？

What setup is required on os/x beyond the spark server itself for mesos in order to run a spark client program?

推荐答案

如果你想使用与Mesos星火，还有的在项目网站说明，包括如何找到在OS X的路径Mesos库笔记。

If you want to use Spark with Mesos, there are instructions on the project website, including notes on how to find the path to the Mesos library on OS X.

当你已经注意到，有其他部署模式，包括本地模式下，不需要Mesos安装。

As you've noticed, there are other deployment modes, including the local modes, that don't require Mesos to be installed.

根据您的堆栈跟踪，它看起来就像你可能会使用星火的旧版本。由于星火0.8.0+，包已被移动到 org.apache.spark 命名空间，所以你可能需要使用的早期版本的文档的如果你不想升级。

Based on your stacktrace, it looks like you might be using an older version of Spark. Since Spark 0.8.0+, the packages have been moved into the org.apache.spark namespace, so you might need to use earlier versions of the docs if you don't want to upgrade.

这篇关于如何设置mesos上独立的OS / X上运行的火花的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！