做火花壳MLIB,错误:对象jblas不是包的成员组织 [英] doing spark-shell with mlib, error: object jblas is not a member of package org

查看:874
本文介绍了做火花壳MLIB,错误:对象jblas不是包的成员组织的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

在火花壳,当我exectue 进口org.jblas.DoubleMatrix ,它会抛出错误:对象jblas不包组织成员在RHEL

In spark-shell, when I exectue import org.jblas.DoubleMatrix, it will throw "error: object jblas is not a member of package org" on the RHEL.

其实,我用Google搜索有关从 https开头jblas并安装gfortran:// GCC。在我的Mac Pro gnu.org/wiki/GFortranBinaries#MacOS

Actually, I googled about "jblas" and installed "gfortran" from https://gcc.gnu.org/wiki/GFortranBinaries#MacOS on my mac pro.

我的火花版本是火花1.4.0彬hadoop2.6.tar或火花1.5.1彬hadoop2.6.tar,这是直接从官方网站上下载,这是说,我没'T从源头code构建。

My spark version is spark-1.4.0-bin-hadoop2.6.tar or spark-1.5.1-bin-hadoop2.6.tar, which is download directly from the official website, it's to say that I didn't build from the source code.

推荐答案

这一步是可选的,它会在你的笔记本电脑存储库安装jblas罐子。

This step may be optional, it will install the jblas jar on your laptop repository.

git clone https://github.com/mikiobraun/jblas.git
cd jblas
mvn install

输入到火花目录

cd /Users/erichan/Garden/spark-1.5.1-bin-cdh4

启动与封装选项的火花外壳,如果你没有做的第一步,你应该给予正确的Maven坐标jblas:

Launch the spark shell with packages option, and if you didn't do the first step, you should give the right maven coordinate for jblas:

bin/spark-shell --name my_mlib --packages org.jblas:jblas:1.2.4-SNAPSHOT --driver-memory 4G --executor-memory 4G --driver-cores 2

这篇关于做火花壳MLIB,错误:对象jblas不是包的成员组织的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆