使用Vagrant在CentOS 6上安装Zeppelin的问题 [英] Issues Installing Zeppelin on CentOS 6 with Vagrant

问题描述

我们正尝试在一个带有Vagrant的4节点CentOS 6集群上站立Zeppelin的沙盒/评估实例，并在构建过程中遇到一些依赖问题。这里是我们正在运行的高级脚本。

（曾试图以特权帐户和用户身份运行，结果相同。）

重新创建步骤

• 从Binary安装Hadoop 2.7.0
  
• 从Binary安装Spark 1.4.0
  
• 从二进制文件安装Maven 3.3.3
  

• 运行以下命令：

    curl --silent --location https://rpm.nodesource.com/setup | bash  -  
   yum install -y nodejs 
   git config --global url。https：//.insteadOf git：// 
   git clone https://github.com/apache/孵化器-zeppelin.git 
   cd孵化器-zeppelin 
   npm更新-g npm 
   npm安装-g grunt-cli 
   npm安装-g grunt 
   npm安装-g bower 
   mvn clean package -Pspark-1.4 -Dhadoop.version = 2.7.0 -Phadoop-2.6 -DskipTests 
    

堆栈跟踪

以下是我们在步骤用于构建zeppelin-web：

  ==> node1：下载：https://repo.maven.apache.org/maven2/com/google/guava/guava/10.0.1/guava-10.0.1.jar（1467 KB在154.5 KB /秒）
 ==> node1：[INFO]安装节点版本v0.10.18 
 ==> node1：[INFO]创建临时目录/ home / vagrant / incubator-zeppelin / zeppelin-web / node_tmp 
 ==> node1：[INFO]将Node.js从http://nodejs.org/dist/v0.10.18/node-v0.10.18-linux-x64.tar.gz下载到/ home / vagrant / incubator-zeppelin / zeppelin-web /node_tmp/node.tar.gz 
 ==> node1：[INFO]没有配置代理，直接下载
 ==> node1：[INFO]在node_tmp中提取Node.js文件
 ==> node1：[INFO]将/home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz打包到/ home / vagrant / incubator-zeppelin / zeppelin-web / node_tmp 
 ==> node1：[INFO]将节点二进制移动到/ home / vagrant / incubator-zeppelin / zeppelin-web / node / node 
 ==> node1：[INFO]删除临时目录/ home / vagrant / incubator-zeppelin / zeppelin-web / node_tmp 
 ==> node1：[INFO]本地安装节点。 
 ==> node1：
 ==> node1：[INFO]安装npm版本1.3.8 
 ==> node1：[INFO]将NPM从http://registry.npmjs.org/npm/-/npm-1.3.8.tgz下载到/home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz 
 ==> node1：[INFO]没有配置代理，直接下载
 ==> node1：[INFO]提取节点中的NPM文件/ 
 ==> node1：[INFO]将/home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz打包到/ home / vagrant / incubator-zeppelin / zeppelin-web / node 
 ==> node1：[INFO]本地安装NPM。 
 ==> node1：[INFO] 
 ==> node1：[INFO] --- frontend-maven-plugin：0.0.23：npm（npm install）@ zeppelin-web --- 
 ==> node1：[INFO]在/ home / vagrant / incubator-zeppelin / zeppelin-web中运行'npm install --color = false'
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-angular-templates 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-dom-munger 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-autoprefixer 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/bower 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-concurrent 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-connect 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-clean 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-concat 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-copy 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-cssmin 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-htmlmin 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-jshint 
 ==> node1：[错误] npm http GET https://registry.npmjs.org/grunt-contrib-uglify 
  

它会持续一段时间，然后失败整个构建。

TL; DR

在先决条件方面是否缺少某些东西，或者是否有一些技巧让它在CentOS 6上构建，这不在文档中？ :)此外，这已被发布到Zeppelin用户板，所以也可以自由地回答。/ /解决我的问题是以非root用户身份运行以下内容：

  sudo envPATH = $ PATHmvn clean install -Pspark-1.4 -Pspark.version = 1.4.0 -Phadoop.version = 2.7.0 -DskipTests 
 sudo envPATH = $ PATHmvn clean install -Pspark-1.4 -Pspark.version = 1.4.0 -Phadoop.version = 2.7.0 -DskipTests -rf：zeppelin-web 
  

We are trying to stand up a sandbox/evaluation instance of Zeppelin on a 4-node CentOS 6 cluster with Vagrant and having some issues with dependencies in the build process. Here is the high level script we’re running.

(Have tried running this as privileged account and as a user, with the same results.)

Recreate Steps

• Install Hadoop 2.7.0 from Binary
• Install Spark 1.4.0 from Binary
• Install Maven 3.3.3 from Binary

• Run the following:

  curl --silent --location  https://rpm.nodesource.com/setup | bash -
  yum install -y nodejs
  git config --global url."https://".insteadOf git://
  git clone https://github.com/apache/incubator-zeppelin.git
  cd incubator-zeppelin
  npm update -g npm
  npm install -g grunt-cli
  npm install -g grunt 
  npm install -g bower
  mvn clean package -Pspark-1.4 -Dhadoop.version=2.7.0 -Phadoop-2.6 -DskipTests
  

Stack Trace

Here’s an example of the stack trace we are receiving when we get to the step for building zeppelin-web:

==> node1: Downloaded: https://repo.maven.apache.org/maven2/com/google/guava/guava/10.0.1/guava-10.0.1.jar (1467 KB at 154.5 KB/sec)
==> node1: [INFO] Installing node version v0.10.18
==> node1: [INFO] Creating temporary directory /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Downloading Node.js from http://nodejs.org/dist/v0.10.18/node-v0.10.18-linux-x64.tar.gz to /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz
==> node1: [INFO] No proxy was configured, downloading directly
==> node1: [INFO] Extracting Node.js files in node_tmp
==> node1: [INFO] Unpacking /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz into /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Moving node binary to /home/vagrant/incubator-zeppelin/zeppelin-web/node/node
==> node1: [INFO] Deleting temporary directory /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Installed node locally.
==> node1: 
==> node1: [INFO] Installing npm version 1.3.8
==> node1: [INFO] Downloading NPM from http://registry.npmjs.org/npm/-/npm-1.3.8.tgz to /home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz
==> node1: [INFO] No proxy was configured, downloading directly
==> node1: [INFO] Extracting NPM files in node/
==> node1: [INFO] Unpacking /home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz into /home/vagrant/incubator-zeppelin/zeppelin-web/node
==> node1: [INFO] Installed NPM locally.
==> node1: [INFO] 
==> node1: [INFO] --- frontend-maven-plugin:0.0.23:npm (npm install) @ zeppelin-web ---
==> node1: [INFO] Running 'npm install --color=false' in /home/vagrant/incubator-zeppelin/zeppelin-web
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-angular-templates
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-dom-munger
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-autoprefixer
==> node1: [ERROR] npm http GET https://registry.npmjs.org/bower
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-concurrent
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-connect
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-clean
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-concat
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-copy
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-cssmin
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-htmlmin
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-jshint
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-uglify

...

It goes on like that for a while, then fails the whole build.

TL;DR

Is there something missing in terms of prerequisites, or is there some trickery to getting it to build on CentOS 6 that’s not in the documentation? :) Also, this has been posted to the Zeppelin User Board, so feel free to answer there too/instead.

解决方案

The solution to my problem was to run the following as a non-root user:

sudo env "PATH=$PATH" mvn clean install -Pspark-1.4 -Pspark.version=1.4.0 -Phadoop.version=2.7.0 -DskipTests
sudo env "PATH=$PATH" mvn clean install -Pspark-1.4 -Pspark.version=1.4.0 -Phadoop.version=2.7.0 -DskipTests -rf :zeppelin-web

这篇关于使用Vagrant在CentOS 6上安装Zeppelin的问题的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！