使用Vagrant在CentOS 6上安装Zeppelin的问题 [英] Issues Installing Zeppelin on CentOS 6 with Vagrant
问题描述
我们正尝试在一个带有Vagrant的4节点CentOS 6集群上站立Zeppelin的沙盒/评估实例,并在构建过程中遇到一些依赖问题。这里是我们正在运行的高级脚本。
(曾试图以特权帐户和用户身份运行,结果相同。)
重新创建步骤
- 从Binary安装Hadoop 2.7.0
- 从Binary安装Spark 1.4.0
- 从二进制文件安装Maven 3.3.3
-
运行以下命令:
curl --silent --location https://rpm.nodesource.com/setup | bash -
yum install -y nodejs
git config --global url。https://.insteadOf git://
git clone https://github.com/apache/孵化器-zeppelin.git
cd孵化器-zeppelin
npm更新-g npm
npm安装-g grunt-cli
npm安装-g grunt
npm安装-g bower
mvn clean package -Pspark-1.4 -Dhadoop.version = 2.7.0 -Phadoop-2.6 -DskipTests
堆栈跟踪
以下是我们在步骤用于构建zeppelin-web:
==> node1:下载:https://repo.maven.apache.org/maven2/com/google/guava/guava/10.0.1/guava-10.0.1.jar(1467 KB在154.5 KB /秒)
==> node1:[INFO]安装节点版本v0.10.18
==> node1:[INFO]创建临时目录/ home / vagrant / incubator-zeppelin / zeppelin-web / node_tmp
==> node1:[INFO]将Node.js从http://nodejs.org/dist/v0.10.18/node-v0.10.18-linux-x64.tar.gz下载到/ home / vagrant / incubator-zeppelin / zeppelin-web /node_tmp/node.tar.gz
==> node1:[INFO]没有配置代理,直接下载
==> node1:[INFO]在node_tmp中提取Node.js文件
==> node1:[INFO]将/home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz打包到/ home / vagrant / incubator-zeppelin / zeppelin-web / node_tmp
==> node1:[INFO]将节点二进制移动到/ home / vagrant / incubator-zeppelin / zeppelin-web / node / node
==> node1:[INFO]删除临时目录/ home / vagrant / incubator-zeppelin / zeppelin-web / node_tmp
==> node1:[INFO]本地安装节点。
==> node1:
==> node1:[INFO]安装npm版本1.3.8
==> node1:[INFO]将NPM从http://registry.npmjs.org/npm/-/npm-1.3.8.tgz下载到/home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz
==> node1:[INFO]没有配置代理,直接下载
==> node1:[INFO]提取节点中的NPM文件/
==> node1:[INFO]将/home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz打包到/ home / vagrant / incubator-zeppelin / zeppelin-web / node
==> node1:[INFO]本地安装NPM。
==> node1:[INFO]
==> node1:[INFO] --- frontend-maven-plugin:0.0.23:npm(npm install)@ zeppelin-web ---
==> node1:[INFO]在/ home / vagrant / incubator-zeppelin / zeppelin-web中运行'npm install --color = false'
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-angular-templates
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-dom-munger
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-autoprefixer
==> node1:[错误] npm http GET https://registry.npmjs.org/bower
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-concurrent
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-connect
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-clean
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-concat
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-copy
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-cssmin
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-htmlmin
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-jshint
==> node1:[错误] npm http GET https://registry.npmjs.org/grunt-contrib-uglify
它会持续一段时间,然后失败整个构建。
TL; DR
在先决条件方面是否缺少某些东西,或者是否有一些技巧让它在CentOS 6上构建,这不在文档中? :)此外,这已被发布到Zeppelin用户板,所以也可以自由地回答。/ /解决我的问题是以非root用户身份运行以下内容:
sudo envPATH = $ PATHmvn clean install -Pspark-1.4 -Pspark.version = 1.4.0 -Phadoop.version = 2.7.0 -DskipTests
sudo envPATH = $ PATHmvn clean install -Pspark-1.4 -Pspark.version = 1.4.0 -Phadoop.version = 2.7.0 -DskipTests -rf:zeppelin-web
We are trying to stand up a sandbox/evaluation instance of Zeppelin on a 4-node CentOS 6 cluster with Vagrant and having some issues with dependencies in the build process. Here is the high level script we’re running.
(Have tried running this as privileged account and as a user, with the same results.)
Recreate Steps
- Install Hadoop 2.7.0 from Binary
- Install Spark 1.4.0 from Binary
- Install Maven 3.3.3 from Binary
Run the following:
curl --silent --location https://rpm.nodesource.com/setup | bash - yum install -y nodejs git config --global url."https://".insteadOf git:// git clone https://github.com/apache/incubator-zeppelin.git cd incubator-zeppelin npm update -g npm npm install -g grunt-cli npm install -g grunt npm install -g bower mvn clean package -Pspark-1.4 -Dhadoop.version=2.7.0 -Phadoop-2.6 -DskipTests
Stack Trace
Here’s an example of the stack trace we are receiving when we get to the step for building zeppelin-web:
==> node1: Downloaded: https://repo.maven.apache.org/maven2/com/google/guava/guava/10.0.1/guava-10.0.1.jar (1467 KB at 154.5 KB/sec)
==> node1: [INFO] Installing node version v0.10.18
==> node1: [INFO] Creating temporary directory /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Downloading Node.js from http://nodejs.org/dist/v0.10.18/node-v0.10.18-linux-x64.tar.gz to /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz
==> node1: [INFO] No proxy was configured, downloading directly
==> node1: [INFO] Extracting Node.js files in node_tmp
==> node1: [INFO] Unpacking /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp/node.tar.gz into /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Moving node binary to /home/vagrant/incubator-zeppelin/zeppelin-web/node/node
==> node1: [INFO] Deleting temporary directory /home/vagrant/incubator-zeppelin/zeppelin-web/node_tmp
==> node1: [INFO] Installed node locally.
==> node1:
==> node1: [INFO] Installing npm version 1.3.8
==> node1: [INFO] Downloading NPM from http://registry.npmjs.org/npm/-/npm-1.3.8.tgz to /home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz
==> node1: [INFO] No proxy was configured, downloading directly
==> node1: [INFO] Extracting NPM files in node/
==> node1: [INFO] Unpacking /home/vagrant/incubator-zeppelin/zeppelin-web/npm.tar.gz into /home/vagrant/incubator-zeppelin/zeppelin-web/node
==> node1: [INFO] Installed NPM locally.
==> node1: [INFO]
==> node1: [INFO] --- frontend-maven-plugin:0.0.23:npm (npm install) @ zeppelin-web ---
==> node1: [INFO] Running 'npm install --color=false' in /home/vagrant/incubator-zeppelin/zeppelin-web
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-angular-templates
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-dom-munger
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-autoprefixer
==> node1: [ERROR] npm http GET https://registry.npmjs.org/bower
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-concurrent
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-connect
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-clean
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-concat
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-copy
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-cssmin
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-htmlmin
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-jshint
==> node1: [ERROR] npm http GET https://registry.npmjs.org/grunt-contrib-uglify
...
It goes on like that for a while, then fails the whole build.
TL;DR
Is there something missing in terms of prerequisites, or is there some trickery to getting it to build on CentOS 6 that’s not in the documentation? :) Also, this has been posted to the Zeppelin User Board, so feel free to answer there too/instead.
The solution to my problem was to run the following as a non-root user:
sudo env "PATH=$PATH" mvn clean install -Pspark-1.4 -Pspark.version=1.4.0 -Phadoop.version=2.7.0 -DskipTests
sudo env "PATH=$PATH" mvn clean install -Pspark-1.4 -Pspark.version=1.4.0 -Phadoop.version=2.7.0 -DskipTests -rf :zeppelin-web
这篇关于使用Vagrant在CentOS 6上安装Zeppelin的问题的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!