群集中HADOOP_CONF_DIR的值 [英] Value for HADOOP_CONF_DIR from Cluster

问题描述

我已经使用Ambari设置了一个群集(YARN)，并以3个VM作为主机.

I have setup a cluster(YARN) using Ambari with 3 VMs as hosts.

在哪里可以找到HADOOP_CONF_DIR的值?

Where I can find the value for HADOOP_CONF_DIR ?

# Run on a YARN cluster
export HADOOP_CONF_DIR=XXX
./bin/spark-submit \
  --class org.apache.spark.examples.SparkPi \
  --master yarn-cluster \  # can also be `yarn-client` for client mode
  --executor-memory 20G \
  --num-executors 50 \
  /path/to/examples.jar \
  1000

推荐答案

还要安装Hadoop.就我而言，我已将其安装在/usr/local/hadoop

Install Hadoop as well. In my case I've installed it in /usr/local/hadoop

设置Hadoop环境变量

Setup Hadoop Environment Variables

export HADOOP_INSTALL=/usr/local/hadoop

然后设置conf目录

export HADOOP_CONF_DIR=$HADOOP_INSTALL/etc/hadoop

这篇关于群集中HADOOP_CONF_DIR的值的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！