oozie的job.properties中的jobTracker属性 [英] jobTracker property in job.properties of oozie

问题描述

我正在使用hadoop-2.7.2和oozie-4.0.1，oozie工作流程的job.properties文件中的jobTracker值应该是多少.我引用了此链接；

I'm using hadoop-2.7.2 and oozie-4.0.1, what should be the jobTracker value in job.properties file of oozie workflow. I referred this link;

http://hadooptutorial.info/apache-oozie-installation -on-ubuntu-14-04/

指出，在YARN架构中，作业跟踪程序在8032端口上运行，而我目前正在使用它.但是在hadoop的mapred-site.xml中，我的作业跟踪器属性值为hdfs://localhost:54311.

which states that, in YARN architecture the job tracker runs on 8032 port and i'm currently using this. But in mapred-site.xml of hadoop i'm having the value hdfs://localhost:54311 for job tracker property.

我很困惑，任何人都可以向我解释一下，或者提供一些有用的链接来安装oozie并在oozie上运行作业.

I'm confused, can any one explain me or provide some useful links for installing oozie and running jobs on oozie.

当前，我无法在oozie上运行工作流程作业，它长时间处于运行"状态，然后由于连接错误而被挂起. Job DAG也没有生成，它引发了一些UI异常.

Currently, i'm not able to run workflow jobs on oozie, it is in a Running state for a long time and then it is getting suspended with a connection error. Job DAG is also not getting generated, it is throwing some UI Exception.

请任何人帮助我.

推荐答案

在属性文件中，只需传递您在yarn-site.xml中配置的Resorucemanager地址，或将工作流.xml文件中的resourcemanager地址直接解析为

In your properties file just pass the Resorucemanager address which you have configured in the yarn-site.xml or directly parse the resourcemanager address in workflow.xml file as

        <job-tracker>localhost:8032</job-tracker>

在运行属性文件时，您需要指定oozie服务器将在哪个主机上运行，​​但我认为在那部分您没有遇到任何问题.然后粘贴错误消息并更新问题.

While running properties file you need to specify in which host the oozie server will be running, I think in that part you didn't face any issues right. Then paste the error message and update the question.

已编辑: 配置必须位于yarn-site.xml

EDITED: Configurations needed to be in yarn-site.xml

    <property>
       <name>yarn.nodemanager.aux-services</name>
       <value>mapreduce_shuffle</value>
    </property>
    <property>
       <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name>
       <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    <property>
    <description>NM Webapp address.</description>
    <name>yarn.nodemanager.webapp.address</name>
    <value>${yarn.nodemanager.hostname}:8042</value>
  </property>
  <property>
    <description>hostname </description>
    <name>yarn.nodemanager.hostname</name>
    <value>localhost</value>
  </property>

您可以为Pesudo节点集群指定主机名或localhost. 对于HA群集，需要以下

you can either specify hostname or localhost for Pesudo node cluster. for HA cluster need the below

https://hadoop. apache.org/docs/r2.7.2/hadoop-project-dist/hadoop-hdfs/HDFSHighAvailabilityWithQJM.html

这篇关于oozie的job.properties中的jobTracker属性的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！