JA017：无法查找已启动的hadoop作业ID [英] JA017: Could not lookup launched hadoop Job ID

问题描述

在Hue的Oozie编辑器中提交mapreduce作业时，如何解决此问题？ ：

JA017：无法查找与行动[0000009-150711083342968-oozie-root-W @ mapreduce-f660]相关联的hadoop作业ID [job_local152843681_0009]。未能执行此操作！

更新：

 这里是日志文件：
 2015-07-15 04：54：40,304 INFO ActionStartXCommand：520  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow] JOB [0000010-150711083342968用户重试状态：userRetryCount [0]开始操作[0000010-150711083342968-oozie-root-W @：start：] [0000010-150711083342968-oozie-root-W @：start： ，userRetryMax [0]，userRetryInterval [10] 
 2015-07-15 04:54:40,321 INFO ActionStartXCommand：520  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow] JOB [ 0000010-150711083342968-oozie-root-W]动作[0000010-150711083342968-oozie-root-W @：start：] [*** 0000010-150711083342968-oozie-root-W @：start：***]动作状态= DONE 
 2015-07-15 04:54:40,325 INFO ActionStartXCommand：520  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow]作业[0000010-150711083342968-oozie-root-W ]行动[0000010-150711083342968-oozie-root-W @：开始：] [*** 0000010-15071108 3342968-oozie-root-W @：start：***]在DB中更新操作！ 
 2015-07-15 04:54:40,501 INFO WorkflowNotificationXCommand：520  -  SERVER [myserver] USER [ - ] GROUP [ - ] TOKEN [ - ] APP [ - ] JOB [0000010-150711083342968-oozie-root-W ]操作[0000010-150711083342968-oozie-root-W @：start：]否定义通知URL。因此没有通知工作0000010-150711083342968-oozie-root-W @：start：
 2015-07-15 04:54:40,502 INFO WorkflowNotificationXCommand：520  -  SERVER [myserver] USER [ - ] GROUP [ - ] TOKEN [ - ] APP [ - ] JOB [0000010-150711083342968-oozie-root-W]操作[]否定义通知URL。因此没有通知的工作0000010-150711083342968-oozie-root-W 
 2015-07-15 04：54：40,713 INFO ActionStartXCommand：520  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow]作业[0000010-150711083342968-oozie-root-W]作业[0000010-150711083342968-oozie-root-W @ mapreduce-52d9]与用户开始操作[0000010-150711083342968-oozie-root-W @ mapreduce-52d9] -retry状态：userRetryCount [0]，userRetryMax [0]，userRetryInterval [10] 
 2015年7月15日04：54：43216 WARN MapReduceActionExecutor：523  -  SERVER [MYSERVER] USER [根]甲基[ - ] TOKEN [] APP [My_Workflow]作业[0000010-150711083342968-oozie-root-W]作业[0000010-150711083342968-oozie-root -W @ mapreduce-52d9] check（）中的异常。消息[JA017：无法查找已启动的与作业[0000010-150711083342968-oozie-root-W @ mapreduce-52d9]关联的hadoop作业ID [job_local1099179300_0010]。无法执行此操作！] 
 org.apache.oozie.action.ActionExecutorException：JA017：无法查找已启动的hadoop作业ID [job_local1099179300_0010]，它与操作[0000010-150711083342968-oozie-root-W @ mapreduce-52d9 ]。没有这个动作！ 
 at org.apache.oozie.action.hadoop.JavaActionExecutor.check（JavaActionExecutor.java:1359）
 at org.apache.oozie.action.hadoop.JavaActionExecutor.start（JavaActionExecutor.java:1288） 
 at org.apache.oozie.command.wf.ActionStartXCommand.execute（ActionStartXCommand.java:250）
 at org.apache.oozie.command.wf.ActionStartXCommand.execute（ActionStartXCommand.java:64） 
 at org.apache.oozie.command.XCommand.call（XCommand.java:286）
 at org.apache.oozie.service.CallableQueueService $ CompositeCallable.call（CallableQueueService.java:321）
 at org.apache.oozie.service.CallableQueueService $ CompositeCallable.call（CallableQueueService.java:250）
 at org.apache.oozie.service.CallableQueueService $ CallableWrapper.run（CallableQueueService.java:175）
。在java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）
在java.util.concurrent.ThreadPoolExecutor中的$ Worker.run（ThreadPoolExecutor.java:615）
在java.lang中。 Thread.run（Thread.java:745）
 2015-07-15 04:54:42 AM WARN ActionStartXCommand：523  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow] JOB [ 0000010-150711083342968-oozie-root-W]动作[0000010-150711083342968-oozie-root -W @ mapreduce-52d9]错误开始动作[mapreduce-52d9]。 ErrorType [FAILED]，ErrorCode [JA017]，消息[JA017：无法查找已启动的与作业[0000010-150711083342968-oozie-root-W @ mapreduce-52d9]关联的hadoop作业ID [job_local1099179300_0010]。无法执行此操作！] 
 org.apache.oozie.action.ActionExecutorException：JA017：无法查找已启动的hadoop作业ID [job_local1099179300_0010]，它与操作[0000010-150711083342968-oozie-root-W @ mapreduce-52d9 ]。没有这个动作！ 
 at org.apache.oozie.action.hadoop.JavaActionExecutor.check（JavaActionExecutor.java:1359）
 at org.apache.oozie.action.hadoop.JavaActionExecutor.start（JavaActionExecutor.java:1288） 
 at org.apache.oozie.command.wf.ActionStartXCommand.execute（ActionStartXCommand.java:250）
 at org.apache.oozie.command.wf.ActionStartXCommand.execute（ActionStartXCommand.java:64） 
 at org.apache.oozie.command.XCommand.call（XCommand.java:286）
 at org.apache.oozie.service.CallableQueueService $ CompositeCallable.call（CallableQueueService.java:321）
 at org.apache.oozie.service.CallableQueueService $ CompositeCallable.call（CallableQueueService.java:250）
 at org.apache.oozie.service.CallableQueueService $ CallableWrapper.run（CallableQueueService.java:175）
。在java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）
在java.util.concurrent.ThreadPoolExecutor中的$ Worker.run（ThreadPoolExecutor.java:615）
在java.lang中。 Thread.run（Thread.java:745）
 2015-07-15 04:54:42发表WARN ActionStartXCommand：523  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow] JOB [ 0000010-150711083342968-oozie-root-W]操作[0000010-150711083342968-oozie-root -W @ mapreduce-52d9]失败的作业失败的作业[mapreduce-52d9] 
 2015-07-15 04:54： 43440 WARNING LiteWorkflowInstance：523  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow] JOB [0000010-150711083342968-oozie-root-W]操作[0000010-150711083342968-oozie-root -W @ mapreduce -52d9]工作流失败。失败节点[mapreduce-52d9] 
 2015-07-15 04:54:43,548 INFO WorkflowNotificationXCommand：520  -  SERVER [myserver] USER [ - ] GROUP [ - ] TOKEN [ - ] APP [ - ] JOB [0000010- 150711083342968-oozie-root-W]操作[0000010-150711083342968-oozie-root-W @ mapreduce-52d9]否定义通知URL。因此没有工作通知0000010-150711083342968-oozie-root-W @ mapreduce-52d9 
 2015-07-15 04:54:43,615 INFO KillXCommand：520  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow]作业[0000010-150711083342968-oozie-root-W] ACTION [] STARTED WorkflowKillXCommand for jobId = 0000010-150711083342968-oozie-root-W 
 2015-07-15 04:54:43,758 INFO CallbackServlet：520  -  SERVER [myserver] USER [ - ] GROUP [ - ] TOKEN [ - ] APP [ - ] JOB [0000010-150711083342968-oozie-root-W]操作[0000010-150711083342968-oozie-root -W @ mapreduce -52d9] callback for action [0000010-150711083342968-oozie-root -W @ mapreduce-52d9] 
 2015-07-15 04:54:43信息KillXCommand：520  -  SERVER [myserver] USER [root] GROUP [ - ] TOKEN [] APP [My_Workflow] JOB [0000010-150711083342968-oozie-root-W] ACTION [] ENDED WorkflowKillXCommand for jobId = 0000010-150711083342968-oozie-root-W 
 2015-07-15 04:54 ：43,491 INFO WorkflowNotificationXCommand：520  -  SERVER [myserver] USER [ - ] GROUP [ - ] TOKEN [ - ] APP [ - ] JOB [0000010-1507110833429 68-oozie-root-W]操作[]否定义通知URL。因此没有任何通知的工作0000010-150711083342968-oozie-root-W 
 2015-07-15 04:54:43发送ERROR CompletedActionXCommand：517  -  SERVER [myserver] USER [ - ] GROUP [ - ] TOKEN [] APP [ - ] JOB [0000010-150711083342968-oozie-root-W]操作[0000010-150711083342968-oozie-root -W @ mapreduce-52d9] XException，
 org.apache.oozie.command.CommandException：E0800：Action它没有在[FAILED]状态下运行，action [0000010-150711083342968-oozie-root -W @ mapreduce-52d9] 
 at org.apache.oozie.command.wf.CompletedActionXCommand.eagerVerifyPrecondition（CompletedActionXCommand.java： 92）$在org.apache.oozie.command.XCommand.call（XCommand.java:257 b $ b）中在org.apache.oozie.service.CallableQueueService $ CallableWrapper.run 
（CallableQueueService.java:175）在java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）
 
。在java.util.concurrent.ThreadPoolExecutor中的$ Worker.run（ThreadPoolExecutor.java:615）
是java .lang.Thread.run（Thread.java:745） 
 2015年7月15日04：54：43803 WARN CallableQueueService $ CallableWrapper：523  -  SERVER [MYSERVER] USER [ - ]集团[ - ]标记[] APP [ - ]作业[0000010-150711083342968-Oozie的 - 根 - W]动作[0000010-150711083342968-oozie-root -W @ mapreduce-52d9]异常可调用[回调]，E0800：动作没有以[FAILED]状态运行，动作[0000010-150711083342968-oozie-root-W @ mapreduce-52d9] 
 org.apache.oozie.command.CommandException：E0800：动作未在[FAILED]状态下运行，动作[0000010-150711083342968-oozie-root-W @ mapreduce-52d9] 
 at org.apache.oozie.command.wf.CompletedActionXCommand.eagerVerifyPrecondition（CompletedActionXCommand.java:92）
 at org.apache.oozie.command.XCommand.call（XCommand.java:257）
在org.apache.oozie.service.CallableQueueService $ CallableWrapper.run（CallableQueueService.java:175）
在java.util.concurrent.ThreadPoolExecutor.runWorker（ThreadPoolExecutor.java:1145）$ b $在java.util .concurrent.ThreadPoolExecutor $ Worker.run（Threa 
 at java.lang.Thread.run（Thread.java:745）
  

=h2_lin>解决方案

我刚刚解决了完全相同的问题。 Oozie默认运行这个工作为mapreduce。在我的情况下，Oozie无法到达hdfs目录/用户/历史记录/ done_intermediate / hdfs，并失败。

所以，我敢打赌你已经登录为其他登录。切换到映射登录，或添加行

  user.name = mapred 
  

到job.properties，如果您想从命令行调用Oozie。

How can I solve this problem when I submit a mapreduce job in Oozie Editor in Hue? :

JA017: Could not lookup launched hadoop Job ID [job_local152843681_0009] which was associated with action [0000009-150711083342968-oozie-root-W@mapreduce-f660]. Failing this action!

UPDATE:

Here are log file:
2015-07-15 04:54:40,304  INFO ActionStartXCommand:520 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@:start:] Start action [0000010-150711083342968-oozie-root-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-07-15 04:54:40,321  INFO ActionStartXCommand:520 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@:start:] [***0000010-150711083342968-oozie-root-W@:start:***]Action status=DONE
2015-07-15 04:54:40,325  INFO ActionStartXCommand:520 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@:start:] [***0000010-150711083342968-oozie-root-W@:start:***]Action updated in DB!
2015-07-15 04:54:40,501  INFO WorkflowNotificationXCommand:520 - SERVER[myserver] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@:start:] No Notification URL is defined. Therefore nothing to notify for job 0000010-150711083342968-oozie-root-W@:start:
2015-07-15 04:54:40,502  INFO WorkflowNotificationXCommand:520 - SERVER[myserver] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000010-150711083342968-oozie-root-W
2015-07-15 04:54:40,713  INFO ActionStartXCommand:520 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] Start action [0000010-150711083342968-oozie-root-W@mapreduce-52d9] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10]
2015-07-15 04:54:43,216  WARN MapReduceActionExecutor:523 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] Exception in check(). Message[JA017: Could not lookup launched hadoop Job ID [job_local1099179300_0010] which was associated with  action [0000010-150711083342968-oozie-root-W@mapreduce-52d9].  Failing this action!]
org.apache.oozie.action.ActionExecutorException: JA017: Could not lookup launched hadoop Job ID [job_local1099179300_0010] which was associated with  action [0000010-150711083342968-oozie-root-W@mapreduce-52d9].  Failing this action!
    at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1359)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1288)
    at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:250)
    at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
    at org.apache.oozie.command.XCommand.call(XCommand.java:286)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
2015-07-15 04:54:43,230  WARN ActionStartXCommand:523 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] Error starting action [mapreduce-52d9]. ErrorType [FAILED], ErrorCode [JA017], Message [JA017: Could not lookup launched hadoop Job ID [job_local1099179300_0010] which was associated with  action [0000010-150711083342968-oozie-root-W@mapreduce-52d9].  Failing this action!]
org.apache.oozie.action.ActionExecutorException: JA017: Could not lookup launched hadoop Job ID [job_local1099179300_0010] which was associated with  action [0000010-150711083342968-oozie-root-W@mapreduce-52d9].  Failing this action!
    at org.apache.oozie.action.hadoop.JavaActionExecutor.check(JavaActionExecutor.java:1359)
    at org.apache.oozie.action.hadoop.JavaActionExecutor.start(JavaActionExecutor.java:1288)
    at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:250)
    at org.apache.oozie.command.wf.ActionStartXCommand.execute(ActionStartXCommand.java:64)
    at org.apache.oozie.command.XCommand.call(XCommand.java:286)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:321)
    at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:250)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
2015-07-15 04:54:43,234  WARN ActionStartXCommand:523 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] Failing Job due to failed action [mapreduce-52d9]
2015-07-15 04:54:43,247  WARN LiteWorkflowInstance:523 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] Workflow Failed. Failing node [mapreduce-52d9]
2015-07-15 04:54:43,548  INFO WorkflowNotificationXCommand:520 - SERVER[myserver] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] No Notification URL is defined. Therefore nothing to notify for job 0000010-150711083342968-oozie-root-W@mapreduce-52d9
2015-07-15 04:54:43,615  INFO KillXCommand:520 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[] STARTED WorkflowKillXCommand for jobId=0000010-150711083342968-oozie-root-W
2015-07-15 04:54:43,758  INFO CallbackServlet:520 - SERVER[myserver] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] callback for action [0000010-150711083342968-oozie-root-W@mapreduce-52d9]
2015-07-15 04:54:43,782  INFO KillXCommand:520 - SERVER[myserver] USER[root] GROUP[-] TOKEN[] APP[My_Workflow] JOB[0000010-150711083342968-oozie-root-W] ACTION[] ENDED WorkflowKillXCommand for jobId=0000010-150711083342968-oozie-root-W
2015-07-15 04:54:43,791  INFO WorkflowNotificationXCommand:520 - SERVER[myserver] USER[-] GROUP[-] TOKEN[-] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[] No Notification URL is defined. Therefore nothing to notify for job 0000010-150711083342968-oozie-root-W
2015-07-15 04:54:43,789 ERROR CompletedActionXCommand:517 - SERVER[myserver] USER[-] GROUP[-] TOKEN[] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] XException, 
org.apache.oozie.command.CommandException: E0800: Action it is not running its in [FAILED] state, action [0000010-150711083342968-oozie-root-W@mapreduce-52d9]
    at org.apache.oozie.command.wf.CompletedActionXCommand.eagerVerifyPrecondition(CompletedActionXCommand.java:92)
    at org.apache.oozie.command.XCommand.call(XCommand.java:257)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)
2015-07-15 04:54:43,803  WARN CallableQueueService$CallableWrapper:523 - SERVER[myserver] USER[-] GROUP[-] TOKEN[] APP[-] JOB[0000010-150711083342968-oozie-root-W] ACTION[0000010-150711083342968-oozie-root-W@mapreduce-52d9] exception callable [callback], E0800: Action it is not running its in [FAILED] state, action [0000010-150711083342968-oozie-root-W@mapreduce-52d9]
org.apache.oozie.command.CommandException: E0800: Action it is not running its in [FAILED] state, action [0000010-150711083342968-oozie-root-W@mapreduce-52d9]
    at org.apache.oozie.command.wf.CompletedActionXCommand.eagerVerifyPrecondition(CompletedActionXCommand.java:92)
    at org.apache.oozie.command.XCommand.call(XCommand.java:257)
    at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:745)

解决方案

I just solved the exactly same issue. Oozie runs the job by default as "mapreduce". In my case, Oozie couldn't reach hdfs directory /user/history/done_intermediate/hdfs and failed.

So, I bet you were logged as some other login. Switch to mapred login, or add line with

user.name=mapred

to job.properties if you want to call Oozie from command line.

这篇关于JA017：无法查找已启动的hadoop作业ID的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！