为什么我在Tez工作中得到的分配映射器为负数?顶点失败? [英] Why am I getting negative allocated mappers in Tez job? Vertex failure?

问题描述

我正在尝试使用此处中记录的PhoenixStorageHandler，并在其中填充在beeline shell中执行以下查询:

I'm trying to use the PhoenixStorageHandler as documented here, and populate it with the following query in beeline shell:

insert into table pheonix_table select * from hive_table;

在Tez会话中，我得到了映射器的以下细分:

I get the following breakdown of the mappers in the Tez session:

...
INFO  : Map 1: 0(+50)/50 
INFO  : Map 1: 0(+50)/50 
INFO  : Map 1: 0(+50,-2)/50 
INFO  : Map 1: 0(+50,-3)/50
...

在会话崩溃之前，出现关于顶点失败的非常长的错误消息(422行):

before the session crashes with a very long error message (422 lines) about vertex failure:

错误:处理语句时出错:失败:执行错误， 从org.apache.hadoop.hive.ql.exec.tez.TezTask返回代码2.顶点 失败，vertexName = Map 1，vertexId = vertex_1499857429667_0084_2_00， diagnostics = [任务失败，taskId = task_1499857429667_0084_2_00_000007， 诊断程序= [TaskAttempt 0失败，信息= [错误:运行时失败 任务:java.lang.RuntimeException:java.lang.RuntimeException:地图 操作员初始化失败[.........]顶点由于OWN_TASK_FAILURE而未成功，失败了任务:1 KilledTasks:49，顶点vertex_1499857429667_0084_2_00 [映射1]因以下原因而被杀死/失败:OWN_TASK_FAILURE]由于VERTEX_FAILURE，DAG未成功. failedVertices:1 KilledVertices:0(状态= 08S01，代码= 2)

Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed, vertexName=Map 1, vertexId=vertex_1499857429667_0084_2_00, diagnostics=[Task failed, taskId=task_1499857429667_0084_2_00_000007, diagnostics=[TaskAttempt 0 failed, info=[Error: Failure while running task:java.lang.RuntimeException: java.lang.RuntimeException: Map operator initialization failed [.........] Vertex did not succeed due to OWN_TASK_FAILURE, failedTasks:1 killedTasks:49, Vertex vertex_1499857429667_0084_2_00 [Map 1] killed/failed due to:OWN_TASK_FAILURE]DAG did not succeed due to VERTEX_FAILURE. failedVertices:1 killedVertices:0 (state=08S01,code=2)

此错误指的是什么?为什么会有负映射器"?

What is this error referring to? Why are there 'negative mappers'?

推荐答案

负数表示失败或终止的尝试次数.格式为:

Negative number indicates the number of failed or killed attempts. The format is:

完成(运行，失败或杀死)/总数

您可以在作业跟踪器日志中查看有关某些映射器为何失败的详细信息.

You can see details about why some mapper has failed in job tracker logs.

另请参阅以下答案: https://stackoverflow.com/a/39144600/2700344

这篇关于为什么我在Tez工作中得到的分配映射器为负数?顶点失败?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！