Hive tez 执行错误 [英] Hive tez execution error

问题描述

我正在运行 hive 查询，并且在设置 hive.execution.engine=tez 时出现以下错误，而查询在 engine=MR 下工作.

I am running a hive query and I got the following error when setting the hive.execution.engine=tez, while the query is working under engine=MR.

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.tez.TezTask

我的查询是内连接，数据量很大.

My query is an inner join and the data is quite big.

另外一件事是我以前遇到过这个问题.但是 tez 后来起作用，所以我认为这是关于 hive 的一些不稳定的东西.

Another thing is that I have met this problem before. But tez works later so I thought it was about something unstable about hive.

推荐答案

通过 hive 运行您的 HQL 时包括以下参数.这将为您提供详细的日志，您可以轻松确定根本原因.

While running your HQL via hive include following parameter. This will give you detailed logs and you can determine the root cause easily.

-hiveconf hive.root.logger=DEBUG,console

我遇到了类似的问题，上面的财产帮了我很大的忙.

I faced similar problem and above property help me big time.

例如:我收到以下消息

16/04/14 10:29:26 ERROR exec.Task: Failed to execute tez graph.
org.apache.tez.dag.api.TezException: org.apache.hadoop.yarn.exceptions.InvalidResourceRequestException: Invalid resource request, requested memory < 0, or requested memory > max configured, requestedMemory=20480, maxMemory=11288

当我将设置更改为 11288 时，我的查询顺利进行.

When I changed my setting to 11288, my query went through fine.

这篇关于Hive tez 执行错误的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！