所有查询的Hive错误:无法找到与操作句柄关联的日志 [英] Hive error on all queries: Couldn't find log associated with operation handle

查看:3803
本文介绍了所有查询的Hive错误:无法找到与操作句柄关联的日志的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

在Hadoop上运行的所有配置单元查询中发生错误。

Getting an error on all hive queries running on Hadoop.

只需从存在的表中运行select语句并获得以下结果:

Simply running a select statement from a table that exists and getting the following results:

Fetching results ran into the following error(s):

Couldn't find log associated with operation handle: 
OperationHandle[opType=EXECUTE_STATEMENT,
getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]

查询的相关日志包括:
$ b

And the accompaning logs for the query are:


请求状态不正确TFetchResultsReq(fetchType = 1,
operationHandle = TOperationHandle(hasResultSet = False,
modifiedRowCount = None,operationType = 0,
operationId = THandleIdentifier(secret ='%\x1d\x0f\x11\xce\xf4B\xd6\xb8\xb5\x8ddv\xceKV',
guid =\xbc5\xd9 | \xfa\x13J'\x86\x8e4\xb3\x87\xa0\xf4\x05)),
orientation = 4,maxRows = -1):
TFetchResultsResp(status = TStatus(errorCod e = 0,errorMessage =不能
查找与操作句柄关联的日志:OperationHandle
[opType = EXECUTE_STATEMENT,
getHandleIdentifier()= bc35d97c-fa13-4a27-868e-34b387a0f405] ,
sqlState = None,
infoMessages = [* org.apache.hive.service.cli.HiveSQLException:不能
查找与操作句柄关联的日志:OperationHandle
[ opType = EXECUTE_STATEMENT,
getHandleIdentifier()= bc35d97c-fa13-4a27-868e-34b387a0f405]:25:24,
'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager .java:257',
'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656',
'sun.reflect.GeneratedMethodAccessor29:invoke :: - 1 ',
'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43',
'java.lang.reflect.Method:invoke:Method.java:606',
'org .apache.hive.service.cli.session.HiveSessionProxy:调用:HiveSessio nProxy.java:79',
'org.apache.hive.service.cli.session.HiveSessionProxy:access $ 000:HiveSessionProxy.java:37',
'org.apache.hive.service.cli .session.HiveSessionProxy $ 1:run:HiveSessionProxy.java:64',
'java.security.AccessController:doPrivileged:AccessController.java:-2',
'javax.security.auth.Subject:doAs :Subject.java:415',
'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1628',
'org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs :HadoopShimsSecure.java:536',
'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:60',
'com.sun.proxy。$ Proxy28: fetchResults :: - 1',
'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427',
'org.apache.hive.service.cli.thrift。 ThriftCLIService:FetchResults:ThriftCLIService.java:587',
'org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIServ ice.java:1553',
'org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1538',
'org.apache.thrift。 ProcessFunction:process:ProcessFunction.java:39',
'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39',
'org.apache.hive.service.auth.TSetIpAddressProcessor: process:TSetIpAddressProcessor.java:56',
'org.apache.thrift.server.TThreadPoolServer $ WorkerProcess:run:TThreadPoolServer.java:206',
'java.util.concurrent.ThreadPoolExecutor:runWorker: ThreadPoolExecutor.java:1145',
'java.util.concurrent.ThreadPoolExecutor $ Worker:run:ThreadPoolExecutor.java:615',
'java.lang.Thread:run:Thread.java:744' (fetchType = 1,
operationHandle = TOperationHandle(hasResultSet = False,
modifiedRowCount = None,operationType),statusCode = 3),results = None,
hasMoreRows = None) = 0,
operationId = THandleIdentifier(secret ='c \\ xdf \xfe\xb7\x8a\x10D\xea\xbaD\x93} B\xb5\xc3\xe7',
guid ='& = \xf9\\ \\ xc3 \xc0vEO\xa0%#\xf5\xb9\x19\xe9W')),orientation = 0,
maxRows = -1):TFetchResultsResp(status = TStatus(errorCode = 0,
errorMessage =无法找到与操作句柄关联的日志:
OperationHandle [opType = EXECUTE_STATEMENT,
getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957],
sqlState = None,
infoMessages = [* org.apache.hive.service.cli.HiveSQLException:不能
查找与操作句柄关联的日志:OperationHandle
[opType = EXECUTE_STATEMENT,
getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957]:25:24,
'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257 ',
'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656',
'sun.r eflect.GeneratedMethodAccessor29:invoke :: - 1',
'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43',
'java.lang.reflect.Method:invoke:Method.java: 606',
'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:79',
'org.apache.hive.service.cli.session.HiveSessionProxy:访问$ 000:HiveSessionProxy.java:37',
'org.apache.hive.service.cli.session.HiveSessionProxy $ 1:run:HiveSessionProxy.java:64',
'java.security.AccessController: doPrivileged:AccessController.java:-2',
'javax.security.auth.Subject:doAs:Subject.java:415',
'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation .java:1628',
'org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536',
'org.apache.hive.service.cli.session.HiveSessionProxy :invoke:HiveSessionProxy.java:60',
'com.sun.proxy。$ Proxy28:fetchResults :: - 1',
'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427',
'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java :587',
'org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1553',
'org.apache.hive.service.cli .thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1538',
'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39',
'org.apache.thrift .TBaseProcessor:process:TBaseProcessor.java:39',
'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56',
'org.apache.thrift.server .TThreadPoolServer $ WorkerProcess:run:TThreadPoolServer.java:206',
'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145',
'java.util.concurrent.ThreadPoolExecutor $ Worker :run:ThreadPoolExecutor.java:615',
'java.lang.Thread :run:Thread.java:744'],statusCode = 3),results = None,
hasMoreRows = None)请求TFetchResultsReq的错误状态(fetchType = 1,
operationHandle = TOperationHandle(hasResultSet = False,
modifiedRowCount = None,operationType = 0,
operationId = THandleIdentifier(secret ='c\xdf\xfe\xb7\x8a\x10D\xea\xbaD\x93} B \xb5\xc3\xe7',
guid ='& = \xf9\xc3\xc0vEO\xa0%#\xf5\xb9\x19\xe9W')) ,orientation = 0,
maxRows = -1):TFetchResultsResp(status = TStatus(errorCode = 0,
errorMessage =找不到与操作句柄关联的日志:
OperationHandle [opType = EXECUTE_STATEMENT,
getHandleIdentifier()= 263df9c3-c076-454f-a025-23f5b919e957],
sqlState = None,
infoMessages = [* org.apache.hive.service.cli.HiveSQLException :
找不到与操作句柄关联的日志:OperationHandle
[opType = EXECUTE_STATEMENT,
getHandleIdenti fier()= 263df9c3-c076-454f-a025-23f5b919e957]:25:24,
'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257',
'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656',
'sun.reflect.GeneratedMethodAccessor29:invoke :: - 1',
'sun调用:DelegateMethodAccessorImpl.java:43',
'java.lang.reflect.Method:invoke:Method.java:606',
'org.apache.hive.service.cli .session.HiveSessionProxy:invoke:HiveSessionProxy.java:79',
'org.apache.hive.service.cli.session.HiveSessionProxy:access $ 000:HiveSessionProxy.java:37',
'org。 apache.hive.service.cli.session.HiveSessionProxy $ 1:run:HiveSessionProxy.java:64',
'java.security.AccessController:doPrivileged:AccessController.java:-2',
'javax。 security.auth.Subject:doAs:Subject.java:415',
'org.apache.hadoop.security.UserGroupInformati on:doAs:UserGroupInformation.java:1628',
'org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536',
'org.apache.hive.service。 cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:60',
'com.sun.proxy。$ Proxy28:fetchResults :: - 1',
'org.apache.hive.service.cli .CLIService:fetchResults:CLIService.java:427',
'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587',
'org.apache.hive .service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java:1553',
'org.apache.hive.service.cli.thrift.TCLIService $ Processor $ FetchResults:getResult:TCLIService.java :1538',
'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39',
'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39',
'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56',
'org.apache.thri ft.server.TThreadPoolServer $ WorkerProcess:run:TThreadPoolServer.java:206',
'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145',
'java.util.concurrent。 ThreadPoolExecutor $ Worker:run:ThreadPoolExecutor.java:615',
'java.lang.Thread:run:Thread.java:744'],statusCode = 3),results = None,
hasMoreRows = None )

Bad status for request TFetchResultsReq(fetchType=1, operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='%\x1d\x0f\x11\xce\xf4B\xd6\xb8\xb5\x8ddv\xceKV', guid="\xbc5\xd9|\xfa\x13J'\x86\x8e4\xb3\x87\xa0\xf4\x05")), orientation=4, maxRows=-1): TFetchResultsResp(status=TStatus(errorCode=0, errorMessage="Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=bc35d97c-fa13-4a27-868e-34b387a0f405]", sqlState=None, infoMessages=["*org.apache.hive.service.cli.HiveSQLException:Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=bc35d97c-fa13-4a27-868e-34b387a0f405]:25:24", 'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257', 'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656', 'sun.reflect.GeneratedMethodAccessor29:invoke::-1', 'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43', 'java.lang.reflect.Method:invoke:Method.java:606', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:79', 'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:37', 'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:64', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:415', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1628', 'org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:60', 'com.sun.proxy.$Proxy28:fetchResults::-1', 'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427', 'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1553', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1538', 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56', 'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:206', 'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145', 'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:615', 'java.lang.Thread:run:Thread.java:744'], statusCode=3), results=None, hasMoreRows=None) Bad status for request TFetchResultsReq(fetchType=1, operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='c\xdf\xfe\xb7\x8a\x10D\xea\xbaD\x93}B\xb5\xc3\xe7', guid='&=\xf9\xc3\xc0vEO\xa0%#\xf5\xb9\x19\xe9W')), orientation=0, maxRows=-1): TFetchResultsResp(status=TStatus(errorCode=0, errorMessage="Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]", sqlState=None, infoMessages=["*org.apache.hive.service.cli.HiveSQLException:Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]:25:24", 'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257', 'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656', 'sun.reflect.GeneratedMethodAccessor29:invoke::-1', 'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43', 'java.lang.reflect.Method:invoke:Method.java:606', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:79', 'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:37', 'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:64', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:415', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1628', 'org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:60', 'com.sun.proxy.$Proxy28:fetchResults::-1', 'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427', 'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1553', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1538', 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56', 'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:206', 'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145', 'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:615', 'java.lang.Thread:run:Thread.java:744'], statusCode=3), results=None, hasMoreRows=None) Bad status for request TFetchResultsReq(fetchType=1, operationHandle=TOperationHandle(hasResultSet=False, modifiedRowCount=None, operationType=0, operationId=THandleIdentifier(secret='c\xdf\xfe\xb7\x8a\x10D\xea\xbaD\x93}B\xb5\xc3\xe7', guid='&=\xf9\xc3\xc0vEO\xa0%#\xf5\xb9\x19\xe9W')), orientation=0, maxRows=-1): TFetchResultsResp(status=TStatus(errorCode=0, errorMessage="Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]", sqlState=None, infoMessages=["*org.apache.hive.service.cli.HiveSQLException:Couldn't find log associated with operation handle: OperationHandle [opType=EXECUTE_STATEMENT, getHandleIdentifier()=263df9c3-c076-454f-a025-23f5b919e957]:25:24", 'org.apache.hive.service.cli.operation.OperationManager:getOperationLogRowSet:OperationManager.java:257', 'org.apache.hive.service.cli.session.HiveSessionImpl:fetchResults:HiveSessionImpl.java:656', 'sun.reflect.GeneratedMethodAccessor29:invoke::-1', 'sun.reflect.DelegatingMethodAccessorImpl:invoke:DelegatingMethodAccessorImpl.java:43', 'java.lang.reflect.Method:invoke:Method.java:606', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:79', 'org.apache.hive.service.cli.session.HiveSessionProxy:access$000:HiveSessionProxy.java:37', 'org.apache.hive.service.cli.session.HiveSessionProxy$1:run:HiveSessionProxy.java:64', 'java.security.AccessController:doPrivileged:AccessController.java:-2', 'javax.security.auth.Subject:doAs:Subject.java:415', 'org.apache.hadoop.security.UserGroupInformation:doAs:UserGroupInformation.java:1628', 'org.apache.hadoop.hive.shims.HadoopShimsSecure:doAs:HadoopShimsSecure.java:536', 'org.apache.hive.service.cli.session.HiveSessionProxy:invoke:HiveSessionProxy.java:60', 'com.sun.proxy.$Proxy28:fetchResults::-1', 'org.apache.hive.service.cli.CLIService:fetchResults:CLIService.java:427', 'org.apache.hive.service.cli.thrift.ThriftCLIService:FetchResults:ThriftCLIService.java:587', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1553', 'org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults:getResult:TCLIService.java:1538', 'org.apache.thrift.ProcessFunction:process:ProcessFunction.java:39', 'org.apache.thrift.TBaseProcessor:process:TBaseProcessor.java:39', 'org.apache.hive.service.auth.TSetIpAddressProcessor:process:TSetIpAddressProcessor.java:56', 'org.apache.thrift.server.TThreadPoolServer$WorkerProcess:run:TThreadPoolServer.java:206', 'java.util.concurrent.ThreadPoolExecutor:runWorker:ThreadPoolExecutor.java:1145', 'java.util.concurrent.ThreadPoolExecutor$Worker:run:ThreadPoolExecutor.java:615', 'java.lang.Thread:run:Thread.java:744'], statusCode=3), results=None, hasMoreRows=None)


推荐答案

这个错误可能发生在 ie(hive.server2。 logging.operation.log.location)指向一个不存在的位置来写日志。

This error can happen with the i.e("hive.server2.logging.operation.log.location") is pointing to a location that does not exist to write logs.

查看 OperationManager中的代码.java

OperationLog operationLog = getOperation(opHandle).getOperationLog();
if (operationLog == null) {
  throw new HiveSQLException("Couldn't find log associated with operation handle: " + opHandle);
}

这篇关于所有查询的Hive错误:无法找到与操作句柄关联的日志的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆