在过滤结果HBase时出现OutOfOrderScannerNextException [英] OutOfOrderScannerNextException when filtering results in HBase

查看：2077
本文介绍了在过滤结果HBase时出现OutOfOrderScannerNextException的处理方法，对大家解决问题具有一定的参考价值，需要的朋友们下面随着小编来一起学习吧！

问题描述

  List< Filter> andFilterList = new ArrayList<>（）; 
 SingleColumnValueFilter sourceLowerFilter = new SingleColumnValueFilter（Bytes.toBytes（cf），Bytes.toBytes（source），CompareFilter.CompareOp.GREATER，Bytes.toBytes（lowerLimit））; 
 sourceLowerFilter.setFilterIfMissing（true）; 
 SingleColumnValueFilter sourceUpperFilter = new SingleColumnValueFilter（Bytes.toBytes（cf），Bytes.toBytes（source），CompareFilter.CompareOp.LESS_OR_EQUAL，Bytes.toBytes（upperLimit））; 
 sourceUpperFilter.setFilterIfMissing（true）; 
 SingleColumnValueFilter targetLowerFilter = new SingleColumnValueFilter（Bytes.toBytes（cf），Bytes.toBytes（target），CompareFilter.CompareOp.GREATER，Bytes.toBytes（lowerLimit））; 
 targetLowerFilter.setFilterIfMissing（true）; 
 SingleColumnValueFilter targetUpperFilter = new SingleColumnValueFilter（Bytes.toBytes（cf），Bytes.toBytes（target），CompareFilter.CompareOp.LESS_OR_EQUAL，Bytes.toBytes（upperLimit））; 
 targetUpperFilter.setFilterIfMissing（true）; 
 
 andFilterList.add（sourceUpperFilter）; 
 andFilterList.add（targetUpperFilter）; 
 
 FilterList andFilter = new FilterList（FilterList.Operator.MUST_PASS_ALL，andFilterList）; 
 
列表<过滤器> orFilterList = new ArrayList<>（）; 
 orFilterList.add（sourceLowerFilter）; 
 orFilterList.add（targetLowerFilter）; 
 FilterList orFilter = new FilterList（FilterList.Operator.MUST_PASS_ONE，orFilterList）; 
 
 FilterList fl = new FilterList（FilterList.Operator.MUST_PASS_ALL）; 
 fl.addFilter（andFilter）; 
 fl.addFilter（orFilter）; 
 
扫描edgeScan = new Scan（）; 
 edgeScan.setFilter（fl）; 
 ResultScanner edgeScanner = table.getScanner（edgeScan）; 
结果edgeResult; 
 logger.info（Writing edges ...）; （（edgeResult = edgeScanner.next（））！= null）{
 //某些代码
}

这段代码启动了这个错误： 

  org.apache.hadoop.hbase。 DoNotRetryIOException：在重试OutOfOrderScannerNextException之后失败：是否存在rpc超时？ 
，位于org.deustotech.internet.phd.framework.rdf2subdue.RDF2Subdue.writeFile（RDF2Subdue.java：
，位于org.apache.hadoop.hbase.client.ClientScanner.next（ClientScanner.java:402） 150）
 at org.deustotech.internet.phd.framework.rdf2subdue.RDF2Subdue.run（RDF2Subdue.java:39）
 at org.deustotech.internet.phd.Main.main（Main.java： 32）
 at sun.reflect.NativeMethodAccessorImpl.invoke0（Native Method）
 at sun.reflect.NativeMethodAccessorImpl.invoke（NativeMethodAccessorImpl.java:57）
 at sun.reflect.DelegatingMethodAccessorImpl.invoke DelegatingMethodAccessorImpl.java:43）
 at java.lang.reflect.Method.invoke（Method.java:606）
 at org.codehaus.mojo.exec.ExecJavaMojo $ 1.run（ExecJavaMojo.java:297 ）
在java.lang.Thread.run（Thread.java:745）
引起：org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException：org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException ：预计nextCallSeq：1但下一个CallSeq从客户端：0; request = scanner_id：178 number_of_rows：100 close_scanner：false next_call_seq：0 
在org.apache.hadoop.hbase.regionserver.HRegionServer.scan（HRegionServer.java:3098）
在org.apache.hadoop。 hbase.protobuf.generated.ClientProtos $ ClientService $ 2.callBlockingMethod（ClientProtos.java:29497）
 at org.apache.hadoop.hbase.ipc.RpcServer.call（RpcServer.java:2012）
 at org .apache.hadoop.hbase.ipc.CallRunner.run（CallRunner.java:98）
 at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop（SimpleRpcScheduler.java:168）
 at org .apache.hadoop.hbase.ipc.SimpleRpcScheduler.access $ 000（SimpleRpcScheduler.java:39）
 at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler $ 1.run（SimpleRpcScheduler.java:111）
在Sun.reflect.NativeConstructorAccessorImpl.newInstance0（本地方法）
在sun.reflect.NativeConstructorAccessorImpl.newInstance（NativeConstructorAccessorImpl。 java：57）
a （java.lang.reflect.Constructor.newInstance）（$ Constructor.java:526）
 at org.apache.hadoop.ipc.RemoteException .instantiateException（RemoteException.java:106）
 at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException（RemoteException.java:95）
 at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException （ProtobufUtil.java:285）
 at org.apache.hadoop.hbase.client.ScannerCallable.call（ScannerCallable.java:204）
 at org.apache.hadoop.hbase.client.ScannerCallable.call （ScannerCallable.java:59）
 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries（RpcRetryingCaller.java:114）
 at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries （RpcRetryingCaller.java:90）
在org.apache.hadoop.hbase.client.ClientScanner.next（ClientScanner.java:354）
 ... 9 more 
引起：org。 apache.hadoop .hbase.ipc.RemoteWithExtrasException（org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException）：org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException：期望nextCallSeq：1但是nextCallSeq从客户端获得：0; request = scanner_id：178 number_of_rows：100 close_scanner：false next_call_seq：0 
在org.apache.hadoop.hbase.regionserver.HRegionServer.scan（HRegionServer.java:3098）
在org.apache.hadoop。 hbase.protobuf.generated.ClientProtos $ ClientService $ 2.callBlockingMethod（ClientProtos.java:29497）
 at org.apache.hadoop.hbase.ipc.RpcServer.call（RpcServer.java:2012）
 at org .apache.hadoop.hbase.ipc.CallRunner.run（CallRunner.java:98）
 at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop（SimpleRpcScheduler.java:168）
 at org .apache.hadoop.hbase.ipc.SimpleRpcScheduler.access $ 000（SimpleRpcScheduler.java:39）
 at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler $ 1.run（SimpleRpcScheduler.java:111）
在java.lang.Thread.run（Thread.java:745）
 
在org.apache.hadoop.hbase.ipc.RpcClient.call（RpcClient.java:1453）
在org .apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod（RpcClient.java:1657）
在org.apache.hadoop.h base.ipc.RpcClient $ BlockingRpcChannelImplementation.callBlockingMethod（RpcClient.java:1715）
 at org.apache.hadoop.hbase.protobuf.generated.ClientProtos $ ClientService $ BlockingStub.scan（ClientProtos.java:29900）
 at org.apache.hadoop.hbase.client.ScannerCallable.call（ScannerCallable.java:174）
 ... 13 more

RPC超时设置为600000.我已经尝试删除一些过滤器给出这些结果：




  • sourceUpperFilter&& （sourceLowerFilter || targetLowerFilter） - >成功

  • targetUpperFilter&& （sourceLowerFilter || targetLowerFilter） - >成功

  • （sourceUpperFilter&& targetUpperFilter）&& （sourceLowerFilter） - >失败

  • （sourceUpperFilter&& targetUpperFilter）&& （targetLowerFilter） - >失败



任何帮助，将不胜感激。谢谢。

解决方案

我通过设置 hbase.client.scanner.caching



另请参阅


客户端和RS在扫描期间保留nextCallSeq编号。从客户端到服务器的每个next（）调用都将在双方中增加此数字。客户端将此号码与请求一起传递，并且在RS侧，将传入的nextCallSeq和它的nextCallSeq匹配。在超时的情况下，客户端的增量不应该发生。如果在服务器端抓取下一批数据结束，nextCallSeq号码将会出现不匹配。服务器将抛出OutOfOrderScannerNextException，然后客户端将重新打开扫描仪作为最后一次成功检索行startrow。

由于问题是由客户端超时造成的，那么相应的减少客户端缓存（hbase.client.scanner.caching）的大小或增加rpc的超时时间（hbase.rpc.timeout）即可。



<希望这个答案有帮助。


I am trying to filter results in HBase this way:

List<Filter> andFilterList = new ArrayList<>();
SingleColumnValueFilter sourceLowerFilter = new SingleColumnValueFilter(Bytes.toBytes("cf"), Bytes.toBytes("source"), CompareFilter.CompareOp.GREATER, Bytes.toBytes(lowerLimit));
sourceLowerFilter.setFilterIfMissing(true);
SingleColumnValueFilter sourceUpperFilter = new SingleColumnValueFilter(Bytes.toBytes("cf"), Bytes.toBytes("source"), CompareFilter.CompareOp.LESS_OR_EQUAL, Bytes.toBytes(upperLimit));
sourceUpperFilter.setFilterIfMissing(true);
SingleColumnValueFilter targetLowerFilter = new SingleColumnValueFilter(Bytes.toBytes("cf"), Bytes.toBytes("target"), CompareFilter.CompareOp.GREATER, Bytes.toBytes(lowerLimit));
targetLowerFilter.setFilterIfMissing(true);
SingleColumnValueFilter targetUpperFilter = new SingleColumnValueFilter(Bytes.toBytes("cf"), Bytes.toBytes("target"), CompareFilter.CompareOp.LESS_OR_EQUAL, Bytes.toBytes(upperLimit));
targetUpperFilter.setFilterIfMissing(true);

andFilterList.add(sourceUpperFilter);
andFilterList.add(targetUpperFilter);

FilterList andFilter = new FilterList(FilterList.Operator.MUST_PASS_ALL, andFilterList);

List<Filter> orFilterList = new ArrayList<>();
orFilterList.add(sourceLowerFilter);
orFilterList.add(targetLowerFilter);
FilterList orFilter = new FilterList(FilterList.Operator.MUST_PASS_ONE, orFilterList);

FilterList fl = new FilterList(FilterList.Operator.MUST_PASS_ALL);
fl.addFilter(andFilter);
fl.addFilter(orFilter);

Scan edgeScan = new Scan();
edgeScan.setFilter(fl);
ResultScanner edgeScanner = table.getScanner(edgeScan);
Result edgeResult;
logger.info("Writing edges...");
while ((edgeResult = edgeScanner.next()) != null) {
    // Some code
}

This code launchs this error:

org.apache.hadoop.hbase.DoNotRetryIOException: Failed after retry of OutOfOrderScannerNextException: was there a rpc timeout?
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:402)
    at org.deustotech.internet.phd.framework.rdf2subdue.RDF2Subdue.writeFile(RDF2Subdue.java:150)
    at org.deustotech.internet.phd.framework.rdf2subdue.RDF2Subdue.run(RDF2Subdue.java:39)
    at org.deustotech.internet.phd.Main.main(Main.java:32)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.codehaus.mojo.exec.ExecJavaMojo$1.run(ExecJavaMojo.java:297)
    at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id: 178 number_of_rows: 100 close_scanner: false next_call_seq: 0
    at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3098)
    at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497)
    at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2012)
    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98)
    at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:168)
    at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:39)
    at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:111)
    at java.lang.Thread.run(Thread.java:745)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
    at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
    at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:285)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:204)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:59)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:114)
    at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:90)
    at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:354)
    ... 9 more
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException): org.apache.hadoop.hbase.exceptions.OutOfOrderScannerNextException: Expected nextCallSeq: 1 But the nextCallSeq got from client: 0; request=scanner_id: 178 number_of_rows: 100 close_scanner: false next_call_seq: 0
    at org.apache.hadoop.hbase.regionserver.HRegionServer.scan(HRegionServer.java:3098)
    at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:29497)
    at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2012)
    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:98)
    at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.consumerLoop(SimpleRpcScheduler.java:168)
    at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler.access$000(SimpleRpcScheduler.java:39)
    at org.apache.hadoop.hbase.ipc.SimpleRpcScheduler$1.run(SimpleRpcScheduler.java:111)
    at java.lang.Thread.run(Thread.java:745)

    at org.apache.hadoop.hbase.ipc.RpcClient.call(RpcClient.java:1453)
    at org.apache.hadoop.hbase.ipc.RpcClient.callBlockingMethod(RpcClient.java:1657)
    at org.apache.hadoop.hbase.ipc.RpcClient$BlockingRpcChannelImplementation.callBlockingMethod(RpcClient.java:1715)
    at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:29900)
    at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:174)
    ... 13 more

The RPC timeout is set to 600000. I have tried to remove some filters given these results:

  • sourceUpperFilter && (sourceLowerFilter || targetLowerFilter) --> Success
  • targetUpperFilter && (sourceLowerFilter || targetLowerFilter) --> Success
  • (sourceUpperFilter && targetUpperFilter) && (sourceLowerFilter) --> Fail
  • (sourceUpperFilter && targetUpperFilter) && (targetLowerFilter) --> Fail

Any help would be appreciated. Thank you.

解决方案

I solve this problem by setting hbase.client.scanner.caching

see also

Client and RS maintain a nextCallSeq number during the scan. Every next() call from client to server will increment this number in both sides. Client passes this number along with the request and at RS side both the incoming nextCallSeq and its nextCallSeq will be matched. In case of a timeout this increment at the client side should not happen. If at the server side fetching of next batch of data was over, there will be mismatch in the nextCallSeq number. Server will throw OutOfOrderScannerNextException and then client will reopen the scanner with startrow as the last successfully retrieved row.

Since the problem is caused by the client-side overtime, then the corresponding reduction in client cache (hbase.client.scanner.caching) size or increase rpc timeout time (hbase.rpc.timeout) can be.

Hope this answer helps.

这篇关于在过滤结果HBase时出现OutOfOrderScannerNextException的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！

查看全文
相关文章
Java开发最新文章
热门教程
热门工具
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆