我如何在Java中对Hive进行异步调用？ [英] How do I make an async call to Hive in Java?

问题描述

我想以异步方式在服务器上执行Hive查询。 Hive查询可能需要很长时间才能完成，因此我不希望阻止该呼叫。我目前使用Thirft进行阻塞调用（在client.execute（）上的阻塞），但我还没有看到如何进行非阻塞调用的示例。这里是阻止代码：

  TSocket transport = new TSocket（hive.example.com，10000）; 
 transport.setTimeout（999999999）; 
 TBinaryProtocol protocol = new TBinaryProtocol（transport）; 
客户端客户端=新ThriftHive.Client（协议）; 
 transport.open（）; 
 client.execute（hql）; //省略HQL 
 
 List< String>行; $（行= client.fetchN（1000））！= null）{
（字符串行：rows）{
 //做行的元素
} 
} 
 
 transport.close（）; 
  

上面的代码缺少try / catch块来保持简短。

有人有任何想法如何做一个异步调用？ Hive / Thrift可以支持它吗？有没有更好的方法？

谢谢！ 解决方案

到Hive邮件列表，Hive不支持使用Thirft的异步调用。

I would like to execute a Hive query on the server in an asynchronous manner. The Hive query will likely take a long time to complete, so I would prefer not to block on the call. I am currently using Thirft to make a blocking call (blocks on client.execute()), but I have not seen an example of how to make a non-blocking call. Here is the blocking code:

        TSocket transport = new TSocket("hive.example.com", 10000);
        transport.setTimeout(999999999);
        TBinaryProtocol protocol = new TBinaryProtocol(transport);
        Client client = new ThriftHive.Client(protocol);
        transport.open();
        client.execute(hql);  // Omitted HQL

        List<String> rows;
        while ((rows = client.fetchN(1000)) != null) {
            for (String row : rows) {
                // Do stuff with row
            }
        }

        transport.close();

The code above is missing try/catch blocks to keep it short.

Does anyone have any ideas how to do an async call? Can Hive/Thrift support it? Is there a better way?

Thanks!

解决方案

After talking to the Hive mailing list, Hive does not support async calls using Thirft.

这篇关于我如何在Java中对Hive进行异步调用？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！