天鹅座版本/0.6.0不会创建Hive扩展表 [英] Cygnus release/0.6.0 does not create Hive extended tables

问题描述

我正在Fi-Lab虚拟机中运行cygnus实例.我已经从分支版本/0.6.0编译了它.除了未创建用于上下文更新的Hive扩展表以外，其他所有操作均正常.天鹅座成功地从Orion接收了更新，将其转发到Cosmos，并创建了HDFS文件.

I'm running a cygnus instance in a Fi-Lab vm. I've compiled it from branch release/0.6.0. Everything is working except that Hive extended tables for context updates are not created. Cygnus is succesfully receiving updates from Orion, they are forwarded to Cosmos and the HDFS files are created.

天鹅座日志显示Creating Hive external table=...，并且不会引发任何错误.然后，如果登录到cosmos头节点，则可以看到创建的HDFS文件，但是如果使用Hive控制台，则表不存在.

The cygnus log says Creating Hive external table=... and does not raise any error. Then, if I log into the cosmos head node, I can see the HDFS files created, but if I use the Hive console, the tables are not there.

如果我在Hive控制台中键入SHOW TABLES;，我会看到一些以_row和_column结尾的表，因此我猜它对其他人有用.

If I type SHOW TABLES; in the Hive console, I can see some tables that end with _row and _column, so I guess it is working for others.

有任何提示吗?我应该使用其他版本的天鹅座吗?

Any hint? Should I use another version of cygnus?

推荐答案

最后我找到了问题. Flume使用libthrift 0.7，但是天鹅座需要0.9.解决方案在自述文件(在Installing Cygnus and its dependencies (from sources)节的末尾)中，但是我跳过了它.您必须使用0.9版本手动覆盖Flume bin发行版中的jar文件.

Finally I found the problem. Flume is using libthrift 0.7 but cygnus needs 0.9. The solution is in the README (at the end of section Installing Cygnus and its dependencies (from sources)) but I skipped it. You have to manually overwrite the jar file in the Flume bin distribution with the 0.9 version.

这篇关于天鹅座版本/0.6.0不会创建Hive扩展表的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！