没有Hadoop的实木复合地板? [英] Parquet without Hadoop?
问题描述
我想在我的一个项目中使用镶木地板作为柱状存储.但我不想依靠hadoop/hdfs库.是否可以在hdfs之外使用镶木地板?或最小依赖性是什么?
I want to use parquet in one of my projects as columnar storage. But i dont want to depends on hadoop/hdfs libs. Is it possible to use parquet outside of hdfs? Or What is the min dependency?
推荐答案
研究相同的问题,我发现目前暂时不可能. 我发现了这个 git问题,该提议提出了从hadoop api解耦木地板的方法.显然它还没有完成.
Investigating the same question I found that apparently it's not possible for the moment. I found this git issue, which proposes decoupling parquet from the hadoop api. Apparently it has not been done yet.
在Apache Jira中,我发现了一个问题,该问题要求在hadoop之外读取实木复合地板文件的方法.在撰写本文时尚未解决.
In the Apache Jira I found an issue, which asks for a way to read a parquet file outside hadoop. It is unresolved by the time of writing.
不再在github上跟踪问题(上面的第一个链接已消失).我发现的一个新问题位于 apache的Jira 中,标题如下:
Issues are not tracked on github anymore (first link above is dead). A newer issue I found is located on apache's Jira with the following headline:
使用Java轻松读取和写入镶木地板文件而无需依赖hadoop
make it easy to read and write parquet files in java without depending on hadoop
这篇关于没有Hadoop的实木复合地板?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!