挂载HDFS目录 [英] Mounting HDFS directory

问题描述

我可以将HDFS目录（在Ubuntu中配置）装载到Windows服务器中的驱动器中吗？

映射后，例如H：\ ---> \home\user1\HDFSCreatedDir，想要使用普通Java读取，写入和移动/复制文件IO包API的。

解决方案

是的，HDFS目录可以安装在Windows和Linux中。您可以使用以下工具之一：

• contrib / fuse-dfs建立在保险丝，C胶水，libhdfs和hadoop- dev.jar


• fuse-j-hdfs建立在用于java的保险丝，熔丝以及hadoop-dev.jar上。


• hdfs-fuse - google代码项目与contrib / fuse-dfs非常相似


• webdav - hdfs作为webdav资源公开


• mapR - 包含一个封闭源代码hdfs兼容的文件系统，支持读取/写入NFS访问


• HDFS NFS代理 - 在不使用保险丝的情况下将HDFS导出为NFS。支持Kerberos并重新排序写入，以便顺序写入hdfs。


• native-hdfs-fuse - 支持随机写入的C中的FUSE实现
  尽管不完整的文件系统实现（FUSE或其他），在构建一个


• hadoofus时，以下项目可能非常有用 - 在hadoop 0.20.203到1.0.3中为C中的libhdfs API实现

Can I mount HDFS directory (configured in Ubuntu) to a drive in Windows server ?

After mapping e.g H:\ ---> \home\user1\HDFSCreatedDir , would like to read, write and move/copy files using normal Java IO package API's.

解决方案

Yes, HDFS directory can be mounted in Windows and Linux. You can use one of the tools below:

• contrib/fuse-dfs is built on fuse, some C glue, libhdfs and the hadoop-dev.jar
• fuse-j-hdfs is built on fuse, fuse for java, and the hadoop-dev.jar
• hdfs-fuse - a google code project is very similar to contrib/fuse-dfs
• webdav - hdfs exposed as a webdav resource
• mapR - contains a closed source hdfs compatible file system that supports read/write NFS access
• HDFS NFS Proxy - exports HDFS as NFS without use of fuse. Supports Kerberos and re-orders writes so they are written to hdfs sequentially.
• native-hdfs-fuse - a FUSE implementation in C that supports random writes While not complete filesystem implementations (FUSE or otherwise), the following projects could be useful when building one
• hadoofus - an implementation of the libhdfs API in C for hadoop 0.20.203 to 1.0.3

这篇关于挂载HDFS目录的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！