使用Hadoop的经验？ [英] Experience with Hadoop?

问题描述

你们有没有试过Hadoop？无共享体系结构中的分布式文件系统能否使用它？这是有道理的吗？

Have any of you tried Hadoop? Can it be used without the distributed filesystem that goes with it, in a Share-nothing architecture? Would that make sense?

我也对你有任何表现结果感兴趣...

I'm also interested into any performance results you have...

推荐答案

是的，您可以在各个地方使用文件URI而不是hdfs URI来在本地文件系统上使用Hadoop。我认为很多Hadoop的例子都是这样做的。

Yes, you can use Hadoop on a local filesystem by using file URIs instead of hdfs URIs in various places. I think a lot of the examples that come with Hadoop do this.

如果您只想了解Hadoop的工作原理和基本的map-reduce范例，但您需要多台机器和一个分布式文件系统来获得架构固有的可扩展性的真正好处。

This is probably fine if you just want to learn how Hadoop works and the basic map-reduce paradigm, but you will need multiple machines and a distributed filesystem to get the real benefits of the scalability inherent in the architecture.

这篇关于使用Hadoop的经验？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！