简单的Java Map / Reduce框架 [英] Simple Java Map/Reduce framework

问题描述

有人能指出一个简单的，开源的Map / Reduce框架/ API for Java吗？似乎没有太多证据证明存在这样的事情，但其他人可能知道不同。

Can anyone point me at a simple, open-source Map/Reduce framework/API for Java? There doesn't seem to much evidence of such a thing existing, but someone else might know different.

我能找到的最好的当然是Hadoop MapReduce，但是没有达到简单的标准。我不需要能够运行分布式作业，只需要让我在单核JVM中使用标准Java5风格的并发在多核机器上运行map / reduce-style作业。

The best I can find is, of course, Hadoop MapReduce, but that fails the "simple" criteria. I don't need the ability to run distributed jobs, just something to let me run map/reduce-style jobs on a multi-core machine, in a single JVM, using standard Java5-style concurrency.

写自己并不难，但我宁愿不必这样做。

It's not a hard thing to write oneself, but I'd rather not have to.

推荐答案

我认为值得一提的是，这些问题是Java 8的历史。例如：

I think it is worth mentioning that these problems are history as of Java 8. An example:

int heaviestBlueBlock =
    blocks.filter(b -> b.getColor() == BLUE)
          .map(Block::getWeight)
          .reduce(0, Integer::max);

换句话说：单节点MapReduce在Java 8中可用。

有关详细信息，请参阅 Brian Goetz关于项目lambda的演讲

For more details, see Brian Goetz's presentation about project lambda

这篇关于简单的Java Map / Reduce框架的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！