Hadoop：生成SequenceFile的示例过程，包含要在map / reduce中处理的图像二进制文件 [英] Hadoop: Example process to generating a SequenceFile with image binaries to be processed in map/reduce

问题描述

遵循 Hadoop：如何访问（许多）要通过map / reduce？处理的照片图像问题，其中 orangeoctopus 提供了一个合理的方向来加载图像二进制文件并将它们收集到 SequenceFiles 中以提供映射器。

认为这可能对其他人有用，作为本地java进程或者在大量图像文件的情况下可能是hadoop作业，我创建了这个单独的问题来查看为实现的例子。

/shop.oreilly.com/product/0636920010388.dorel =nofollow> Hadoop：权威指南 - 第4章有一些读取/写入序列文件的示例。以下是相同的代码。浏览代码并将其更改为二进制图像作为序列文件的输入。

Following Hadoop: how to access (many) photo images to be processed by map/reduce? question, where orangeoctopus provides a reasonable direction to load the image binaries and collect them into SequenceFiles to feed the mapper.

Think this could be useful for the others also, as a local java process or probably a hadoop job in case of vast amount image files, I created this separate question to look for the example for the implementation.

Thanks!

解决方案

Hadoop: The Definitive Guide - Chapter 4 has some samples for reading/writing sequence files. Here is the code for the same. Go through the code and change it for the binary images as input for the sequence file.

这篇关于Hadoop：生成SequenceFile的示例过程，包含要在map / reduce中处理的图像二进制文件的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！