DynamoDB的InputFormat Hadoop的 [英] DynamoDB InputFormat for Hadoop

问题描述

我要处理的是使用Hadoop的Map Reduce坚持在亚马逊迪纳摩DB一些数据。

我在寻找互联网上Hadoop的的InputFormat迪纳摩DB和找不到它。我不熟悉的迪纳摩DB所以我猜测有一定的技巧与DynamoDB和Hadoop？如果有任何地方执行这一输入格式的请你分享呢？

解决方案

很多搜索，我发现DynamoDBInputFormat和DynamoDBOutputFormat在亚马逊的图书馆之一后。

在亚马逊弹性的Map Reduce有图书馆称为蜂房bigbird处理程序，其中包含的输入和输出格式dynamoDB。 完整的类名是：org.apache.hadoop.hive.dynamodb.write.DynamoDBOutputFormat和org.apache.hadoop.hive.dynamodb.read.DynamoDBInputFormat

我希望这些类将是有益的社区。

I have to process some data which is persisted in Amazon Dynamo DB using Hadoop map reduce.

I was searching over internet for Hadoop InputFormat for Dynamo DB and couldn't find it. I'm not familiar with Dynamo DB so I'm guessing there is some trick related to DynamoDB and Hadoop? If there is anywhere implementation of this Input Format could you please share it?

解决方案

After a lot of searching I found DynamoDBInputFormat and DynamoDBOutputFormat in one of Amazon's libraries.

On amazon elastic map reduce there is library called hive-bigbird-handler which contains input and output format for dynamoDB. Full class names are: org.apache.hadoop.hive.dynamodb.write.DynamoDBOutputFormat and org.apache.hadoop.hive.dynamodb.read.DynamoDBInputFormat

I hope these classes will be useful to community.

这篇关于DynamoDB的InputFormat Hadoop的的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！