Flume和Sqoop有什么区别? [英] What's the difference between Flume and Sqoop?

查看:1010
本文介绍了Flume和Sqoop有什么区别?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

Flume和Sqoop都是用于数据移动的,那么他们之间有什么不同?在什么情况下,我应该使用Flume或Sqoop?

http://flume.apache.org/


Flume是一个分布式,可靠且可用的服务,用于
有效地收集,汇总和移动大量的log b $ b数据。

Flume有助于从多种渠道,如日志,jms,目录等。
多渠道代理可配置为收集大量数据。

它横向扩展。



http://sqoop.apache.org/



< blockquote>

Apache Sqoop(TM)是一款专为在Apache Hadoop和结构化数据存储库(如
关系数据库)之间高效传输批量
数据而设计的工具。


Sqoop有助于在hadoop和其他数据库之间移动数据,并且可以传输数据并行表现。

Both Flume and Sqoop are meant for data movement, then what is the difference between them? Under what condition should I use Flume or Sqoop?

解决方案

From http://flume.apache.org/

Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data.

Flume helps to collect data from a variety of sources, like logs, jms, Directory etc.
Multiple flume agents can be configured to collect high volume of data.
It scales horizontally.

From http://sqoop.apache.org/

Apache Sqoop(TM) is a tool designed for efficiently transferring bulk data between Apache Hadoop and structured datastores such as relational databases.

Sqoop helps to move data between hadoop and other databases and it can transfer data in parallel for performance.

这篇关于Flume和Sqoop有什么区别?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆