由于QuickSight可以直接查询S3,我们什么时候需要使用Athena作为QuickSight的数据源? [英] Since QuickSight can directly query S3, when would we need to use Athena as data source for QuickSight?

查看:111
本文介绍了由于QuickSight可以直接查询S3,我们什么时候需要使用Athena作为QuickSight的数据源?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

可能是我遗漏了一些东西,但是我无法理解如果将Athena与QuickSight连接而不是将QuickSight与S3直接连接会带来什么好处.请帮助我理解这一点.

May be I am missing something but I am not able to understand what benefit I will get if I connect Athena with QuickSight instead of connecting QuickSight directly with S3. Please help me to understand this.

推荐答案

Amazon S3是一种对象存储,旨在存储和检索任意数量的数据.基本上,它具有一些原始数据或非结构化数据(某些文件格式为 .csv .tsv ).

Amazon S3 is an object storage built to store and retrieve any amount of data. Basically, it has some raw data or unstructured data (in certain file format .csv or .tsv).

Amazon Athena使用托管数据目录来存储信息和有关为数据创建的数据库和表的架构存储在Amazon S3中.因此,雅典娜了解数据及其结构(即某种模式).

Amazon Athena uses a managed Data Catalog to store information and schemas about the databases and tables that you create for your data stored in Amazon S3. So, Athena knows about the data and its structure (i.e. some schema) in S3.

此外,QuickSight可以直接连接到Athena数据库并查询数据以进行分析.连接到Athena数据库时,最有可能处理结构化或半结构化数据.

Also, QuickSight can directly connect to the Athena database and query the data for analysis. When you connect to Athena database, you are most likely to handle structured or semi-structured data.

Amazon S3清单文件.

直接连接到S3时的一些限制:-

清单中指定的文件大小不能超过1 GB,指定的所有文件的大小不能超过10 GB,总大小不能超过10 GB.指定的文件数不能超过1000.

No file specified in the manifest can exceed 1 GB in size, the total size of the all the files specified can't exceed 10 GB, and the total number of files specified can't exceed 1000.

当您使用Amazon Athena Data创建数据集时,上述限制不可用.

The above limitations are not available when you use create the Data Set Using Amazon Athena Data.

使用Amazon Athena数据创建数据集时的另一个功能:-

您可以直接分析数据,而无需加载或加载到SPICE中并分析数据.

You can directly analyze the data without loading or load into SPICE and analyze the data.

结论:-

如果您尚未对S3文件执行任何操作,则可以直接使用以S3作为数据集的QuickSight.

If you have not done anything on your S3 files, you can just ahead and use QuickSight using S3 as data set.

如果将S3数据加载到Athena中,则可以将Athena用作QuickSight的数据集.

In case, if you have loaded the S3 data into Athena, then you can use Athena as data set for QuickSight.

通过使用Athena或任何其他数据源,您将获得很少的好处,并且可以克服上述一些限制(即文件大小).

By using the Athena or any other data source, you will get few benefits and can overcome some limitation (i.e. file size) mentioned above.

这篇关于由于QuickSight可以直接查询S3,我们什么时候需要使用Athena作为QuickSight的数据源?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆