在同一Cloudformation堆栈中连接Athena和S3 [英] Connecting Athena and S3 in same Cloudformation Stack

问题描述

从文档中， AWS :: Athena :: NamedQuery ，目前尚不清楚如何将Athena附加到同一堆栈中指定的S3存储桶中。

From the documentation, AWS::Athena::NamedQuery, it is unclear how to attach Athena to an S3 bucket specified in the same stack.

如果我不得不从示例，我想您可以编写一个模板，

If I had to guess from the example, I would imagine that you can write a template like,

Resources:
  MyS3Bucket:
    Type: AWS::S3::Bucket
       ... other params ...

  AthenaNamedQuery:
    Type: AWS::Athena::NamedQuery
    Properties:
      Database: "db_name"
      Name: "MostExpensiveWorkflow"
      QueryString: >
                    CREATE EXTERNAL TABLE db_name.test_table 
                    (...) LOCATION s3://.../path/to/folder/

像上面的作品一样的模板吗？创建堆栈后，表 db_name.test_table 是否可用于运行查询？

Would a template like the above work? Upon stack creation, will the table db_name.test_table be available to run queries on?

推荐答案

找出连接S3和Athena的方法是制作Glue桌子！我真傻！当然，胶水是您连接事物的方式！

Turns out the way you connect the S3 and Athena is to make a Glue table! How silly of me!! Of course Glue is how you connect things!

除了讽刺，这是一个使用 AWS :: Glue :: Table 和 AWS :: Glue :: Database ，

Sarcasm aside, this is a template that worked for me when using AWS::Glue::Table and AWS::Glue::Database,

Resources:
  MyS3Bucket:
    Type: AWS::S3::Bucket

  MyGlueDatabase:
    Type: AWS::Glue::Database
    Properties:
      DatabaseInput:
        Name: my-glue-database
        Description: "Glue beats tape"
      CatalogId: !Ref AWS::AccountId

  MyGlueTable:
    Type: AWS::Glue::Table
    Properties:
      DatabaseName: !Ref MyGlueDatabase
      CatalogId: !Ref AWS::AccountId
      TableInput:
        Name: my-glue-table
        Parameters: { "classification" : "csv" }
        StorageDescriptor:
          Location:
            Fn::Sub: "s3://${MyS3Bucket}/"
          InputFormat: "org.apache.hadoop.mapred.TextInputFormat"
          OutputFormat: "org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat"
          SerdeInfo:
            Parameters: { "separatorChar" : "," }
            SerializationLibrary: "org.apache.hadoop.hive.serde2.OpenCSVSerde"
          StoredAsSubDirectories: false
          Columns:
            - Name: column0
              Type: string
            - Name: column1
              Type: string

此后，数据库和表位于AWS Athena控制台中！

After this, the database and table were in the AWS Athena Console!

这篇关于在同一Cloudformation堆栈中连接Athena和S3的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！