将文件上传到S3存储桶后，基于事件的AWS Glue Crawler触发器? [英] Event based trigger of AWS Glue Crawler after a file is uploaded into a S3 Bucket?

问题描述

假设搜寻器指向"该存储桶，是否有可能在上传到S3存储桶的新文件上触发AWS Glue搜寻器?换句话说:文件上传会生成一个事件，该事件使AWS Glue搜寻器对其进行分析.我知道有基于计划的爬网，但从未找到基于事件的爬网.

Is it possible to trigger an AWS Glue crawler on new files, that get uploaded into a S3 bucket, given that the crawler is "pointed" to that bucket? In other words: a file upload generates an event, that causes AWS Glue crawler to analyse it. I know that there is schedule based crawling, but never found an event- based one.

推荐答案

否，当前没有直接方法可以响应上载到S3存储桶来调用AWS Glue搜寻器. S3事件通知只能发送到:

No, there is currently no direct way to invoke an AWS Glue crawler in response to an upload to an S3 bucket. S3 event notifications can only be sent to:

• SNS
• SQS
• Lambda

但是，编写一小段Lambda代码以使用相关语言SDK来以编程方式调用Glue搜寻器将是微不足道的.

However, it would be trivial to write a small piece of Lambda code to programmatically invoke a Glue crawler using the relevant language SDK.

这篇关于将文件上传到S3存储桶后，基于事件的AWS Glue Crawler触发器?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！