将文件上传到S3存储桶后,基于事件的AWS Glue Crawler触发器? [英] Event based trigger of AWS Glue Crawler after a file is uploaded into a S3 Bucket?
问题描述
假设搜寻器指向"该存储桶,是否有可能在上传到S3存储桶的新文件上触发AWS Glue搜寻器?换句话说:文件上传会生成一个事件,该事件使AWS Glue搜寻器对其进行分析.我知道有基于计划的爬网,但从未找到基于事件的爬网.
Is it possible to trigger an AWS Glue crawler on new files, that get uploaded into a S3 bucket, given that the crawler is "pointed" to that bucket? In other words: a file upload generates an event, that causes AWS Glue crawler to analyse it. I know that there is schedule based crawling, but never found an event- based one.
推荐答案
否,当前没有直接方法可以响应上载到S3存储桶来调用AWS Glue搜寻器. S3事件通知只能发送到:
No, there is currently no direct way to invoke an AWS Glue crawler in response to an upload to an S3 bucket. S3 event notifications can only be sent to:
- SNS
- SQS
- Lambda
但是,编写一小段Lambda代码以使用相关语言SDK来以编程方式调用Glue搜寻器将是微不足道的.
However, it would be trivial to write a small piece of Lambda code to programmatically invoke a Glue crawler using the relevant language SDK.
这篇关于将文件上传到S3存储桶后,基于事件的AWS Glue Crawler触发器?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!