同步两个AWS Glue数据目录 [英] Syncing two AWS Glue Data Catalog
问题描述
我有一个用例,我想同步两个驻留在不同账户上的AWS Glue数据目录.
I have a use-case where I want to sync two AWS Glue Data Catalog residing on different accounts.
当创建/删除新的数据库/表/分区时,Glue是否发出可以发布的通知?还是通过其他方式知道其他Glue数据目录中正在发生的事情?
Does Glue emit notifications which can be published when a new database/table/partition is created/deleted? Or some other way of knowing what is happening in other Glue Data Catalog?
一种方法是侦听该Glue帐户的Cloudwatch通知,但根据Doc Cloudwatch通知,这是不可靠的:
One way is to listen Cloudwatch notifications of that Glue account but according to Doc Cloudwatch notifications are not reliable:
https://docs.aws.amazon.com/glue/latest/dg/automating-awsglue-with-cloudwatch-events.html
推荐答案
AWS provides an open source script(s) for that purpose. See here
不确定它的可靠性和快速性,但值得尝试.
Not sure how reliable and fast it is, but worth trying.
这篇关于同步两个AWS Glue数据目录的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!