同步两个AWS Glue数据目录 [英] Syncing two AWS Glue Data Catalog

问题描述

我有一个用例，我想同步两个驻留在不同账户上的AWS Glue数据目录.

I have a use-case where I want to sync two AWS Glue Data Catalog residing on different accounts.

当创建/删除新的数据库/表/分区时，Glue是否发出可以发布的通知?还是通过其他方式知道其他Glue数据目录中正在发生的事情?

Does Glue emit notifications which can be published when a new database/table/partition is created/deleted? Or some other way of knowing what is happening in other Glue Data Catalog?

一种方法是侦听该Glue帐户的Cloudwatch通知，但根据Doc Cloudwatch通知，这是不可靠的:

One way is to listen Cloudwatch notifications of that Glue account but according to Doc Cloudwatch notifications are not reliable:

https://docs.aws.amazon.com/glue/latest/dg/automating-awsglue-with-cloudwatch-events.html

推荐答案

AWS为此目的提供了一个开放源脚本.参见

AWS provides an open source script(s) for that purpose. See here

不确定它的可靠性和快速性，但值得尝试.

Not sure how reliable and fast it is, but worth trying.

这篇关于同步两个AWS Glue数据目录的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！