将 AWS 胶水架构注册表与融合的 SerDe 客户端结合使用 [英] Using AWS glue schema registry with confluent SerDe clients

查看:25
本文介绍了将 AWS 胶水架构注册表与融合的 SerDe 客户端结合使用的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

为了在我的 MSK 主题上支持架构注册表,我找到了两个选项 -

For supporting schema registry on my MSK topic, I found two options -

  • AWS Glue 架构注册表;和
  • Confluent Schema Registry

由于 Glue SR 完全由 AWS 管理,我更愿意使用它.但是,我的生产者和消费者客户端是用 python 编写的,这限制了我在 java 中使用 AWS 提供的 SerDe 库.

Since, Glue SR is fully managed by AWS, I would prefer to use that. However, my producer and consumer clients are written in python, which limits me from using SerDe libraries provided by AWS in java.

我继续搜索是否可以使融合模式注册表 API(python 中融合的 kafka 库的一部分)与 Glue 模式注册表一起使用,因为我最初的假设是模式注册表实现跨融合和胶水是通用的.

I went on to search whether the confluent schema registry API (part of confluent kafka library in python) can be made to work with the Glue Schema Registry, since my initial assumption is that the schema registry implementations are generic across confluent and glue.

在阅读融合文档时,我发现可以通过使用 url 属性(https://docs.confluent.io/platform/current/clients/confluent-kafka-python/#).

When reading confluent documentation, I found that a schema registry connection can be established by supplying url for schema registry using url property (https://docs.confluent.io/platform/current/clients/confluent-kafka-python/#).

我无法为我创建的胶水注册表找到这样的 url.他们的 Java 客户端确实接受区域名称、注册表名称和其他属性等属性(https://docs.aws.amazon.com/glue/latest/dg/glue-dg.pdf#schema-registry).有什么办法可以找到这个 url,或者我应该切换到 confluent SR,这不是托管服务?

I cannot find such url for the glue registry I created. Their java client does take in properties like region name, registry name and other properties (https://docs.aws.amazon.com/glue/latest/dg/glue-dg.pdf#schema-registry). Is there any way this url can be found out, or should I switch to confluent SR, which is not a managed service?

推荐答案

AWS Glue Schema Registry 没有 URL 端点的概念.您可以通过给定区域和注册名称的 AWS API 与服务交互.

AWS Glue Schema Registry does not have the notion of a URL endpoint. You interact with the service through the AWS APIs given a region and a registry name.

AWS 提供了一个库

https://github.com/awslabs/aws-glue-schema-registry

这篇关于将 AWS 胶水架构注册表与融合的 SerDe 客户端结合使用的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆