Kafka中__consumer_offsets和_schema主题有什么用? [英] What is the use of __consumer_offsets and _schema topics in Kafka?

查看:44
本文介绍了Kafka中__consumer_offsets和_schema主题有什么用?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

在搭建好Kafka Broker集群并创建了几个topic后,我们发现Kafka自动创建了以下两个topic:

After setting up the Kafka Broker cluster and creating few topics, we found that the following two topics are automatically created by Kafka:

  1. __consumer_offsets
  2. _schema

这些主题的重要性和用途是什么?

What is the importance and use of these topics ?

推荐答案

__consumer_offsets 用于存储有关每个主题的已提交偏移量的信息:每个消费者组 (groupID) 的分区.它是压缩主题,因此数据将被定期压缩,并且只有最新的偏移量信息可用.

__consumer_offsets is used to store information about committed offsets for each topic:partition per group of consumers (groupID). It is compacted topic, so data will be periodically compressed and only latest offsets information available.

_schema - 不是默认的 kafka 主题(至少在 kafka 8,9).它是由 Confluent 添加的.查看更多:Confluent Schema Registry - github.com/confluentinc/schema-registry(感谢@serejja)

_schema - is not a default kafka topic (at least at kafka 8,9). It is added by Confluent. See more: Confluent Schema Registry - github.com/confluentinc/schema-registry (thanks @serejja)

这篇关于Kafka中__consumer_offsets和_schema主题有什么用?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆