如何从kafka(0.10.x)获取组提交偏移量 [英] how to get the group commit offset from kafka(0.10.x)

问题描述

该组的偏移量信息之前已存储在zookeeper中.现在，在Kafka群集(0.10.x)中，偏移量信息存储在名为 __ consumer_offsets 的主题中.

The offsets informations of the group were stored in zookeeper before. Now, in the Kafka Cluster (0.10.x), the offsets informations are stored in the topic which's name is __consumer_offsets.

但是如何获取指定的组的偏移量信息?

But how could I get the offsets information of the group which I specified？

推荐答案

对于活动组，调用以下命令以获取偏移量:

For active groups, invoke command below to retrieve the offsets:

bin/kafka-consumer-groups.sh --bootstrap-server broker1:9092 --describe --group test-consumer-group

对于非活动组，首先通过计算Math.abs(groupId.hashCode())％50获得目标偏移主题分区号，然后调用:

For inactive groups, first get the target offset topic partition number by calculating Math.abs(groupId.hashCode()) % 50, then invoke:

bin/kafka-simple-consumer-shell.sh --topic __consumer_offsets --partition <calculated number> --broker-list broker1:9092 --formatter "kafka.coordinator.GroupMetadataManager\$OffsetsMessageFormatter"

查找组的偏移量.

这篇关于如何从kafka(0.10.x)获取组提交偏移量的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！