如何获得有关过期 kafka 事件的通知 [英] How to get notified about expired kafka events

问题描述

如果 kafka 主题中的事件由于保留策略而过期，是否有任何机制可以(通过特定的日志文件条目或类似条目)获得通知?(我知道设计上应该避免这种情况，但仍然如此).

Is there any mechanism to get notified (by a specific logfile entry or similar) in case an event within a kafka topic is expired due to retention policies? (I know this should avoided by design, but still).

我了解消费者滞后监控工具，用于监控已发布的事件与相关消费者群体之间的偏移差异，但它们仅提供一个错误的数字(偏移差异).

I know about consumer lag monitoring tools for monitoring offset discrepancies between a published event and related consumer groups but they provide afaik only numbers (the offset difference).

换句话说:我们如何确定 kafka 事件是否从未被消费并因此过期?

推荐答案

日志清理线程会将删除事件输出到代理日志，但它会反映文件段而不是特定消息

The log cleaner thread will output deletion events to the broker logs, but it'll reflect file segments not particular messages

这篇关于如何获得有关过期 kafka 事件的通知的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！