生产中的Kafka监控工具 [英] Kafka Monitoring tool in Production

查看:421
本文介绍了生产中的Kafka监控工具的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

需要检查在生产中监控Kafka的工具. 另外,该工具不需要许可证或笨重的硬件. 特别是,我需要一种工具来评估消费者对主题的偏倚,主题的健康状况.

Need to check for tool to monitor Kafka in production. Also tool does not need to have license or heavy hardware. In particular I need a tool to evaluate consumer offset on topic,health of topic.

推荐答案

Landoop
Landoop 通过用户界面,流式SQL引擎和群集监视功能增强了Kafka.它可以更快地监视Kafka数据管道.

Landoop
Landoop enhances Kafka with User Interface, streaming SQL engine and cluster monitoring. It enables faster monitoring of Kafka data pipelines.

他们提供了一个免费的多功能码头工人(镜头盒)一个经纪人,最多可容纳2500万条消息.请注意,建议在开发环境中使用.

They provide a free all-in-one docker (LENSES Box) which can serve a single broker for up to 25M messages. Note that this is recommended for development environments.

融合
另一种选择是 Confluent Enterprise ,它是针对生产环境的Kafka发行版.它还包括控制中心,这是用于Apache-Kafka的支持集群的管理系统通过用户界面进行监视和管理.

Confluent
Another option is Confluent Enterprise which is a Kafka distribution for production environments. It also includes Control Centre, which is a management system for Apache-Kafka that enables cluster monitoring and management from a User Interface.

Yahoo Kafka Manager
Kafka的管理器是用于监视Kafka的工具,与上述工具相比,该工具提供的功能较少.

Yahoo Kafka Manager
Kafka's Manager is a tool for monitoring Kafka offering less functionality compared to the aforementioned tools.

KafDrop
KafDrop 是用于监视Apache Kafka集群的UI.该工具显示诸如代理,主题,分区之类的信息,甚至可以让您查看消息.这是一个轻量级的应用程序,可以在Spring Boot上运行,并且只需要很少的配置.

KafDrop
KafDrop is a UI for monitoring Apache Kafka clusters. The tool displays information such as brokers, topics, partitions, and even lets you view messages. It is a light weight application that runs on Spring Boot and requires very little configuration.

链接到洞穴
Burrow 是Apache Kafka的监视助手,它无需指定阈值就可以将消费者滞后检查作为一项服务提供.它监视所有消费者的承诺抵销,并根据需要计算这些消费者的状态.提供HTTP端点以按需请求状态,并提供其他Kafka群集信息.还有一些可配置的通知程序,可以通过电子邮件或HTTP调用向其他服务发送状态.

LinkedIn Burrow
Burrow is a monitoring companion for Apache Kafka that provides consumer lag checking as a service without the need for specifying thresholds. It monitors committed offsets for all consumers and calculates the status of those consumers on demand. An HTTP endpoint is provided to request status on demand, as well as provide other Kafka cluster information. There are also configurable notifiers that can send status out via email or HTTP calls to another service.

Kafka的工具
Kafka工具是用于管理和使用Apache-Kafka集群的GUI应用程序.它提供了一种直观的UI,可让用户快速查看Kafka集群中的对象以及集群主题中存储的消息.它包含面向开发人员和管理员的功能.

Kafka's Tool
Kafka's Tool is a GUI application for managing and using Apache-Kafka clusters. It provides an intuitive UI that allows one to quickly view objects within a Kafka cluster as well as the messages stored in the topics of the cluster. It contains features geared towards both developers and administrators.

恐怕您找不到适合生产环境的免费产品,但是如果您负担不起,请去Yahoo Kafka Manager,LinkedIn Burrow或KafDrop. Confluent和Landoop的产品是目前最好的产品,但不幸的是,它们需要许可证.

I am afraid that you will not find any free products suitable for production environments but if you cannot afford it then go for Yahoo Kafka Manager, LinkedIn Burrow or KafDrop. Confluent's and Landoop's products are the best out there but unfortunately, they require licensing.

有关更多详细信息,请参阅我的博客文章 Apache Kafka群集的UI监视工具概述 .

For more details, you can refer to my blog post Overview of UI Monitoring tools for Apache Kafka Clusters.

这篇关于生产中的Kafka监控工具的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆