与sqs经纪人合作进行芹菜监控 [英] celery monitoring with sqs broker

问题描述

我们将Airflow(1.10.3)与celery executor(4.1.1(latentcall))和经纪人SQS一起使用.在调试问题时，我们尝试使用celery CLI，发现任何检查命令或监视工具均不支持SQS代理.花.有什么方法可以监控芹菜工人的任务或事件?

We are using Airflow(1.10.3) with celery executor(4.1.1 (latentcall)) and broker SQS. While debugging an issue we tried our hands on celery CLI and found out that SQS broker is not supported for any of the inspect commands or monitoring tool eg. Flower. Is there any way we can monitor the tasks or events on celery workers?

我们尝试了以下诅咒监控器:

We have tried curses monitor as below:

芹菜事件-b sqs://

celery events -b sqs://

但是它显示未发现任何工作程序，未选择任何任务.检查命令直接显示:

But it shows no worker discovered,no tasks selected. Inspect Commands directly shows:

可用性:RabbitMQ(AMQP)和Redis传输.

Availability: RabbitMQ (AMQP) and Redis transports.

请让我知道我是否缺少某些东西，甚至可以用SQS监控芹菜工人.

Please let me know if I am missing something or is it even possible to monitor celery workers with SQS.

推荐答案

SQS传输不提供监视/检查支持(这是我不使用它的主要原因)...根据最新文档 Redis和RabbitMQ是唯一支持以下类型的经纪人类型监视/检查和远程控制.

SQS transport does not provide support for monitoring/inspection (this is the main reason why I do not use it)... According to the latest documentation Redis and RabbitMQ are the only broker types that have support for monitoring/inspection and remote control.

这篇关于与sqs经纪人合作进行芹菜监控的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！