执行任务后,气流调度程序似乎没有运行 [英] Airflow scheduler does not appear to be running after execute a task

查看:38
本文介绍了执行任务后,气流调度程序似乎没有运行的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

当有任务在运行时,Airflow会弹出一个通知,说调度器似乎没有运行,一直显示到任务完成:

When there is a task running, Airflow will pop a notice saying the scheduler does not appear to be running and it kept showing until the task finished:

The scheduler does not appear to be running. Last heartbeat was received 5 minutes ago.

The DAGs list may not update, and new tasks will not be scheduled.

实际上,调度程序进程正在运行,因为我已经检查了该进程.任务完成后,提示消失,一切恢复正常.

Actually, the scheduler process is running, as I have checked the process. After the task finished, the notice will disappear and everything back to normal.

我的任务有点重,可能要运行几个小时.

My task is kind of heavy, may running for couple hours.

推荐答案

我认为这是 Sequential Executor 所期望的.Sequential Executor 一次只运行一件事,所以它不能同时运行心跳和任务.

I think it is expected for Sequential Executor. Sequential Executor runs one thing at a time so it cannot run heartbeat and task at the same time.

为什么需要使用 Sequential Executor/Sqlite?切换到其他 DB/Executor 的建议非常有意义.

Why do you need to use Sequential Executor / Sqlite? The advice to switch to other DB/Executor make perfect sense.

这篇关于执行任务后,气流调度程序似乎没有运行的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆