重新启动气流调度程序 [英] Restarting the airflow scheduler

问题描述

我正在尝试让气流工作以更好地编排 etl 过程.当我对 dags 文件夹中的 dag 进行更改时，我经常需要使用

I'm trying to get airflow working to better orchestrate an etl process. When I make changes to a dag in my dags folder, I often have to restart the scheduler with

airflow scheduler

更改在 UI 中可见之前.我想使用

before the changes are visible in the UI. I would like to run the scheduler as a daemon process with

airflow scheduler -D

但我们尝试这样做，我收到一条消息说

but we I try to do so, I get a message saying

[2018-10-17 14:13:54,769] {jobs.py:580} ERROR - 
Cannot use more than 1 thread when using sqlite. Setting max_threads to 1

我认为出现此错误是因为调度程序已作为守护程序运行.但是，当我尝试找出调度程序运行的位置时

I think this error pops up because the scheduler is already running as a daemon. However, when I try to find out where the scheduler is being run with

lsof -i

我没有得到任何结果.

问题:为什么我无法使用 airflow scheduler -D 重新启动调度程序.为什么调度程序会使用 airflow webserver 重新启动?如何成功终止阻止我运行 airflow scheduler -D 的进程?

Question: Why am I not able to restart the scheduler with airflow scheduler -D. Why does the scheduler restart with airflow webserver? How do I successfully kill the process that is preventing me to run airflow scheduler -D?

推荐答案

运行 ps aux |grep airflow 并检查 airflow webserver 或 airflow scheduler 进程是否正在运行.如果他们被杀死并使用 airflow scheduler -D

Run ps aux | grep airflow and check if airflow webserver or airflow scheduler processes are running. If they are kill them and rerun using airflow scheduler -D

这篇关于重新启动气流调度程序的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！