使用PostgresSQL 12作为后端数据库时，Airflow Scheduler持续发出警告 [英] Airflow Scheduler is continuously issuing warning when using postgresSQL 12 as backend database

问题描述

在执行airflow scheduler时，将继续打印以下消息，并且任务没有被执行.

While executing airflow scheduler is continue printing following messages and tasks are NOT getting picked up.

[2020-02-21 09:21:20,696] {dag_processing.py:663} WARNING - DagFileProcessorManager (PID=11895) exited with exit code -11 - re-launching
[2020-02-21 09:21:20,699] {dag_processing.py:556} INFO - Launched DagFileProcessorManager with pid: 11898
[2020-02-21 09:21:20,711] {settings.py:54} INFO - Configured default timezone <Timezone [UTC]>
[2020-02-21 09:21:20,725] {settings.py:253} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=11898
[2020-02-21 09:21:22,701] {dag_processing.py:663} WARNING - DagFileProcessorManager (PID=11898) exited with exit code -11 - re-launching
[2020-02-21 09:21:22,704] {dag_processing.py:556} INFO - Launched DagFileProcessorManager with pid: 11905
[2020-02-21 09:21:22,712] {settings.py:54} INFO - Configured default timezone <Timezone [UTC]>
[2020-02-21 09:21:22,722] {settings.py:253} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=11905
[2020-02-21 09:21:24,704] {dag_processing.py:663} WARNING - DagFileProcessorManager (PID=11905) exited with exit code -11 - re-launching
[2020-02-21 09:21:24,706] {dag_processing.py:556} INFO - Launched DagFileProcessorManager with pid: 11907
[2020-02-21 09:21:24,717] {settings.py:54} INFO - Configured default timezone <Timezone [UTC]>
[2020-02-21 09:21:24,728] {settings.py:253} INFO - settings.configure_orm(): Using pool settings. pool_size=5, max_overflow=10, pool_recycle=1800, pid=11907
[2020-02-21 09:21:26,710] {dag_processing.py:663} WARNING - DagFileProcessorManager (PID=11907) exited with exit code -11 - re-launching

设置:PostgreSQL 12作为具有气流v1.10.9的后端数据库.

Setup: PostgreSQL 12 as backend database with airflow v1.10.9.

但是，如果我更改为PostgreSQL 11，则调度程序将按预期运行.有人遇到同样的问题吗?

But if I change to PostgreSQL 11 scheduler runs as expected. Does any one faced same issue?

推荐答案

您是否有任何特定原因要使用Postgres ver 12?撰写本文时，1.10.x不支持Postgresql ver 12.

is there any particular reason you want to use Postgres ver 12? As of writing this post, Postgresql ver 12 is not supported by 1.10.x.

根据其github页面， Apache Airflow已通过以下测试:

According to its github page, Apache Airflow is tested with:

主版本(2.0.0dev) Python版本:3.6、3.7 Postgres DB:9.6、10 MySQL数据库:5.7 Sqlite-最新稳定版(主要用于开发目的)

Master version (2.0.0dev) Python versions: 3.6, 3.7 Postgres DB: 9.6, 10 MySQL DB: 5.7 Sqlite - latest stable (it is used mainly for development purpose)

稳定版(1.10.9) Python版本:2.7、3.5、3.6、3.7 Postgres DB:9.6、10 MySQL数据库:5.6、5.7 Sqlite-最新稳定版(主要用于开发目的)

Stable version (1.10.9) Python versions: 2.7, 3.5, 3.6, 3.7 Postgres DB: 9.6, 10 MySQL DB: 5.6, 5.7 Sqlite - latest stable (it is used mainly for development purpose)

这篇关于使用PostgresSQL 12作为后端数据库时，Airflow Scheduler持续发出警告的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！