如何设置Airflow中DAG之间的依赖关系？ [英] How to set dependencies between DAGs in Airflow?

问题描述

我正在使用 Airflow 计划批处理作业。我有一个DAG（A）每晚运行，另一个DAG（B）每月运行一次。 B取决于A已成功完成。但是B运行需要很长时间，因此我想将其保存在单独的DAG中，以实现更好的SLA报告。

I am using Airflow to schedule batch jobs. I have one DAG (A) that runs every night and another DAG (B) that runs once per month. B depends on A having completed successfully. However B takes a long time to run and so I would like to keep it in a separate DAG to allow better SLA reporting.

如何使运行DAG B依赖于当天成功运行的DAG A？

How can I make running DAG B dependent on a successful run of DAG A on the same day?

推荐答案

您可以使用名为ExternalTask​​Sensor的运算符来实现此行为。
将安排DAG（B）中的任务（B1），并等待DAG（A）中的任务（A2）成功完成

You can achieve this behavior using an operator called ExternalTaskSensor. Your task (B1) in DAG(B) will be scheduled and wait for a success on task (A2) in DAG(A)

外部任务传感器文档

这篇关于如何设置Airflow中DAG之间的依赖关系？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！