如何运行一个气流任务及其所有依赖项? [英] How to run one airflow task and all its dependencies?

查看:67
本文介绍了如何运行一个气流任务及其所有依赖项?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我怀疑

气流运行dag_id task_id执行日期

将运行所有上游任务,但不会。当看到并非所有相关任务都在运行时,它将简单地失败。如何运行特定任务及其所有依赖项?我猜这是由于气流设计的决定而无法实现的,但是有办法解决吗?

would run all upstream tasks, but it does not. It will simply fail when it sees that not all dependent tasks are run. How can I run a specific task and all its dependencies? I am guessing this is not possible because of an airflow design decision, but is there a way to get around this?

推荐答案

您可以通过使用-i / -I / -A标志以及run命令来独立运行任务。

You can run a task independently by using -i/-I/-A flags along with the run command.

但是是的,气流设计不允许运行特定任务及其所有依赖项。

But yes the design of airflow does not permit running a specific task and all its dependencies.

您可以通过从DAG中删除无关的任务来回填Dag,以进行测试

You can backfill the dag by removing non-related tasks from the DAG for testing purpose

这篇关于如何运行一个气流任务及其所有依赖项?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆