如何在Airflow中将参数传递给PythonOperator [英] How to pass parameter to PythonOperator in Airflow

问题描述

我刚刚开始使用 Airflow ，有人可以启发我如何将参数传递到 PythonOperator 中，如下所示：

I just started using Airflow, can anyone enlighten me how to pass a parameter into PythonOperator like below:

t5_send_notification = PythonOperator(
    task_id='t5_send_notification',
    provide_context=True,
    python_callable=SendEmail,
    op_kwargs=None,
    #op_kwargs=(key1='value1', key2='value2'),
    dag=dag,
)

def SendEmail(**kwargs):
    msg = MIMEText("The pipeline for client1 is completed, please check.")
    msg['Subject'] = "xxxx"
    msg['From'] = "xxxx"
    ......
    s = smtplib.SMTP('localhost')
    s.send_message(msg)
    s.quit()

我希望能够将一些参数传递给 t5_send_notification 的可调用对象，即 SendEmail ，理想情况下，我想将完整日志和/或部分日志（本质上是来自垃圾邮件）附加到要发送的电子邮件中，猜测 t5_send_notification 是收集这些信息的地方。

I would like to be able to pass some parameters into the t5_send_notification's callable which is SendEmail, ideally I want to attach the full log and/or part of the log (which is essentially from the kwargs) to the email to be sent out, guessing the t5_send_notification is the place to gather those information.

非常感谢。

推荐答案

1. 将字典对象传递给 op_kwargs



2. 使用键从可调用的python中的 kwargs 字典访问其值

def SendEmail(**kwargs):
    print(kwargs['key1'])
    print(kwargs['key2'])
    msg = MIMEText("The pipeline for client1 is completed, please check.")
    msg['Subject'] = "xxxx"
    msg['From'] = "xxxx"
    ......
    s = smtplib.SMTP('localhost')
    s.send_message(msg)
    s.quit()


t5_send_notification = PythonOperator(
    task_id='t5_send_notification',
    provide_context=True,
    python_callable=SendEmail,
    op_kwargs={'key1': 'value1', 'key2': 'value2'},
    dag=dag,
)

这篇关于如何在Airflow中将参数传递给PythonOperator的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！