为什么 Airflow 会因 INFO 崩溃 - “任务退出并返回代码 -9"? [英] Why is Airflow crashing with INFO - "Task exited with return code -9"?
本文介绍了为什么 Airflow 会因 INFO 崩溃 - “任务退出并返回代码 -9"?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
我有一个很大的 DAG 正在运行,但是它只是因为那条消息而停止,我无法弄清楚 Airflow 文档上的错误是什么.
I have a big DAG running, however it's stopping with just that message, I couldn't figure out what is the error on the Airflow docs.
如果这有所作为:我的 Airflow 在带有 Helm 图表的 Rancher 中运行.
If that makes difference: My Airflow is running in a Rancher with a Helm chart.
推荐答案
我想到了一种减少所有内存大小的方法.第一次尝试是加载一些行而不是所有行:
I thought about a way to reduce the size of all the memory possibilities. And the first try was load some number of lines instead of all the lines:
serverCursor = conn.cursor("serverCursor")
serverCursor.execute(f'''select * from {ORIGIN_SCHEMA}.{table};''')
df = []
while True:
records = serverCursor.fetchmany(size=50000)
df = df + records
if not records:
break
serverCursor.close()
解决了这个问题.
这篇关于为什么 Airflow 会因 INFO 崩溃 - “任务退出并返回代码 -9"?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文