是否在Apache Spark中重新提交了失败的任务? [英] Are failed tasks resubmitted in Apache Spark?

问题描述

失败的任务是否自动在Apache Spark中重新提交给同一执行者或其他执行者?

Are failed tasks automatically resubmitted in Apache Spark to the same or another executor?

推荐答案

我相信失败的任务会被重新提交，因为我在Web UI上看到多次提交同一失败的任务.但是，如果同一任务多次失败，则整个作业将失败:

I believe failed tasks are resubmitted because I have seen the same failed task submitted multiple times on the Web UI. However, if the same task fails multiple times, the full job fail:

org.apache.spark.SparkException: Job aborted due to stage failure: Task 120 in stage 91.0 failed 4 times, most recent failure: Lost task 120.3 in stage 91.0

这篇关于是否在Apache Spark中重新提交了失败的任务?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！