Flink 任务管理器超时? [英] Flink TaskManager timeout?

问题描述

我正在运行一个 Flink 应用程序(通过 Yarn)，似乎随机有时任务管理器超时，这是错误:

I am running a Flink application (via Yarn) and it seems that randomly sometimes a task manager times out, here is the error:

java.util.concurrent.TimeoutException: Heartbeat of TaskManager with id someId timed out.
    at org.apache.flink.runtime.jobmaster.JobMaster$TaskManagerHeartbeatListener.notifyHeartbeatTimeout(JobMaster.java:1610)
    at org.apache.flink.runtime.heartbeat.HeartbeatManagerImpl$HeartbeatMonitor.run(HeartbeatManagerImpl.java:339)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:154)
    at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:39)
    at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:415)
    at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
    at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
    at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
    at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)

这会在作业开始运行 30-45 分钟后发生.关于可能导致这种情况的任何想法?

This happens 30-45 minutes after the job has started running. Any ideas as to what could be causing this?

推荐答案

这个问题的原因可能是JobManager的内存太小了，试试把它调大

The reason of this problem maybe the membory of JobManager is too small, try make it bigger

这篇关于Flink 任务管理器超时?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！