看到愚蠢的工人的日志 [英] Seeing logs of dask workers

问题描述

我无法在Dask中更改临时目录.当出于某种原因更改dask.yaml中的临时目录时，Dask仍在/tmp(已满)中写出.我现在想尝试调试它，但是当我使用client.get_worker_logs()时，我只会得到INFO输出.

I'm having trouble changing the temporary directory in Dask. When I change the temporary-directory in dask.yaml for some reason Dask is still writing out in /tmp (which is full). I now want to try and debug this, but when I use client.get_worker_logs() I only get INFO output.

我通过以下方式启动集群

I start my cluster with

from dask.distributed import LocalCluster, Client

cluster = LocalCluster(n_workers=1, threads_per_worker=4, memory_limit='10gb')

client = Client(cluster)

我已经尝试将distributed.worker: debug添加到distributed.yaml，但这不会更改输出.我还要检查我实际上是通过调用dask.config.get('distributed.logging')

I already tried adding distributed.worker: debug to the distributed.yaml, but this doesn't change the output. I also check I am actually changing the configuration by calling dask.config.get('distributed.logging')

我在做什么错了?

推荐答案

默认情况下，LocalCluster使大多数日志记录保持静音.尝试传递silence_logs=False关键字

By default LocalCluster silences most logging. Try passing the silence_logs=False keyword

cluster = LocalCluster(..., silence_logs=False)

这篇关于看到愚蠢的工人的日志的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！