Google Dataflow挂起，没有日志 [英] Google Dataflow hangs with no logs

问题描述

当我运行示例WordCount作业，它将启动工作程序，然后挂起并处于运行状态.

When I run example WordCount job from Dataflow docs with *DataflowPipelineRunner, it launches workers and then just hangs with state Running.

最后两个状态消息:

Jan 29, 2016, 22:05:50
S02: (b959a12901787f4d): Executing operation ReadLines+WordCount.CountWords/ParDo(ExtractWords)+WordCount.CountWords/Count.PerElement/Init+WordCount.CountWords/Count.PerElement/Count.PerKey/GroupByKey+WordCount.CountWords/Count.PerElement/Count.PerKey/Combine.GroupedValues/Partial+WordCount.CountWords/Count.PerElement/Count.PerKey/GroupByKey/Reify+WordCount.CountWords/Count.PerElement/Count.PerKey/GroupByKey/Write

Jan 29, 2016, 22:06:42
(c3fc1276c0229a41): Workers have started successfully.

就是这样.当我单击工作日志"时，它完全是空的.这样至少会停留20分钟.

and that's it. When I click "Worker logs", it's completely empty. It stays like this for at least 20 minutes.

它可以与DirectPipelineRunner配合使用(几秒钟内完成，并在我的gs://...上创建输出文件).

It works fine with DirectPipelineRunner (completes within seconds and creates output file on my gs://...).

我应该看什么?

命令行参数:

--project=my-project
--stagingLocation=gs://my-project/dataflow/staging

推荐答案

不显示日志的常见原因是尚未启用Cloud Logging API.如果入门指南中列出的所有API均未启用，则它会启用可能会导致您描述的两个问题(没有伐木工人和上班族).

A common cause of no logs showing up is that the Cloud Logging API hasn't been enabled. If all of the APIs listed in the getting started guide are not enabled, then it could lead to both problems you described (no logging & hanging workers).

尝试再次遍历入门指南并启用所有相关的API.

Try walking through through the getting started guide again and enabling all the relevant APIs.

这篇关于Google Dataflow挂起，没有日志的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！