使用Docker来处理Google云数据流依赖关系 [英] use docker for google cloud data flow dependencies

问题描述

我有兴趣使用Google云端数据流并行处理视频。我的工作同时使用OpenCV和tensorflow。是否可以在Docker实例中运行工作器，而不是按照以下所述从源代码安装所有依赖项：

https://cloud.google.com/dataflow/pipelines/dependencies-python

我预料会有一个Docker容器标志，它已经在Google容器引擎中。

无法修改或切换默认的Dataflow工作容器。您需要根据文档安装依赖项。

I am interested in using Google cloud Dataflow to parallel process videos. My job uses both OpenCV and tensorflow. Is it possible to just run the workers inside a docker instance, rather than installing all the dependencies from source as described:

https://cloud.google.com/dataflow/pipelines/dependencies-python

I would have expected a flag for a docker container, which is already sitting in google container engine.

解决方案

It is not possible to modify or switch the default Dataflow worker container. You need to install the dependencies according to the documentation.

这篇关于使用Docker来处理Google云数据流依赖关系的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！