apache beam 2.19.0不再在云数据流上运行，原因是找不到满足setuptools> = 40.8要求的版本 [英] apache beam 2.19.0 not running on cloud dataflow anymore due to Could not find a version that satisfies the requirement setuptools>=40.8

问题描述

几天以来，我们的python数据流作业导致工作程序启动时出错:

Since a few days our python dataflow jobs result in an error on worker startup:

"ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 
(from versions: none)"

ERROR: Command errored out with exit status 1: /usr/local/bin/python3 
/usr/local/lib/python3.5/site-packages/pip install --ignore-installed --no-user --prefix 
/tmp/pip-build-env-qz0ogm1p/overlay --no-warn-script-location --no-binary :none: --only-binary
 :none: --no-index --find-links /var/opt/google/dataflow -- 'setuptools>=40.8.0' wheel Check the 
logs for full command output.

requests.txt似乎不是问题，

This seems to not be an issue with the requirements.txt, which are:

ua-parser
numpy
pandas
Deprecated

有人遇到过这个问题，也许有解决办法吗?我确实尝试设置了特定的setuptools版本(46.1.3)，这导致了另一个错误:

Did anyone come across this and maybe a solution? I did try to set a specific setuptools version (46.1.3) which resulted in another error:

ERROR: Could not find a version that satisfies the requirement wheel (from versions: none)

"ERROR: Command errored out with exit status 1: /usr/local/bin/python3 
/usr/local/lib/python3.5/site-packages/pip install --ignore-installed --no-user --prefix 
/tmp/pip-build-env-2awl4fw3/overlay --no-warn-script-location --no-binary :none: --only-binary 
:none: --no-index --find-links /var/opt/google/dataflow -- 'setuptools>=40.8.0' wheel Check the
 logs for full command output." 

谢谢

推荐答案

我遇到了与您相同的问题.要解决此问题，我在requirements.txt文件中添加了setuptools，并确保在apache-beam之前订购了该工具.

I had the same issue than yours. To fix it, I added setuptools in the requirements.txt and make sure it is ordered before apache-beam.

这篇关于apache beam 2.19.0不再在云数据流上运行，原因是找不到满足setuptools> = 40.8要求的版本的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！