GCP中的AWS Batch模拟吗? [英] AWS Batch analog in GCP?

问题描述

我正在使用AWS，并且是GCP的新手.我大量使用的功能之一是AWS Batch，它在提交作业时自动创建VM，并在完成作业时删除VM.是否有GCP对应对象?根据我的研究，最接近的是GCP数据流.GCP Dataflow文档将我引到了Apache Beam.但是，当我浏览此处的示例(链接)时，感觉完全不同从AWS Batch中获取.

I was using AWS and am new to GCP. One feature I used heavily was AWS Batch, which automatically creates a VM when the job is submitted and deletes the VM when the job is done. Is there a GCP counterpart? Based on my research, the closest is GCP Dataflow. The GCP Dataflow documentation led me to Apache Beam. But when I walk through the examples here (link), it feels totally different from AWS Batch.

关于在GCP中提交作业以进行批处理的任何建议?我的要求是简单地从Google Cloud Storage中检索数据，使用Python脚本分析数据，然后将结果返回给Google Cloud Storage.该过程可能需要一整夜，并且我不希望在工作完成后让VM处于空闲状态，但我正在睡觉.

Any suggestions on submitting jobs for batch processing in GCP? My requirement is to simply retrieve data from Google Cloud Storage, analyze the data using a Python script, and then put the result back to Google Cloud Storage. The process can take overnight and I don't want the VM to be idle when the job is finished but I'm sleeping.

推荐答案

我建议签出 dsub .它是Google Genomics团队最初开发的一种开源工具，用于在Google Cloud上进行批处理.

I recommend checking out dsub. It's an open-source tool initially developed by the Google Genomics teams for doing batch processing on Google Cloud.

这篇关于GCP中的AWS Batch模拟吗?的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！