以编程方式模拟“gsutil mv".在 python 中的 appengine 云存储上 [英] Programmatically emulating "gsutil mv" on appengine cloudstorage in python

问题描述

我想在谷歌云存储上实现一个 mv(copy-in-the-cloud)操作，类似于 gsutil 的操作方式(http://developers.google.com/storage/docs/gsutil/commands/mv).

I would like to implement a mv (copy-in-the-cloud) operation on google cloud storage that is similar to how gsutil does it (http://developers.google.com/storage/docs/gsutil/commands/mv).

我之前在某处读到这涉及数据的读取和写入(下载和重新上传)，但我无法再次找到这些段落.

I read somewhere earlier that this involves a read and write (download and reupload) of the data, but I cannot find the passages again.

这是在云存储中移动文件的正确方法，还是必须深入到 boto 库以避免通过网络复制数据以重命名文件?

Is this the correct way to move a file in cloud storage, or does one have to go a level down to the boto library to avoid copying the data over the network for renaming the file?

istream = cloudstorage.open(src, mode='r')
ostream = cloudstorage.open(dst, content_type=src_content, mode='w')

while True:
    buf = istream.read(500000)
    if not buf:
        break

    ostream.write(buf)

istream.close()
ostream.close()

更新:我找到了支持复制和撰写操作的其余 api 等等.似乎有希望我们不必跨大陆复制数据来重命名.

Update: I found the rest api that supports copy and compose operations and much more. It seems that there is hope that we do not have to copy data across continents to rename something.

到目前为止我发现的有用链接...

Useful Links I have found sofar ...

• 基于 Boto 的方法:https://developers.google.com/storage/docs/gspythonlibrary
• GCS 客户端库:https://developers.google.com/appengine/docs/python/googlecloudstorageclient/
• GCS 库:https://code.google.com/p/appengine-gcs-客户
• 原始 JSON API:https://developers.google.com/storage/docs/json_api

推荐答案

使用JSON API，有一个复制方法.这是 Python 的官方示例，使用 Python Google Api Client lib :

Use the JSON API, there is a copy method. Here is the official example for Python, using the Python Google Api Client lib :

# The destination object resource is entirely optional. If empty, we use
# the source object's metadata.
if reuse_metadata:
    destination_object_resource = {}
else:
    destination_object_resource = {
            'contentLanguage': 'en',
            'metadata': {'my-key': 'my-value'},
    }
req = client.objects().copy(
        sourceBucket=bucket_name,
        sourceObject=old_object,
        destinationBucket=bucket_name,
        destinationObject=new_object,
        body=destination_object_resource)
resp = req.execute()
print json.dumps(resp, indent=2)

这篇关于以编程方式模拟“gsutil mv".在 python 中的 appengine 云存储上的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！