如何从一个亚马逊S3斗将大量的项目到另一个？ [英] How to move a lot of items from one S3 Amazon bucket to another?

问题描述

我有2个亚马逊S3水桶

I have 2x S3 Amazon buckets

• 在旧的东西
• 新的东西

和我想的10K左右的项目从旧的东西斗名单（这是在桶中的数据的一个子集）移动到新东西桶。

and I wish to move a list of 10K or so items from the Old Stuff bucket (which is just a subset of the data in that bucket) to the New Stuff bucket.

我不知道要做到这一点的最好办法。

I'm not sure of the best way to do this.

我想利用他们的 REST API 但没有站出来，可以做本。其次，我不知道他们的API将处理大容量移动 - 这样的话，我需要如何最好地火了10K奇怪的REST API请求一些建议......

I was thinking of leveraging their REST API but nothing stood out that could do this. Secondly, I'm not sure that their API would handle bulk moving - so then I would need some suggestions about how to best fire off 10K odd REST api requests...

任何code例子将需要pferred在.NET $ P $吧。

Any code examples would need to be preferred in .NET please.

最后，如果有人提出一个开放源码库来做到这一点..可以请他们解释一下，如果方法（S）处理批量请求..如果不是..我该如何处理在很短的时间这么多的要求。

Lastly, if someone suggests an Open Source library to do this.. can they please explain if the method(s) handle bulk requests .. and if not .. how can i handle so many requests in a short time.

推荐答案

这只是一次性的举动？

为什么不使用GUI工具，例如莓浏览器或的 BucketExplorer 。我是pretty的确保两个可以做并行操作。

Why not use a GUI tool such Cloudberry Explorer or BucketExplorer. I'm pretty sure both can do parallel operations.

如果你想要或需要以编程方式做到这一点，你可以使用<一个href="http://docs.amazonwebservices.com/AmazonS3/latest/dev/index.html?CopyingObjectUsingNetSDK.html"相对=nofollow> AWS .NET SDK的 CopyObject 法桶之间复制文件。然后删除原始文件，以完成移动。你可以在 <$ C $包这件事C>的Parallel.For 或任何其它对并口/异步操作建库。请参见任务并行库。

If you want or need to do it programmatically, you can use the AWS .NET SDK's CopyObject method to copy files between buckets. Then delete the original file to complete the move. You could wrap this up in a Parallel.For or any of the other built in libraries for parallel/async operations. See Task Parallel Library.

我想有什么用这些库，使多个请求并行太REST API阻止你。

I guess there's nothing stopping you using these libraries to make multiple request to the REST API in parallel too.

这篇关于如何从一个亚马逊S3斗将大量的项目到另一个？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！