Amazon S3串联小文件 [英] Amazon S3 concatenate small files

问题描述

在Amazon S3上是否可以串联小于5MB的小文件. 由于文件太小，无法进行多部分上传.

Is there a way to concatenate small files which are less than 5MBs on Amazon S3. Multi-Part Upload is not ok because of small files.

拉下所有这些文件并进行连接不是一种有效的解决方案.

It's not a efficient solution to pull down all these files and do the concatenation.

那么，有人可以告诉我一些API来执行这些操作吗?

So, can anybody tell me some APIs to do these?

推荐答案

Amazon S3不提供连接功能.它主要是对象存储服务.

Amazon S3 does not provide a concatenate function. It is primarily an object storage service.

您将需要一些过程来下载对象，将它们组合在一起，然后再次上载它们.最有效的方法是并行下载对象，以充分利用可用带宽.但是，这对代码来说更复杂.

You will need some process that downloads the objects, combines them, then uploads them again. The most efficient way to do this would be to download the objects in parallel, to take full advantage of available bandwidth. However, that is more complex to code.

我建议在云中"进行处理，以避免必须通过Internet下载对象.在 Amazon EC2或AWS Lambda 上执行此操作将更高效且成本更低.

I would recommend doing the processing on "in the cloud" to avoid having to download the objects across the Internet. Doing it on Amazon EC2 or AWS Lambda would be more efficient and less costly.

这篇关于Amazon S3串联小文件的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！