将2TB映像从Rackspace迁移到Amazon s3 [英] Migrate 2TB images from Rackspace to Amazon s3
问题描述
我们需要将2TB的图像从Rackspace服务器移至Amazon S3存储桶，以与我们在项目中使用的其他Amazon Web Services(AWS)整合.是否有任何AWS服务可用于迁移这堆文件.我对使用第三方CLOUD迁移服务不感兴趣.请帮忙.
We had a requirement to move a 2TB of images from a Rackspace server to an Amazon S3 bucket, to consolidate with other Amazon Web Services (AWS) we were using on a project. Is there any AWS service available to migrate this bunch of files. I am not interested on go with third party CLOUD migration services. Please help.
推荐答案
对于您的用例，我会看到3种不同的服务
I would see 3 different services for your use case
- S3传输加速
You can use transfer acceleration it was announced last April. I could not test it (we migrated 1TB of oracle dump files last november)
如上所述
通过在高度优化的网络桥上承载HTTP和HTTPS流量来工作，该网络桥在距离您的客户端最近的AWS Edge位置和您的Amazon S3存储桶之间运行.没有要管理的网关服务器，没有要打开的防火墙，没有要与之集成的特殊协议或客户端，也没有要支付的前期费用.您只需更改应用程序用于传输数据的S3端点，即可自动应用加速.远距离移动GB或TB数据时，可以节省数小时(甚至数天)的传输时间
It works by carrying HTTP and HTTPS traffic over a highly optimized network bridge that runs between the AWS Edge Location nearest to your clients and your Amazon S3 bucket. There are no gateway servers to manage, no firewalls to open, no special protocols or clients to integrate with, or upfront fees to pay. You simply change the S3 endpoint that your application uses to transfer data, and acceleration is automatically applied. When moving GBs or TBs of data over long distances, it can save hours (or even days) in transfer time
好处是，您无需更改基础架构中的任何内容即可使其工作.
The good thing is that you don't need to change anything in your infrastructure to make it work.
另一个好处是，如果AWS发现TA不会提高您的上传速率，则不会从
The other good thing is that if AWS finds TA will not improve your upload rate, it will not charge you, from the pricing page
每次使用Transfer Acceleration上传对象时，我们都会检查Transfer Acceleration是否可能比常规Amazon S3传输更快.如果我们确定Transfer Acceleration不可能比将同一对象到同一目标AWS区域的常规Amazon S3传输更快，那么我们将不为使用该传输而对Transfer Acceleration进行收费，并且可以绕过Transfer Acceleration系统用于该上传.
Each time you use Transfer Acceleration to upload an object, we will check whether Transfer Acceleration is likely to be faster than a regular Amazon S3 transfer. If we determine that Transfer Acceleration is not likely to be faster than a regular Amazon S3 transfer of the same object to the same destination AWS region, we will not charge for that use of Transfer Acceleration for that transfer, and may bypass the Transfer Acceleration system for that upload.
- AWS Direct Connect
根据主机服务器的位置，可以启用直接连接
Depending where your host servers are located, you could enable direct connect
AWS Direct Connect使您可以轻松地建立从您的房屋到AWS的专用网络连接.使用AWS Direct Connect，您可以在AWS与数据中心，办公室或托管环境之间建立专用连接，与基于Internet的连接相比，在许多情况下，它们可以降低网络成本，提高带宽吞吐量并提供更一致的网络体验./p>
AWS Direct Connect makes it easy to establish a dedicated network connection from your premises to AWS. Using AWS Direct Connect, you can establish private connectivity between AWS and your datacenter, office, or colocation environment, which in many cases can reduce your network costs, increase bandwidth throughput, and provide a more consistent network experience than Internet-based connections.
您需要检查服务器所在的数据中心是否在列表中或附近，或者是否花费太长时间才能将服务器连接到
You need to check if the datacenter where your servers are located are part of the list or nearby, if it takes too long to make the connection from your server to a direct connect location, there will be no benefit
- 雪球
如果您在本地拥有文件副本，或者可以插入雪球设备 除非您的服务器连接确实很慢，否则我不建议仅将其用于2TB:使用S3 Transfer Acceleration将2TB的数据从Backspace上传到S3会更快，并且比来回运送雪球更经济高效在AWS和机架空间之间.如果您有PB级的数据或确实运行缓慢，通常使用滚雪球
If you have a copy of your files locally or if you can plug the snowball device Unless you really have a slow connection from your server, I would not recommend this for 2TB only : it would be faster to upload 2TB of data from backspace to S3 using S3 Transfer Acceleration and most probably more cost effective than shipping the snowball back and forth between AWS and rackspace. snowball are generally used if you have petabytes of data or really run a slow connection
这篇关于将2TB映像从Rackspace迁移到Amazon s3的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
