将数据从Azure VM传输到AWS VM时在Azcopy中使用并行级别 [英] Using parallel-level in azcopy when transferring data from an Azure VM to an AWS VM

问题描述

在Ubuntu 14.04上使用azcopy来提高下载性能时，人们如何精确地利用-parallel-level ?

How does one precisely utilize --parallel-level when using azcopy on Ubuntu 14.04 to speed up download performance?

我选择了 100 的值，但没有任何理由(只是看看会发生什么).我找不到在线相关文档.

I chose a value of 100, but without any reason (just to see what happens). I can't find related documentation online.

我正在使用它将文件从Azure Blob传输到AWS EC2 VM.它只是一个t2.micro实例-但是我将其用于测试目的，一旦掌握了azcopy，我就可以使用更大的实例了.我必须传输约50 GB的数据，大部分是低分辨率图像(即大量文件).

I'm using it to transfer files from an Azure blob to an AWS EC2 VM. It's just a t2.micro instance - however I'm using it for testing purposes and once I get the hang of azcopy, I'm open to using a bigger instance. I have to transfer ~50 GB of data, mostly low res image (i.e. lots of files).

推荐答案

选项-parallel-level 指定并发副本数操作.默认情况下，AzCopy启动一定数量的并发操作以增加数据传输吞吐量.的数量并发操作等于处理器数量的八倍你有.如果您正在低带宽网络上运行AzCopy，您可以为-parallel-level 指定一个较小的数字以避免失败是资源竞争造成的.

Option --parallel-level specifies the number of concurrent copy operations. By default, AzCopy starts a certain number of concurrent operations to increase the data transfer throughput. The number of concurrent operations is equal eight times the number of processors you have. If you are running AzCopy across a low-bandwidth network, you can specify a lower number for --parallel-level to avoid failure caused by resource competition.

在大多数情况下，您无需指定此选项，只有在低带宽网络上运行AzCopy时，您才可以指定较少的数量.

Under most of the cases you don't need to specify this option, only when you're running AzCopy across a low-bandwidth network, you can specify a lower number of this option.

这篇关于将数据从Azure VM传输到AWS VM时在Azcopy中使用并行级别的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！