文件的并行抓取 [英] Parallel fetching of files

问题描述

为了下载文件，我创建一个对象的urlopen（urllib2的类）和块阅读。

In order to download files, I'm creating a urlopen object (urllib2 class) and reading it in chunks.

我想连接到服务器几次并下载该文件在六个不同的会话。这样做，下载速度应该得到更快。许多下载管理器具有此功能。

I would like to connect to the server several times and download the file in six different sessions. Doing that, the download speed should get faster. Many download managers have this feature.

我想过指定我想在每一届下载，并以某种方式处理的同时所有会议文件的一部分。我不知道我怎么能做到这一点。

I thought about specifying the part of file i would like to download in each session, and somehow process all the sessions in the same time. I'm not sure how I can achieve this.

推荐答案

听起来像是你要使用的 HTTP范围可用。

Sounds like you want to use one of the flavors of HTTP Range that are available.

修改更新的链接指向存储RFC的w3.org

edit Updated link to point to the w3.org stored RFC

这篇关于文件的并行抓取的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！