Python tarfile比Linux命令慢 [英] Python tarfile slow than Linux command
问题描述
我尝试了另一种方法来压缩文件夹。我的理解是,Python内置模块始终比subprocess.call( Linux command)更快。
但是我只是做了一些演示。 tarfile模块比subprocess.call( tar)慢。有人可以向我解释吗?
I tried the different way to zip folder.My understanding is that Python built-in module always faster than subprocess.call("Linux command"). But I just did some demo. The tarfile module is slow than subprocess.call("tar").Can someone explain it to me?
#!/usr/bin/python
import os
import time
import tarfile
import subprocess
tStart1 = time.time()
TestFolder = ["Jack", "Robin"]
for folder in TestFolder:
name = "/mnt/ShareDrive/Share/ExistingUsers/"+folder
path = "/mnt/TEST2/"
tar = tarfile.open(path+folder+".tar.gz", "w:gz")
tar.add(name)
tar.close()
tEnd1 = time.time()
time.sleep(2)
tStart2 = time.time()
for folder in TestFolder:
path = "/mnt/TEST1/"
subprocess.call(["tar", "zcvf", path+folder+".tar.gz", "-P", "/mnt/ShareDrive/Share/ExistingUsers/"+folder])
tEnd2 = time.time()
print "The module cost %f sec" % (tEnd1 - tStart1)
print "The subprocess cost %f sec" % (tEnd2 - tStart2)
tarfile模块花费63秒。
子进程仅花费32秒。
The tarfile module cost 63 sec. The subprocess cost only 32 sec.
两个文件夹的总大小为433 MB
The total size of two folders is 433 MB
推荐答案
tar
用C编写。 tarfile
模块是纯Python实现焦油处理。模块不可能比命令快。
tar
is written in C. The tarfile
module is a pure Python implementation of tar handling. There is no way that the module will be faster than the command.
这篇关于Python tarfile比Linux命令慢的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!