python3中的_pickle不适用于大数据保存 [英] _pickle in python3 doesn't work for large data saving
本文介绍了python3中的_pickle不适用于大数据保存的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
我正在尝试应用_pickle
将数据保存到磁盘上.但是调用_pickle.dump
时出现错误
I am trying to apply _pickle
to save data onto disk. But when calling _pickle.dump
, I got an error
OverflowError: cannot serialize a bytes object larger than 4 GiB
使用_pickle
难吗? (对于python2为cPickle
)
Is this a hard limitation to use _pickle
? (cPickle
for python2)
推荐答案
在具有PEP 3154和Pickle 4.0的Python 3.4中不再可用
https://www.python.org/dev/peps/pep-3154/
Not anymore in Python 3.4 which has PEP 3154 and Pickle 4.0
https://www.python.org/dev/peps/pep-3154/
但是您需要说要使用该协议的版本4:
https://docs.python.org/3/library/pickle.html
But you need to say you want to use version 4 of the protocol:
https://docs.python.org/3/library/pickle.html
pickle.dump(d, open("file", 'w'), protocol=4)
这篇关于python3中的_pickle不适用于大数据保存的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文