This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author phillies
Recipients phillies
Date 2011-12-08.12:52:02
SpamBayes Score 5.10504e-07
Marked as misclassified No
Message-id <>
When I try to load a large file (>1GB) cPickle crashes with a MemoryError:
Traceback (most recent call last):
  File "/tmp/", line 8, in <module>
    A2 = cPickle.load(f2)
MemoryError contains following code:
import numpy as np
import cPickle
A = np.random.randn(196,240000)
f = open('test.pydat', 'w')
f2 = open('test.pydat', 'rb')
A2 = cPickle.load(f2)

cPickle 1.71
python 2.7.2
Ubuntu 11.10 amd64

Memory is not an issue as a) pickle works nicely and b) my computer has 122GB free RAM
Date User Action Args
2011-12-08 12:52:03philliessetrecipients: + phillies
2011-12-08 12:52:03philliessetmessageid: <>
2011-12-08 12:52:02phillieslinkissue13555 messages
2011-12-08 12:52:02philliescreate