Author pitrou
Recipients Ramchandra Apte, mark.dickinson, neologix, phillies, pitrou
Date 2011-12-12.16:20:21
SpamBayes Score 4.15167e-11
Marked as misclassified No
Message-id <1323706822.67.0.204022049041.issue13555@psf.upfronthosting.co.za>
In-reply-to
Content
> Couldn't this be linked to #11564 (pickle not 64-bit ready)?

Well, I don't know anything about numpy, but:

>>> 196 * 240000
47040000
>>> 196 * 240000 * 8   # assuming 8 bytes per float
376320000
>>> 2**31
2147483648

So it seems unlikely to be the explanation. After all the report says ">1GB" for the file size, which is still comfortably in the capabilities of a 32-bit module.

Philipp, perhaps you could try to run Python under gdb and try to diagnose where the MemoryError occurs?

Also, posting the disassembly (using pickletools.dis()) of a very small equivalent pickle (e.g. of randn(2,3)) could help us know what is involved.
History
Date User Action Args
2011-12-12 16:20:22pitrousetrecipients: + pitrou, mark.dickinson, neologix, Ramchandra Apte, phillies
2011-12-12 16:20:22pitrousetmessageid: <1323706822.67.0.204022049041.issue13555@psf.upfronthosting.co.za>
2011-12-12 16:20:22pitroulinkissue13555 messages
2011-12-12 16:20:21pitroucreate