This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author martin.panter
Recipients Jack.McCracken, Klamann, martin.panter, nadeem.vawda, xiang.zhang
Date 2016-07-20.11:49:33
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1469015378.07.0.764788943746.issue27130@psf.upfronthosting.co.za>
In-reply-to
Content
Here is a possible patch for 2.7. To fix everything on 2.7 I changed the module to accept input buffers over 2 GiB by enabling PY_SSIZE_T_CLEAN. As a consequence, the patch also includes ports of Nadeem Vawda’s adler32(), crc32() changes from Issue 10276, and my tests from Issue 25626.

I have only tested this on computers with less than 4 GiB of memory. I can test compression and checksums with more input by using a sparse memory map, but not decompression.

fm = open("5GiB.sparse", "w+b")
fm.truncate(5 * 2**30)
m = mmap(fm.fileno(), 0)
z = compress(m)
History
Date User Action Args
2016-07-20 11:49:40martin.pantersetrecipients: + martin.panter, nadeem.vawda, Jack.McCracken, xiang.zhang, Klamann
2016-07-20 11:49:38martin.pantersetmessageid: <1469015378.07.0.764788943746.issue27130@psf.upfronthosting.co.za>
2016-07-20 11:49:38martin.panterlinkissue27130 messages
2016-07-20 11:49:33martin.pantercreate