Message270866
Here is a possible patch for 2.7. To fix everything on 2.7 I changed the module to accept input buffers over 2 GiB by enabling PY_SSIZE_T_CLEAN. As a consequence, the patch also includes ports of Nadeem Vawda’s adler32(), crc32() changes from Issue 10276, and my tests from Issue 25626.
I have only tested this on computers with less than 4 GiB of memory. I can test compression and checksums with more input by using a sparse memory map, but not decompression.
fm = open("5GiB.sparse", "w+b")
fm.truncate(5 * 2**30)
m = mmap(fm.fileno(), 0)
z = compress(m) |
|
Date |
User |
Action |
Args |
2016-07-20 11:49:40 | martin.panter | set | recipients:
+ martin.panter, nadeem.vawda, Jack.McCracken, xiang.zhang, Klamann |
2016-07-20 11:49:38 | martin.panter | set | messageid: <1469015378.07.0.764788943746.issue27130@psf.upfronthosting.co.za> |
2016-07-20 11:49:38 | martin.panter | link | issue27130 messages |
2016-07-20 11:49:33 | martin.panter | create | |
|