Message212250
bz2.BZ2File does not decompress a file (see attached) correctly. This file can be decompressed and compressed via stadard unix tools (bzip2 and bunzip2) without change.
Consider ...
$ python
Python 2.7.6 (default, Dec 7 2013, 22:49:16)
[GCC 4.8.2] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import bz2
>>> import hashlib
>>> len(bz2.BZ2File("example-file.csv.bz2", "r", 0).read())
900000
>>> hashlib.md5(bz2.BZ2File("example-file.csv.bz2", "r", 0).read()).hexdigest()
'e2d4ce212a040c879cb256f88c9faab9'
>>> len(bz2.BZ2File("example-file.csv.bz2", "rb", 0).read())
900000
>>> hashlib.md5(bz2.BZ2File("example-file.csv.bz2", "rb", 0).read()).hexdigest()
'e2d4ce212a040c879cb256f88c9faab9'
>>>
It looks like bz2 is not dealing with the second block. This is not the first file I've come across that has this problem, and initially I thought it was the file not the module. I've attached a copy of the file.
I use gentoo on a 64bit intel core i5. |
|
Date |
User |
Action |
Args |
2014-02-26 11:59:20 | James.Dominy | set | recipients:
+ James.Dominy |
2014-02-26 11:59:20 | James.Dominy | set | messageid: <1393415960.86.0.411484359826.issue20781@psf.upfronthosting.co.za> |
2014-02-26 11:59:20 | James.Dominy | link | issue20781 messages |
2014-02-26 11:59:20 | James.Dominy | create | |
|