Message 129859 - Python tracker

➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author	neologix
Recipients	Eric.Wolf, neologix, niemeyer, pitrou, wrobell
Date	2011-03-02.07:55:37
SpamBayes Score	2.7131427e-05
Marked as misclassified	No
Message-id	<AANLkTinYFWszh4ZNYmWRHParAnx_4dosctA5_YUod01A@mail.gmail.com>
In-reply-to	<1299022878.52.0.0620340549407.issue10900@psf.upfronthosting.co.za>

Content
2011/3/2 Eric Wolf <report@bugs.python.org>: > > Eric Wolf <ebwolf@gmail.com> added the comment: > > I just got confirmation that OSM is using pbzip2 to generate these files. So they are multi-stream. At least that gives a final answer but doesn't solve my problem. > At least on Unix, you can use this workaround: - self.fp = bz2.BZ2File(filename,'rb',16384*64) + self.fp = os.popen('bzip2 -cd ' + filename) It's ugly, not as portable, but it should work on any Unix with bzip2 installed (and supporting multi-stream files).

2011/3/2 Eric Wolf <report@bugs.python.org>:
>
> Eric Wolf <ebwolf@gmail.com> added the comment:
>
> I just got confirmation that OSM is using pbzip2 to generate these files. So they are multi-stream. At least that gives a final answer but doesn't solve my problem.
>

At least on Unix, you can use this workaround:

-        self.fp = bz2.BZ2File(filename,'rb',16384*64)
+       self.fp = os.popen('bzip2 -cd ' + filename)

It's ugly, not as portable, but it should work on any Unix with bzip2
installed (and supporting multi-stream files).

History
Date	User	Action	Args
2011-03-02 07:55:40	neologix	set	recipients: + neologix, niemeyer, pitrou, wrobell, Eric.Wolf
2011-03-02 07:55:38	neologix	link	issue10900 messages
2011-03-02 07:55:37	neologix	create