Message48712
Logged In: YES
user_id=747439
Actually, the slow speed in that specific circumstance has
nothing to do with the fact that it uses a string style
buffer, which should always be faster than what it used
before (an array of strings that was constantly appended to.)
The problem with that particular file is how the
gzip.readline function auto-optimizes it's read size.
if readsize > self.min_readsize:
self.min_readsize = readsize
So, it optimizes it's read size to the length of the largest
line that it has seen so far. The assumption is that
gzipped files are generally going to be a bunch of lines of
similar length, and not wildly differing length. |
|
Date |
User |
Action |
Args |
2007-08-23 15:43:49 | admin | link | issue1281707 messages |
2007-08-23 15:43:49 | admin | create | |
|