Message258287
On Fri, Jan 15, 2016 at 07:56:39AM +0000, poostenr wrote:
> As I did more testing I noticed that appending data to the file slowed
> down. The file grew initially with ~30-50KB increments and around
> 500KB it had slowed down to ~3-5KB/s, until around 1MB the file grew
> at ~1KB/s.
How are you appending to the file? In the code snippets below you merely
say "append s to file", which is not Python code and could hide a
multitude of sins. You're asking us to diagnose slow performance in code
we can't see.
Or perhaps your disk is just badly fragmented, and as the file gets
bigger, performance gets worse.
> Did conv.escape_string() change something about columnvalue
I don't know. What's conv.escape_string? Where does it come from, and
what does it do? Again, you're asking us to diagnose code we can't see.
Perhaps you should run the profiler and see where your code is spending
most of its time. |
|
Date |
User |
Action |
Args |
2016-01-15 10:43:29 | steven.daprano | set | recipients:
+ steven.daprano, vstinner, eric.smith, poostenr, ubehera |
2016-01-15 10:43:29 | steven.daprano | link | issue26118 messages |
2016-01-15 10:43:29 | steven.daprano | create | |
|