This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author steven.daprano
Recipients eric.smith, poostenr, steven.daprano, ubehera, vstinner
Date 2016-01-15.10:43:29
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <20160115104312.GM10854@ando.pearwood.info>
In-reply-to <1452844599.03.0.391742164413.issue26118@psf.upfronthosting.co.za>
Content
On Fri, Jan 15, 2016 at 07:56:39AM +0000, poostenr wrote:
> As I did more testing I noticed that appending data to the file slowed 
> down. The file grew initially with ~30-50KB increments and around 
> 500KB it had slowed down to ~3-5KB/s, until around 1MB the file grew 
> at ~1KB/s.

How are you appending to the file? In the code snippets below you merely 
say "append s to file", which is not Python code and could hide a 
multitude of sins. You're asking us to diagnose slow performance in code 
we can't see.

Or perhaps your disk is just badly fragmented, and as the file gets 
bigger, performance gets worse.

> Did conv.escape_string() change something about columnvalue

I don't know. What's conv.escape_string? Where does it come from, and 
what does it do? Again, you're asking us to diagnose code we can't see.

Perhaps you should run the profiler and see where your code is spending 
most of its time.
History
Date User Action Args
2016-01-15 10:43:29steven.dapranosetrecipients: + steven.daprano, vstinner, eric.smith, poostenr, ubehera
2016-01-15 10:43:29steven.dapranolinkissue26118 messages
2016-01-15 10:43:29steven.dapranocreate