This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author sbromberger
Recipients josh.r, lemburg, ncoghlan, pmoody, r.david.murray, rhettinger, sbromberger, serhiy.storchaka
Date 2014-12-23.23:27:11
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1419377231.95.0.330190455135.issue23103@psf.upfronthosting.co.za>
In-reply-to
Content
Sorry for the additional followup, but I re-ran the test with approximately real-world parameters. In this second test, I created 10 million Foo() instances with random values from 1-2000 (using random.randint). This corresponds to "2000 hosts generating 10 million logs".

Memory use is ~80 MB. Times: CPU times: user 27.5 s, sys: 101 ms, total: 27.6 s Wall time: 27.6 s

For the nonoptimized run (10m instances of 2000 random values):
Memory use is ~1.8GB. Times: CPU times: user 28.2 s, sys: 1.29 s, total: 29.5 s Wall time: 29.5 s
History
Date User Action Args
2014-12-23 23:27:11sbrombergersetrecipients: + sbromberger, lemburg, rhettinger, ncoghlan, pmoody, r.david.murray, serhiy.storchaka, josh.r
2014-12-23 23:27:11sbrombergersetmessageid: <1419377231.95.0.330190455135.issue23103@psf.upfronthosting.co.za>
2014-12-23 23:27:11sbrombergerlinkissue23103 messages
2014-12-23 23:27:11sbrombergercreate