Message137692
Using your test script fixed (on Python 3.3), I get the following numbers:
Starting multiproc...done in 2.1014609336853027 s.
Starting futures...done in 20.209479093551636 s.
Starting futures "fixed"...done in 2.026125907897949 s.
So there's a 0.2ms overhead per remote function call here (20/(100100000-100000000)).
Can't your chunks() function use itertools.islice()?
Also, the chunksize can't be anything else than 1 by default, since your approach is increasing latency of returning results. |
|
Date |
User |
Action |
Args |
2011-06-05 13:15:44 | pitrou | set | recipients:
+ pitrou, bquinlan, tbrink |
2011-06-05 13:15:44 | pitrou | set | messageid: <1307279744.72.0.238869941318.issue11271@psf.upfronthosting.co.za> |
2011-06-05 13:14:44 | pitrou | link | issue11271 messages |
2011-06-05 13:14:44 | pitrou | create | |
|