Message243272
Short History:
=============
(Ram Rachum)
What do you think about adding a method: `Executor.filter`?
I was using something like this:
my_things = [thing for thing in things if some_condition(thing)]
But the problem was that `some_condition` took a long time to run waiting on I/O, which is a great candidate for parallelizing with ThreadPoolExecutor. I made it work using `Executor.map` and some improvizing, but it would be nicer if I could do:
with concurrent.futures.ThreadPoolExecutor(100) as executor:
my_things = executor.filter(some_condition, things)
And have the condition run in parallel on all the threads.
(Nick Coughlan)
I think this is sufficiently tricky to get right that it's worth adding filter() as a parallel to the existing map() API. |
|
Date |
User |
Action |
Args |
2015-05-15 15:59:36 | ethan.furman | set | recipients:
+ ethan.furman, paul.moore, bquinlan, pitrou, jnoller, cool-RR, sbt |
2015-05-15 15:59:36 | ethan.furman | set | messageid: <1431705576.49.0.498619980139.issue24195@psf.upfronthosting.co.za> |
2015-05-15 15:59:36 | ethan.furman | link | issue24195 messages |
2015-05-15 15:59:36 | ethan.furman | create | |
|