classification
Title: Simplifications in concurrent.futures
Type: resource usage Stage: resolved
Components: Library (Lib) Versions: Python 3.2, Python 3.3
process
Status: closed Resolution: fixed
Dependencies: Superseder:
Assigned To: Nosy List: bquinlan, pitrou, python-dev
Priority: normal Keywords: patch

Created on 2011-04-09 23:37 by pitrou, last changed 2011-04-12 16:01 by pitrou. This issue is now closed.

Files
File name Uploaded Description Edit
cfsimplify.patch pitrou, 2011-04-09 23:37 review
Messages (4)
msg133435 - (view) Author: Antoine Pitrou (pitrou) * (Python committer) Date: 2011-04-09 23:37
Queue.get(block=True) cannot raise EmptyError, meaning there's some dead code that we can remove.
msg133436 - (view) Author: Antoine Pitrou (pitrou) * (Python committer) Date: 2011-04-09 23:45
A further optimization would be to use a SimpleQueue (from multiprocessing.queues) for the result_queue in the ProcessPoolExecutor. A SimpleQueue is much more light-weight than a normal Queue, which has a bunch of additional locks and a dedicated thread.
msg133584 - (view) Author: Roundup Robot (python-dev) Date: 2011-04-12 15:50
New changeset bfc586c558ed by Antoine Pitrou in branch '3.2':
Issue #11815: Remove dead code in concurrent.futures (since a blocking Queue
http://hg.python.org/cpython/rev/bfc586c558ed

New changeset eb751e3cb753 by Antoine Pitrou in branch 'default':
Issue #11815: Remove dead code in concurrent.futures (since a blocking Queue
http://hg.python.org/cpython/rev/eb751e3cb753
msg133587 - (view) Author: Roundup Robot (python-dev) Date: 2011-04-12 15:58
New changeset c26d015cbde8 by Antoine Pitrou in branch 'default':
Issue #11815: Use a light-weight SimpleQueue for the result queue in concurrent.futures.ProcessPoolExecutor.
http://hg.python.org/cpython/rev/c26d015cbde8
History
Date User Action Args
2011-04-12 16:01:33pitrousetstatus: open -> closed
resolution: fixed
stage: patch review -> resolved
2011-04-12 15:58:16python-devsetmessages: + msg133587
2011-04-12 15:50:28python-devsetnosy: + python-dev
messages: + msg133584
2011-04-09 23:45:13pitrousetmessages: + msg133436
2011-04-09 23:37:46pitroucreate