This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author dlukes
Recipients dlukes, docs@python, pitrou
Date 2017-12-20.11:21:23
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1513768884.04.0.213398074469.issue32306@psf.upfronthosting.co.za>
In-reply-to
Content
Hi Antoine,

Thanks for the response! :) I think the problem lies in the line immediately preceding the code you've posted:

```
fs = [self.submit(fn, *args) for args in zip(*iterables)]
```

In other words, all the jobs are first submitted and their futures stored in a list, which is then iterated over. This approach obviously breaks down when there is a great number of jobs, or when it's part of a pipeline meant for processing jobs continuously as they come.
History
Date User Action Args
2017-12-20 11:21:24dlukessetrecipients: + dlukes, pitrou, docs@python
2017-12-20 11:21:24dlukessetmessageid: <1513768884.04.0.213398074469.issue32306@psf.upfronthosting.co.za>
2017-12-20 11:21:24dlukeslinkissue32306 messages
2017-12-20 11:21:23dlukescreate