Author pitrou
Recipients davin, pitrou, sbt
Date 2017-03-20.18:14:14
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1490033654.49.0.302428807584.issue29861@psf.upfronthosting.co.za>
In-reply-to
Content
The various workers in multiprocessing.Pool keep a reference to the last encountered task or task result.  This means some data may be kept alive even after the caller is done with them, as long as some other task doesn't clobber the relevant variables.

Specifically, Pool._handle_tasks(), Pool._handle_results() and the toplevel worker() function fail to clear references at the end of each loop.

Originally reported at https://github.com/dask/distributed/issues/956
History
Date User Action Args
2017-03-20 18:14:14pitrousetrecipients: + pitrou, sbt, davin
2017-03-20 18:14:14pitrousetmessageid: <1490033654.49.0.302428807584.issue29861@psf.upfronthosting.co.za>
2017-03-20 18:14:14pitroulinkissue29861 messages
2017-03-20 18:14:14pitroucreate