Message289894
The various workers in multiprocessing.Pool keep a reference to the last encountered task or task result. This means some data may be kept alive even after the caller is done with them, as long as some other task doesn't clobber the relevant variables.
Specifically, Pool._handle_tasks(), Pool._handle_results() and the toplevel worker() function fail to clear references at the end of each loop.
Originally reported at https://github.com/dask/distributed/issues/956 |
|
Date |
User |
Action |
Args |
2017-03-20 18:14:14 | pitrou | set | recipients:
+ pitrou, sbt, davin |
2017-03-20 18:14:14 | pitrou | set | messageid: <1490033654.49.0.302428807584.issue29861@psf.upfronthosting.co.za> |
2017-03-20 18:14:14 | pitrou | link | issue29861 messages |
2017-03-20 18:14:14 | pitrou | create | |
|