classification
Title: Subinterpreters are not finalized during runtime finalization.
Type: behavior Stage: resolved
Components: Interpreter Core Versions: Python 3.8, Python 3.7
process
Status: closed Resolution: duplicate
Dependencies: Superseder: Lingering subinterpreters should be implicitly cleared on shutdown
View: 36225
Assigned To: Nosy List: eric.snow
Priority: normal Keywords:

Created on 2019-03-29 20:39 by eric.snow, last changed 2019-03-29 21:00 by eric.snow. This issue is now closed.

Messages (1)
msg339144 - (view) Author: Eric Snow (eric.snow) * (Python committer) Date: 2019-03-29 20:39
When using subinterpreters, any that exist when Py_FinalizeEx() is called do not appear to get cleaned up during runtime finalization.  Maybe I've been looking at the code too much and I'm missing something. :)

This really isn't a problem except for embedders that use subinterpreters (where we're leaking memory).  However, even with the "python" executable it can have an impact because the subinterpreters' non-daemon threads will exit later than expected. (see #36469 & #36476)

The solution would be to finalize all subinterpreters at the beginning of Py_FinalizeEx(), right before the call to wait_for_thread_shutdown().  This means calling Py_EndInterpreter() for all the runtime's interpreters (except the main one).  It would also mean setting a flag (_PyRuntime.interpreters.finalizing?) right before that to disallow creation of any more subinterptreters.
History
Date User Action Args
2019-03-29 21:00:35eric.snowsetstatus: open -> closed
superseder: Lingering subinterpreters should be implicitly cleared on shutdown
resolution: duplicate
stage: needs patch -> resolved
2019-03-29 20:39:27eric.snowcreate