This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

classification
Title: forked process in multiprocessing does not honour atexit
Type: behavior Stage:
Components: Library (Lib) Versions: Python 3.9
process
Status: open Resolution:
Dependencies: Superseder:
Assigned To: pablogsal Nosy List: davin, gaborjbernat, pablogsal, pitrou
Priority: normal Keywords:

Created on 2020-02-18 11:35 by gaborjbernat, last changed 2022-04-11 14:59 by admin.

Messages (1)
msg362197 - (view) Author: gaborjbernat (gaborjbernat) * Date: 2020-02-18 11:35
I've talked with Pablo about this in person, and as advised opening the issue here now. 

I've discovered that forked processes do not honour atexit registrations. See the following example code:

from multiprocessing import Process, set_start_method
import time
import os
import atexit


def cleanup():
    print(f"cleanup {os.getpid()}")


atexit.register(cleanup)


def run():
    time.sleep(0.1)
    print(f"process done {os.getpid()}")
    # atexit._run_exitfuncs()


if __name__ == "__main__":
    set_start_method("fork")
    process = Process(target=run)
    process.start()
    process.join()
    print("app finished")

In case of a forked process childs the atexit is never executed (note it works if I ran them manually at the end of the child process; so they're registered correctly). Switching to spawn method makes it work as expected. The behaviour is the same even if you call register within the child process (as opposed to being inherited during forking). Also found this StackOverflow question that mentions this https://stackoverflow.com/a/26476585. At the very least the documentation should explain this; though I'd expect atexit to be called before finalization of the fork processes (assuming the child process exits with 0 exit code). d
History
Date User Action Args
2022-04-11 14:59:26adminsetgithub: 83856
2020-02-18 12:27:31pablogsalsettype: behavior
components: + Library (Lib)
versions: + Python 3.9
2020-02-18 12:27:16pablogsalsetassignee: pablogsal
2020-02-18 11:35:55gaborjbernatcreate