This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

classification
Title: test_multiprocessing_spawn: Dangling processes: {} on AMD64 RHEL7 Refleaks 3.7
Type: Stage: resolved
Components: Tests Versions: Python 3.7
process
Status: closed Resolution: out of date
Dependencies: Superseder:
Assigned To: Nosy List: vstinner
Priority: normal Keywords:

Created on 2019-10-11 13:01 by vstinner, last changed 2022-04-11 14:59 by admin. This issue is now closed.

Messages (6)
msg354447 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2019-10-11 13:01
AMD64 RHEL7 Refleaks 3.7:
https://buildbot.python.org/all/#/builders/311/builds/22

0:15:09 load avg: 12.21 [311/416/1] test_multiprocessing_spawn failed (env changed) (14 min 39 sec) -- running: test_shelve (5 min 11 sec), test_sqlite (1 min), test_cmd_line_script (1 min 26 sec), test_asyncio (3 min 13 sec), test_io (8 min 6 sec), test_pickle (53.8 sec), test_concurrent_futures (12 min 52 sec)
beginning 6 repetitions
123456
....Warning -- Dangling processes: {<SpawnProcess(QueueManager-1576, stopped)>}
Warning -- Dangling processes: {<SpawnProcess(QueueManager-1576, stopped)>}
.Warning -- Dangling processes: {<SpawnProcess(QueueManager-1788, started)>}
.
msg355147 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2019-10-22 20:09
New failure on AMD64 RHEL7 Refleaks 3.7:

https://buildbot.python.org/all/#/builders/311/builds/34

0:18:35 load avg: 2.24 [414/416/1] test_multiprocessing_spawn failed (env changed) (13 min 55 sec) -- running: test_concurrent_futures (8 min 43 sec), test_asyncio (5 min 48 sec)
beginning 6 repetitions
123456
.Warning -- Dangling processes: {<SpawnProcess(QueueManager-525, stopped)>}
.....
msg356630 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2019-11-14 22:25
AMD64 RHEL7 LTO + PGO 3.x:
https://buildbot.python.org/all/#/builders/258/builds/227

...
test_bounded_semaphore (test.test_multiprocessing_spawn.WithProcessesTestSemaphore) ... ok
test_semaphore (test.test_multiprocessing_spawn.WithProcessesTestSemaphore) ... ok
test_timeout (test.test_multiprocessing_spawn.WithProcessesTestSemaphore) ... ok
test_copy (test.test_multiprocessing_spawn.WithProcessesTestSharedCTypes) ... ok
test_sharedctypes (test.test_multiprocessing_spawn.WithProcessesTestSharedCTypes) ... ok
test_synchronize (test.test_multiprocessing_spawn.WithProcessesTestSharedCTypes) ... ok
test_shared_memory_ShareableList_basics (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_ShareableList_pickling (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_SharedMemoryManager_basics (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_SharedMemoryManager_reuses_resource_tracker (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_SharedMemoryServer_ignores_sigint (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_across_processes (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_basics (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
test_shared_memory_cleaned_after_process_termination (test.test_multiprocessing_spawn.WithProcessesTestSharedMemory) ... ok
Warning -- Dangling processes: {<SpawnProcess name='SharedMemoryManager-314' pid=29989 parent=17707 started>}
msg356632 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2019-11-14 22:35
x86 Windows7 3.x:
https://buildbot.python.org/all/#/builders/58/builds/3223

...
test_dict_proxy_nested (test.test_multiprocessing_spawn.WithManagerTestContainers) ... ok
test_list (test.test_multiprocessing_spawn.WithManagerTestContainers) ... ok
test_list_iter (test.test_multiprocessing_spawn.WithManagerTestContainers) ... ok
test_list_proxy_in_list (test.test_multiprocessing_spawn.WithManagerTestContainers) ... ok
test_namespace (test.test_multiprocessing_spawn.WithManagerTestContainers) ... ok
test_event (test.test_multiprocessing_spawn.WithManagerTestEvent) ... ok
test_lock (test.test_multiprocessing_spawn.WithManagerTestLock) ... ok
test_lock_context (test.test_multiprocessing_spawn.WithManagerTestLock) ... ok
test_rlock (test.test_multiprocessing_spawn.WithManagerTestLock) ... ok
test_rapid_restart (test.test_multiprocessing_spawn.WithManagerTestManagerRestart) ... ok
Warning -- multiprocessing.Manager still has [<SpawnProcess name='SyncManager-116' pid=2420 parent=3512 started>] active children after 5.256999999983236 seconds
msg361579 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2020-02-07 10:55
I didn't see this issue recently, I close the issue.
msg376622 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2020-09-09 07:48
Issue seen on x86 Windows7 3.8:
https://buildbot.python.org/all/#/builders/270/builds/30

0:52:12 load avg: 6.48 [367/423/1] test_multiprocessing_spawn failed (env changed) (12 min 32 sec)
Warning -- Dangling processes: {<SpawnProcess name='QueueManager-205' pid=1060 parent=2800 started>}

I keep the issue closed since I spent a lot of time trying to reproduce it, and I failed. The failure looks rare and really hard to reproduce.
History
Date User Action Args
2022-04-11 14:59:21adminsetgithub: 82628
2020-09-09 07:48:46vstinnersetmessages: + msg376622
2020-02-07 10:55:35vstinnersetstatus: open -> closed
resolution: out of date
messages: + msg361579

stage: resolved
2019-11-14 22:35:03vstinnersetmessages: + msg356632
2019-11-14 22:25:01vstinnersetmessages: + msg356630
2019-10-22 20:09:03vstinnersetmessages: + msg355147
2019-10-11 13:01:43vstinnercreate