msg299392 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-07-28 15:02 |
It's just a warning, but later I would like to make a buildbot fail on such warnings, so I would like to first fix all these warnings.
http://buildbot.python.org/all/builders/AMD64%20Windows8.1%20Refleaks%203.x/builds/59/steps/test/logs/stdio
0:46:17 [119/406] test_multiprocessing_spawn passed (2667 sec) -- running: test_asyncio (290 sec), test_userstring (54 sec), test_regrtest (471 sec)
beginning 6 repetitions
123456
...Warning -- Dangling processes: {<Process(Process-1235, stopped daemon)>}
...
|
msg300118 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-10 21:33 |
With the commit 957d0e9b59bd27ca7c473560634d8b5dbe66338c (bpo-26762), _test_multiprocessing now fails with ENV_CHANGED if a warning is emitted. It allowed to catch a warning on x86-64 El Capitan 3.x:
http://buildbot.python.org/all/builders/x86-64%20El%20Capitan%203.x/builds/581/steps/test/logs/stdio
test_enable_logging (test.test_multiprocessing_spawn.WithProcessesTestLogging) ... ok
test_level (test.test_multiprocessing_spawn.WithProcessesTestLogging) ... ok
test_rapid_restart (test.test_multiprocessing_spawn.WithProcessesTestManagerRestart) ... ok
Warning -- Dangling processes: {<Process(Process-181, stopped daemon)>}
test_access (test.test_multiprocessing_spawn.WithProcessesTestPicklingConnections) ... ok
test_pickling (test.test_multiprocessing_spawn.WithProcessesTestPicklingConnections) ... ok
test_boundaries (test.test_multiprocessing_spawn.WithProcessesTestPoll) ... ok
|
msg300122 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-10 21:43 |
Another warning on x86 Tiger 3.x:
http://buildbot.python.org/all/builders/x86%20Tiger%203.x/builds/1043/steps/test/logs/stdio
test_rapid_restart (test.test_multiprocessing_forkserver.WithProcessesTestManagerRestart) ... ok
Warning -- Dangling processes: {<Process(Process-181, stopped daemon)>}
test_access (test.test_multiprocessing_forkserver.WithProcessesTestPicklingConnections) ... ok
|
msg300137 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-10 23:58 |
See also bpo-30846.
|
msg300334 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 08:45 |
I marked bpo-30846 as a duplicate of this issue. Copy of its message:
http://buildbot.python.org/all/builders/AMD64%20Debian%20PGO%203.6/builds/517/steps/test/logs/stdio
======================================================================
ERROR: test_rapid_restart (test.test_multiprocessing_fork.WithProcessesTestManagerRestart)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/var/lib/buildbot/slaves/enable-optimizations-bot/3.6.gps-debian-profile-opt.nondebug/build/Lib/test/_test_multiprocessing.py", line 2410, in test_rapid_restart
manager.start()
File "/var/lib/buildbot/slaves/enable-optimizations-bot/3.6.gps-debian-profile-opt.nondebug/build/Lib/multiprocessing/managers.py", line 517, in start
self._address = reader.recv()
File "/var/lib/buildbot/slaves/enable-optimizations-bot/3.6.gps-debian-profile-opt.nondebug/build/Lib/multiprocessing/connection.py", line 250, in recv
buf = self._recv_bytes()
File "/var/lib/buildbot/slaves/enable-optimizations-bot/3.6.gps-debian-profile-opt.nondebug/build/Lib/multiprocessing/connection.py", line 407, in _recv_bytes
buf = self._recv(4)
File "/var/lib/buildbot/slaves/enable-optimizations-bot/3.6.gps-debian-profile-opt.nondebug/build/Lib/multiprocessing/connection.py", line 383, in _recv
raise EOFError
EOFError
(...)
Re-running test 'test_multiprocessing_fork' in verbose mode
(...)
test_rapid_restart (test.test_multiprocessing_fork.WithManagerTestManagerRestart) ... ok
|
msg300337 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 08:48 |
AppVeyor:
https://ci.appveyor.com/project/python/cpython/build/3.7.0a0.5341
test_lock_context (test.test_multiprocessing_spawn.WithProcessesTestLock) ... ok
test_rlock (test.test_multiprocessing_spawn.WithProcessesTestLock) ... ok
test_enable_logging (test.test_multiprocessing_spawn.WithProcessesTestLogging) ... ok
test_level (test.test_multiprocessing_spawn.WithProcessesTestLogging) ... ok
test_rapid_restart (test.test_multiprocessing_spawn.WithProcessesTestManagerRestart) ... ok
Warning -- Dangling processes: {<Process(Process-174, stopped daemon)>}
test_access (test.test_multiprocessing_spawn.WithProcessesTestPicklingConnections) ... ok
|
msg300343 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 09:34 |
http://buildbot.python.org/all/builders/x86-64%20El%20Capitan%203.x/builds/590/steps/test/logs/stdio
test_enable_logging (test.test_multiprocessing_forkserver.WithProcessesTestLogging) ... ok
test_level (test.test_multiprocessing_forkserver.WithProcessesTestLogging) ... ok
test_rapid_restart (test.test_multiprocessing_forkserver.WithProcessesTestManagerRestart) ... ok
Warning -- Dangling processes: {<Process(Process-181, stopped daemon)>}
test_access (test.test_multiprocessing_forkserver.WithProcessesTestPicklingConnections) ... ok
test_pickling (test.test_multiprocessing_forkserver.WithProcessesTestPicklingConnections) ... ok
(...)
test_level (test.test_multiprocessing_spawn.WithProcessesTestLogging) ... ok
test_rapid_restart (test.test_multiprocessing_spawn.WithProcessesTestManagerRestart) ... ok
Warning -- Dangling processes: {<Process(Process-181, stopped daemon)>}
test_access (test.test_multiprocessing_spawn.WithProcessesTestPicklingConnections) ... ok
test_pickling (test.test_multiprocessing_spawn.WithProcessesTestPicklingConnections) ... ok
|
msg300345 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 10:46 |
New changeset 17657bb9458ff8f8804b7637d61686a68f4b9471 by Victor Stinner in branch 'master':
bpo-31069, test_multiprocessing: Fix dangling process (#3103)
https://github.com/python/cpython/commit/17657bb9458ff8f8804b7637d61686a68f4b9471
|
msg300348 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 11:14 |
New changeset 78c66a641a0d4fe61356ebfae8772e4fae24dcb7 by Victor Stinner in branch '3.6':
bpo-31069, test_multiprocessing: Fix dangling process (#3103) (#3104)
https://github.com/python/cpython/commit/78c66a641a0d4fe61356ebfae8772e4fae24dcb7
|
msg300349 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 11:14 |
New changeset 883520a846d87f01a14636978cfa9cee1ecc07c1 by Victor Stinner in branch '2.7':
bpo-31069, test_multiprocessing: Fix dangling process (#3103) (#3105)
https://github.com/python/cpython/commit/883520a846d87f01a14636978cfa9cee1ecc07c1
|
msg300350 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-08-16 11:17 |
Ok, the main bug should have been fixed. I will reopen it if it's not the case, or open a new issue if a second bug is seen on buildbots.
|
msg301339 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-09-05 17:13 |
Too bad, the bug is not dead, I reopen the issue.
http://buildbot.python.org/all/builders/AMD64%20FreeBSD%2010.x%20Shared%203.x/builds/800/steps/test/logs/stdio
test_rlock (test.test_multiprocessing_forkserver.WithThreadsTestLock) ... ok
test_rapid_restart (test.test_multiprocessing_forkserver.WithThreadsTestManagerRestart) ... ok
Warning -- Dangling processes: {<ForkServerProcess(QueueManager-465, stopped)>}
test_boundaries (test.test_multiprocessing_forkserver.WithThreadsTestPoll) ... ok
test_dont_merge (test.test_multiprocessing_forkserver.WithThreadsTestPoll) ... ok
|
msg301969 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-09-12 16:03 |
Failure on AMD64 FreeBSD 10.x Shared 3.x:
http://buildbot.python.org/all/builders/AMD64%20FreeBSD%2010.x%20Shared%203.x/builds/868/steps/test/logs/stdio
...
test_map_chunksize (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_map_handle_iterable_exception (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_map_no_failfast (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_map_unplicklable (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... skipped 'test not appropriate for threads'
test_release_task_refs (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_starmap (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_starmap_async (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_terminate (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_traceback (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
test_wrapped_exception (test.test_multiprocessing_forkserver.WithThreadsTestPool) ... ok
Warning -- Dangling threads: {<DummyProcess(Thread-158, started daemon 34461984768)>}
test_active_children (test.test_multiprocessing_forkserver.WithThreadsTestProcess) ... ok
|
msg301977 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-09-12 17:07 |
On the FreeBSD 10 buildbot, I ran test_multiprocessing_forkserver during 10 minutes twice in two terminals, while running "./python -m test -j2 -r -F" twice in two other terminals to stress the machine. I failed to reproduce the "Warning -- Dangling threads: {<DummyProcess(Thread-158, started daemon 34461984768)>}" warning.
|
msg302061 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-09-13 12:21 |
New test_multiprocessing_fork failure on AMD64 FreeBSD CURRENT Debug 3.x:
http://buildbot.python.org/all/builders/AMD64%20FreeBSD%20CURRENT%20Debug%203.x/builds/869/steps/test/logs/stdio
(...)
test_traceback (test.test_multiprocessing_fork.WithThreadsTestPool) ... ok
test_wrapped_exception (test.test_multiprocessing_fork.WithThreadsTestPool) ... ok
Warning -- Dangling threads: {<DummyProcess(Thread-158, started daemon 34496780800)>}
test_active_children (test.test_multiprocessing_fork.WithThreadsTestProcess) ... ok
(...)
|
msg302273 - (view) |
Author: STINNER Victor (vstinner) * |
Date: 2017-09-15 16:40 |
I continued the effort to fix all "dangling threads/processes" in bpo-31234, so I close this issue.
|
|
Date |
User |
Action |
Args |
2022-04-11 14:58:49 | admin | set | github: 75252 |
2017-09-15 16:40:24 | vstinner | set | status: open -> closed resolution: fixed messages:
+ msg302273
|
2017-09-13 12:21:16 | vstinner | set | messages:
+ msg302061 |
2017-09-12 17:07:00 | vstinner | set | messages:
+ msg301977 |
2017-09-12 16:03:04 | vstinner | set | messages:
+ msg301969 |
2017-09-05 17:13:26 | vstinner | set | status: closed -> open resolution: fixed -> (no value) messages:
+ msg301339
|
2017-08-16 11:17:45 | vstinner | set | status: open -> closed resolution: fixed messages:
+ msg300350
stage: resolved |
2017-08-16 11:14:42 | vstinner | set | messages:
+ msg300349 |
2017-08-16 11:14:40 | vstinner | set | messages:
+ msg300348 |
2017-08-16 10:48:19 | vstinner | set | pull_requests:
+ pull_request3144 |
2017-08-16 10:46:54 | vstinner | set | pull_requests:
+ pull_request3143 |
2017-08-16 10:46:06 | vstinner | set | messages:
+ msg300345 |
2017-08-16 10:28:38 | vstinner | set | pull_requests:
+ pull_request3142 |
2017-08-16 09:34:49 | vstinner | set | messages:
+ msg300343 |
2017-08-16 09:34:29 | vstinner | set | title: test_multiprocessing_spawn leaks a dangling process -> test_multiprocessing_spawn and test_multiprocessing_forkserver leak dangling processes |
2017-08-16 08:48:56 | vstinner | set | messages:
+ msg300337 |
2017-08-16 08:46:19 | vstinner | link | issue30846 superseder |
2017-08-16 08:45:58 | vstinner | set | messages:
+ msg300334 |
2017-08-10 23:58:17 | vstinner | set | messages:
+ msg300137 |
2017-08-10 23:57:39 | vstinner | set | title: test_multiprocessing_spawn leaked a dangling process -> test_multiprocessing_spawn leaks a dangling process |
2017-08-10 21:43:54 | vstinner | set | messages:
+ msg300122 |
2017-08-10 21:33:45 | vstinner | set | title: test_multiprocessing_spawn leaked a process on AMD64 Windows8.1 Refleaks 3.x -> test_multiprocessing_spawn leaked a dangling process |
2017-08-10 21:33:31 | vstinner | set | messages:
+ msg300118 |
2017-07-28 15:02:05 | vstinner | create | |