This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

classification
Title: asyncio test failure on appveyor
Type: behavior Stage: resolved
Components: asyncio, Tests Versions: Python 3.8
process
Status: closed Resolution: out of date
Dependencies: Superseder:
Assigned To: Nosy List: asvetlov, pablogsal, terry.reedy, xtreak, yselivanov
Priority: normal Keywords:

Created on 2018-12-30 19:47 by terry.reedy, last changed 2022-04-11 14:59 by admin. This issue is now closed.

Messages (4)
msg332757 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2018-12-30 19:47
https://ci.appveyor.com/project/python/cpython/builds/21296354?fullLog=true
Blocked merge.  Passed on Azure Pipeline +- same time. Appveyor re-run passed.  Please disable or weaken the false positive tests.

I will propose a different solution elsewhere, perhaps pydev.
msg332765 - (view) Author: Andrew Svetlov (asvetlov) * (Python committer) Date: 2018-12-30 21:56
Do you mean an environment modification?

1 test altered the execution environment:
    test_asyncio
msg332773 - (view) Author: Terry J. Reedy (terry.reedy) * (Python committer) Date: 2018-12-30 23:07
My position is that tests that are known to occasionally fail independently of any changes in particular PRs should not be allowed to block merging.  In the context of CI, the failure is a lie.

One solution, and the easiest, is to disable the test.  That is all I could do here.

If the module/test author wants to keep running the test, another solution is to change the test so that bogus results are no longer seen as a failure by the test framework.  How depends on the situation.  Perhaps turn particular exceptions into a warning message?

In this case, there are multiple exceptions listed in the log:
OSError: [WinError 6] The handle is invalid x 2
OSError: [WinError 995] The I/O operation has been aborted because of either a thread exit or an application request, leading to
ConnectionResetError: [WinError 995] ...
OSError: [WinError 64] The specified network name is no longer available, leading to another ConnectionResetError.

I don't see am a little surprised at and don't understand the vague end failure message.  So I cannot suggest anything more specific.

The third solution I am thinking of is somehow change the test framework so we can somehow mark 'heisentests' as such and not count know false positives as merge-blocking failures.
msg352152 - (view) Author: Karthikeyan Singaravelan (xtreak) * (Python committer) Date: 2019-09-12 13:06
asyncio tests are stable now and I couldn't find related reports. I guess it's fixed in one of the commits and also AppVeyor is not used anymore. I guess this can be closed as outdated.
History
Date User Action Args
2022-04-11 14:59:09adminsetgithub: 79801
2019-09-12 14:21:56asvetlovsetstatus: open -> closed
resolution: out of date
stage: resolved
2019-09-12 13:06:37xtreaksetnosy: + xtreak
messages: + msg352152
2018-12-30 23:07:18terry.reedysetmessages: + msg332773
2018-12-30 21:56:23asvetlovsetmessages: + msg332765
2018-12-30 19:47:17terry.reedycreate