This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author arhadthedev
Recipients arhadthedev, serhiy.storchaka, sobolevn
Date 2021-11-04.10:33:32
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1636022012.89.0.125023751884.issue45672@roundup.psfhosted.org>
In-reply-to
Content
> What is the problem actually?

I guess, Lib/test/test_typing.py has gaps in test coverage. The report provided by the OP is a list of random modifications that corrupt logic of Lib/typing.py but still pass all test cases.

Mutation testing is validation of tests themselves. A mutation framework takes code that the validated test actually tests, makes some random but syntactically correct change, and runs the test that should fail some assertion here. If so, the code is rolled back and another mutation attempt is done. If the validated test catches all thousands of such attempts, we can consider it a reliable safety net for any refactoring. Otherwise, we open the report and start to supplement tests and probably package documentation to cover missed scenarios.

Actually, something like cosmic-ray may be added into a CI pipeline, but I suspect that preliminary fixing of test coverage will be a task of the OP themselves. There are no people with enough free time to sit down and sort all tests out, being overwhelmed with new language features, bug fixing and already pending epics of, for example, closing Python internals from extension modules to stop constantly breaking backward compatibility, or fixing startup modules to properly freeze them for speedup of Python launching.
History
Date User Action Args
2021-11-04 10:33:32arhadthedevsetrecipients: + arhadthedev, serhiy.storchaka, sobolevn
2021-11-04 10:33:32arhadthedevsetmessageid: <1636022012.89.0.125023751884.issue45672@roundup.psfhosted.org>
2021-11-04 10:33:32arhadthedevlinkissue45672 messages
2021-11-04 10:33:32arhadthedevcreate