This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author rbcollins
Recipients michael.foord, rbcollins
Date 2013-06-16.19:32:39
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1371411159.89.0.919313216558.issue18232@psf.upfronthosting.co.za>
In-reply-to
Content
In bug https://bugs.launchpad.net/subunit/+bug/586176 I recorded a user request - that if no tests are found, tools consuming subunit streams should be able to consider that an error.

There is an analogous situation though, which is that if discover returns without error, running the resulting suite is worthless, as it has no tests. This is a bit of a sliding slope - what if discover finds one test when there should be 1000's ? 

Anyhow, filing this because there's been a few times when things have gone completely wrong that it would have helped CI systems detect that. (For instance, the tests package missing entirely, but tests were being scanned in the whole source tree, so no discover level error occurred).

I'm thinking I'll add a '--min-tests=X' parameter to unittest.main, with the semantic that if there are less than X tests executed, the test run will be considered a failure, and folk can set this to 1 for the special case, or any arbitrary figure that they want for larger suites.
History
Date User Action Args
2013-06-16 19:32:39rbcollinssetrecipients: + rbcollins, michael.foord
2013-06-16 19:32:39rbcollinssetmessageid: <1371411159.89.0.919313216558.issue18232@psf.upfronthosting.co.za>
2013-06-16 19:32:39rbcollinslinkissue18232 messages
2013-06-16 19:32:39rbcollinscreate