Author patriki
Recipients patriki
Date 2016-12-22.11:56:14
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1482407776.18.0.223230024277.issue29048@psf.upfronthosting.co.za>
In-reply-to
Content
I checkout the latest tip from scratch.

When i run the tests i get the following results:
% ./python -m test -j
[...]
376 tests OK.

1 test altered the execution environment:
    test_site

27 tests skipped:
    test_bz2 test_ctypes test_curses test_dbm_gnu test_dbm_ndbm
    test_devpoll test_gdb test_kqueue test_lzma test_msilib
    test_ossaudiodev test_readline test_smtpnet test_socketserver
    test_sqlite test_startfile test_timeout test_tix test_tk
    test_ttk_guionly test_urllib2net test_urllibnet test_winconsoleio
    test_winreg test_winsound test_xmlrpc_net test_zipfile64

Total duration: 2 min 57 sec
Tests result: SUCCESS

Without any changes i run the tests again but this time under coverage. I get a completely different result:
% ./python ../coveragepy run --pylib Lib/test/regrtest.py
[...]
328 tests OK.

8 tests failed:
    test_exceptions test_frame test_ssl test_subprocess test_super
    test_traceback test_unittest test_xml_etree_c

41 tests altered the execution environment:
    test_asynchat test_asyncio test_asyncore test_capi
    test_concurrent_futures test_decimal test_distutils test_docxmlrpc
    test_email test_fork1 test_ftplib test_functools test_gc
    test_hashlib test_httplib test_httpservers test_imaplib
    test_import test_io test_json test_logging test_mailbox
    test_multiprocessing_fork test_multiprocessing_forkserver
    test_multiprocessing_spawn test_nntplib test_os test_poll
    test_poplib test_pydoc test_queue test_robotparser test_sched
    test_smtplib test_socket test_sys test_telnetlib
    test_threaded_import test_threadedtempfile test_threading
    test_xml_etree

27 tests skipped:
    test_bz2 test_ctypes test_curses test_dbm_gnu test_dbm_ndbm
    test_devpoll test_gdb test_kqueue test_lzma test_msilib
    test_ossaudiodev test_readline test_smtpnet test_socketserver
    test_sqlite test_startfile test_timeout test_tix test_tk
    test_ttk_guionly test_urllib2net test_urllibnet test_winconsoleio
    test_winreg test_winsound test_xmlrpc_net test_zipfile64

Total duration: 92 min 34 sec
Tests result: FAILURE

Is the reason for this difference known? Coverage shouldn't affect the outcome of the tests right?
History
Date User Action Args
2016-12-22 11:56:16patrikisetrecipients: + patriki
2016-12-22 11:56:16patrikisetmessageid: <1482407776.18.0.223230024277.issue29048@psf.upfronthosting.co.za>
2016-12-22 11:56:16patrikilinkissue29048 messages
2016-12-22 11:56:14patrikicreate