Issue30716
This issue tracker has been migrated to GitHub,
and is currently read-only.
For more information,
see the GitHub FAQs in the Python's Developer Guide.
Created on 2017-06-20 18:55 by terry.reedy, last changed 2022-04-11 14:58 by admin. This issue is now closed.
Messages (8) | |||
---|---|---|---|
msg296477 - (view) | Author: Terry J. Reedy (terry.reedy) * ![]() |
Date: 2017-06-20 18:55 | |
3.6.2rc1, 64 bit version, installed on my Win10 machine, has 5 failures not present in my 32-bit debug repository builds. Auto Windows updates is on. Results same after uninstall and re-install. F:\dev\3x>py -3 -c "import sys; print(sys.version)" 3.6.2rc1 (heads/3.6:268e1fb, Jun 17 2017, 19:01:44) [MSC v.1900 64 bit (AMD64)] test_codecencodings_iso2022 multiple failures test_random multiple failures test_sax multiple failures test_regrtest failed in test_pcbuild_rt, FileNotFoundError in subprocess test_tools 2to3 it seems Are the failures unique to my machine? At least some of the failures below don't seem that they should be. How is the installer tested? ----------------------- FAil test_incrementaldecoder test.test_codecencodings_iso2022.Test_ISO2022_KR) has 4 failures like the following, where b'\n' and b'\r\n' are switched (both ways) between expected and actual. AssertionError: b'\xe[334 chars]\x80\n\xed\x9a\xa8\xec\x9c\xa8\xec\xa0\x81\xec[1668 chars]4.\n' != b'\xe[334 chars]\x80\r\n\xed\x9a\xa8\xec\x9c\xa8\xec\xa0\x81\x[1682 chars]\r\n' b"\x1[143 chars]\x0f\r\n\x0eH?@2@{@N\x0f \x0e0m<vAX\x0f \x0e5%[631 chars]\r\n" != b"\x1[143 chars]\x0f\n\x0eH?@2@{@N\x0f \x0e0m<vAX\x0f \x0e5%@L[617 chars]f.\n" --------------------- ERROR: test_bug_1727780 (test.test_random.MersenneTwister_TestBasicOps) ---------------------------------------------------------------------- Traceback (most recent call last): File "C:\Programs\Python36\lib\test\test_random.py", line 257, in test_bug_1727780 r = pickle.load(f) ModuleNotFoundError: No module named 'random\r' Any 1 of the 3 test files produces this. ------------------- test_sax has 10 line-ending switch failures like this b'<?x[36 chars]1"?>\n<HTML xmlns:pp="http://www.isogen.com/pa[1508 chars]TML>' != b'<?x[36 chars]1"?>\r\n<HTML xmlns:pp="http://www.isogen.com/[1736 chars]TML>' --------------------------- ERROR: test_pcbuild_rt (test.test_regrtest.ProgramsTestCase) ---------------------------------------------------------------------- Traceback (most recent call last): File "C:\Programs\Python36\lib\test\test_regrtest.py", line 582, in test_pcbuild_rt self.run_batch(script, *rt_args, *self.regrtest_args, *self.tests) File "C:\Programs\Python36\lib\test\test_regrtest.py", line 557, in run_batch proc = self.run_command(args) File "C:\Programs\Python36\lib\test\test_regrtest.py", line 455, in run_command **kw) File "C:\Programs\Python36\lib\subprocess.py", line 403, in run with Popen(*popenargs, **kwargs) as process: File "C:\Programs\Python36\lib\subprocess.py", line 707, in __init__ restore_signals, start_new_session) File "C:\Programs\Python36\lib\subprocess.py", line 992, in _execute_child startupinfo) FileNotFoundError: [WinError 2] The system cannot find the file specified -------------------------------- I don't understand the test_tools output. Some tests ran, but test_tools could not be found ;-). F:\dev\3x>py -3 -m test -v test_tools == CPython 3.6.2rc1 (heads/3.6:268e1fb, Jun 17 2017, 19:01:44) [MSC v.1900 64 bit (AMD64)] == Windows-10-10.0.14393-SP0 little-endian == hash algorithm: siphash24 64bit == cwd: C:\Users\Terry\AppData\Local\Temp\test_python_14224 == CPU count: 12 == encodings: locale=cp1252, FS=utf-8 Testing with flags: sys.flags(debug=0, inspect=0, interactive=0, optimize=0, dont_write_bytecode=0, no_user_site=0, no_site=0, ignore_environment=0, verbose=0, bytes_warning=0, quiet=0, hash_randomization=1, isolated=0) Run tests sequentially 0:00:00 [1/1] test_tools test_alter_comments (test.test_tools.test_fixcid.Test) ... ok test_directory (test.test_tools.test_fixcid.Test) ... ok test_parse_strings (test.test_tools.test_fixcid.Test) ... ok test_gprof (test.test_tools.test_gprof2html.Gprof2htmlTests) ... ok test_POT_Creation_Date (test.test_tools.test_i18n.Test_pygettext) Match the date format from xgettext for POT-Creation-Date ... ok test_header (test.test_tools.test_i18n.Test_pygettext) Make sure the required fields are in the header, according to: ... ok test_checksum_fodder (test.test_tools.test_md5sum.MD5SumTests) ... ok test_dash_l (test.test_tools.test_md5sum.MD5SumTests) ... ok test_dash_s (test.test_tools.test_md5sum.MD5SumTests) ... ok test_dash_t (test.test_tools.test_md5sum.MD5SumTests) ... ok test_multiple_files (test.test_tools.test_md5sum.MD5SumTests) ... ok test_noargs (test.test_tools.test_md5sum.MD5SumTests) ... ok test_usage (test.test_tools.test_md5sum.MD5SumTests) ... ok test_inverse_attribute_error (test.test_tools.test_pdeps.PdepsTests) ... ok test_process_errors (test.test_tools.test_pdeps.PdepsTests) ... ok test_empty_line (test.test_tools.test_pindent.PindentTests) ... ok test_escaped_newline (test.test_tools.test_pindent.PindentTests) ... ok test_multilevel (test.test_tools.test_pindent.PindentTests) ... ok test_oneline (test.test_tools.test_pindent.PindentTests) ... ok test_preserve_indents (test.test_tools.test_pindent.PindentTests) ... ok test_selftest (test.test_tools.test_pindent.PindentTests) ... ok test_statements (test.test_tools.test_pindent.PindentTests) ... ok test_help (test.test_tools.test_reindent.ReindentTests) ... ok test_noargs (test.test_tools.test_reindent.ReindentTests) ... ok test_reindent_file_with_bad_encoding (test.test_tools.test_reindent.ReindentTests) ... ok test_analyze_dxp_import (test.test_tools.test_sundry.TestSundryScripts) ... ok test_sundry (test.test_tools.test_sundry.TestSundryScripts) ... RefactoringTool: Adding transformation: apply RefactoringTool: Adding transformation: asserts RefactoringTool: Adding transformation: basestring RefactoringTool: Skipping optional fixer: buffer RefactoringTool: Adding transformation: dict RefactoringTool: Adding transformation: except RefactoringTool: Adding transformation: exec RefactoringTool: Adding transformation: execfile RefactoringTool: Adding transformation: exitfunc RefactoringTool: Adding transformation: filter RefactoringTool: Adding transformation: funcattrs RefactoringTool: Adding transformation: future RefactoringTool: Adding transformation: getcwdu RefactoringTool: Adding transformation: has_key RefactoringTool: Skipping optional fixer: idioms RefactoringTool: Adding transformation: import RefactoringTool: Adding transformation: imports RefactoringTool: Adding transformation: imports2 RefactoringTool: Adding transformation: input RefactoringTool: Adding transformation: intern RefactoringTool: Adding transformation: isinstance RefactoringTool: Adding transformation: itertools RefactoringTool: Adding transformation: itertools_imports RefactoringTool: Adding transformation: long RefactoringTool: Adding transformation: map RefactoringTool: Adding transformation: metaclass RefactoringTool: Adding transformation: methodattrs RefactoringTool: Adding transformation: ne RefactoringTool: Adding transformation: next RefactoringTool: Adding transformation: nonzero RefactoringTool: Adding transformation: numliterals RefactoringTool: Adding transformation: operator RefactoringTool: Adding transformation: paren RefactoringTool: Adding transformation: print RefactoringTool: Adding transformation: raise RefactoringTool: Adding transformation: raw_input RefactoringTool: Adding transformation: reduce RefactoringTool: Adding transformation: reload RefactoringTool: Adding transformation: renames RefactoringTool: Adding transformation: repr RefactoringTool: Skipping optional fixer: set_literal RefactoringTool: Adding transformation: standarderror RefactoringTool: Adding transformation: sys_exc RefactoringTool: Adding transformation: throw RefactoringTool: Adding transformation: tuple_params RefactoringTool: Adding transformation: types RefactoringTool: Adding transformation: unicode RefactoringTool: Adding transformation: urllib RefactoringTool: Skipping optional fixer: ws_comma RefactoringTool: Adding transformation: xrange RefactoringTool: Adding transformation: xreadlines RefactoringTool: Adding transformation: zip RefactoringTool: Can't open test_tools: [Errno 2] No such file or directory: 'test_tools' RefactoringTool: No files need to be modified. RefactoringTool: There was 1 error: RefactoringTool: Can't open test_tools: [Errno 2] No such file or directory: 'test_tools' ERROR test_sundry_windows (test.test_tools.test_sundry.TestSundryScripts) ... ok test_files (test.test_tools.test_unparse.DirectoryTestCase) ... Testing C:\Programs\Python36\Lib\test\test_super.py Testing C:\Programs\Python36\Lib\subprocess.py Testing C:\Programs\Python36\Lib\string.py Testing C:\Programs\Python36\Lib\mimetypes.py Testing C:\Programs\Python36\Lib\test\test_dictcomps.py Testing C:\Programs\Python36\Lib\site.py Testing C:\Programs\Python36\Lib\test\pydoc_mod.py Testing C:\Programs\Python36\Lib\stringprep.py Testing C:\Programs\Python36\Lib\test\test_cgi.py Testing C:\Programs\Python36\Lib\struct.py ok test_annotations (test.test_tools.test_unparse.UnparseTestCase) ... ok test_bytes (test.test_tools.test_unparse.UnparseTestCase) ... ok test_chained_comparisons (test.test_tools.test_unparse.UnparseTestCase) ... ok test_class_decorators (test.test_tools.test_unparse.UnparseTestCase) ... ok test_class_definition (test.test_tools.test_unparse.UnparseTestCase) ... ok test_del_statement (test.test_tools.test_unparse.UnparseTestCase) ... ok test_dict_comprehension (test.test_tools.test_unparse.UnparseTestCase) ... ok test_dict_unpacking_in_dict (test.test_tools.test_unparse.UnparseTestCase) ... ok test_elifs (test.test_tools.test_unparse.UnparseTestCase) ... ok test_for_else (test.test_tools.test_unparse.UnparseTestCase) ... ok test_fstrings (test.test_tools.test_unparse.UnparseTestCase) ... ok test_function_arguments (test.test_tools.test_unparse.UnparseTestCase) ... ok test_huge_float (test.test_tools.test_unparse.UnparseTestCase) ... ok test_imaginary_literals (test.test_tools.test_unparse.UnparseTestCase) ... ok test_integer_parens (test.test_tools.test_unparse.UnparseTestCase) ... ok test_lambda_parentheses (test.test_tools.test_unparse.UnparseTestCase) ... ok test_min_int (test.test_tools.test_unparse.UnparseTestCase) ... ok test_nonlocal (test.test_tools.test_unparse.UnparseTestCase) ... ok test_raise_from (test.test_tools.test_unparse.UnparseTestCase) ... ok test_relative_import (test.test_tools.test_unparse.UnparseTestCase) ... ok test_set_comprehension (test.test_tools.test_unparse.UnparseTestCase) ... ok test_set_literal (test.test_tools.test_unparse.UnparseTestCase) ... ok test_shifts (test.test_tools.test_unparse.UnparseTestCase) ... ok test_starred_assignment (test.test_tools.test_unparse.UnparseTestCase) ... ok test_try_except_finally (test.test_tools.test_unparse.UnparseTestCase) ... ok test_unary_parens (test.test_tools.test_unparse.UnparseTestCase) ... ok test_while_else (test.test_tools.test_unparse.UnparseTestCase) ... ok test_with_as (test.test_tools.test_unparse.UnparseTestCase) ... ok test_with_simple (test.test_tools.test_unparse.UnparseTestCase) ... ok test_with_two_items (test.test_tools.test_unparse.UnparseTestCase) ... ok ====================================================================== ERROR: test_sundry (test.test_tools.test_sundry.TestSundryScripts) ---------------------------------------------------------------------- Traceback (most recent call last): File "C:\Programs\Python36\lib\test\test_tools\test_sundry.py", line 36, in test_sundry import_tool(name) File "C:\Programs\Python36\lib\test\test_tools\__init__.py", line 21, in import_tool return importlib.import_module(toolname) File "C:\Programs\Python36\lib\importlib\__init__.py", line 126, in import_module return _bootstrap._gcd_import(name[level:], package, level) File "<frozen importlib._bootstrap>", line 978, in _gcd_import File "<frozen importlib._bootstrap>", line 961, in _find_and_load File "<frozen importlib._bootstrap>", line 950, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 655, in _load_unlocked File "<frozen importlib._bootstrap_external>", line 678, in exec_module File "<frozen importlib._bootstrap>", line 205, in _call_with_frames_removed File "C:\Programs\Python36\Tools\scripts\2to3.py", line 5, in <module> sys.exit(main("lib2to3.fixes")) SystemExit: 1 ---------------------------------------------------------------------- Ran 59 tests in 3.481s FAILED (errors=1) Warning -- logging._handlerList was modified by test_tools Before: (2752582445576, [<weakref at 0x00000280E2BE4F48; to '_StderrHandler' at 0x00000280E2BF11D0>, <weakref at 0x00000280E35A4688; to 'StreamHandler' at 0x00000280E36BEE10>], [<weakref at 0x00000280E2BE4F48; to '_StderrHandler' at 0x00000280E2BF11D0>]) After: (2752582445576, [<weakref at 0x00000280E2BE4F48; to '_StderrHandler' at 0x00000280E2BF11D0>, <weakref at 0x00000280E35A4688; to 'StreamHandler' at 0x00000280E36BEE10>], [<weakref at 0x00000280E2BE4F48; to '_StderrHandler' at 0x00000280E2BF11D0>, <weakref at 0x00000280E35A4688; to 'StreamHandler' at 0x00000280E36BEE10>]) test test_tools failed |
|||
msg296507 - (view) | Author: Martin Panter (martin.panter) * ![]() |
Date: 2017-06-21 03:21 | |
Sounds similar to Issue 27425. Did rc1 get built with mangled newlines or something? |
|||
msg296558 - (view) | Author: Steve Dower (steve.dower) * ![]() |
Date: 2017-06-21 14:08 | |
To clarify (because I never trust test output for this), your install has \n line endings everywhere instead of \r\n? |
|||
msg296565 - (view) | Author: Steve Dower (steve.dower) * ![]() |
Date: 2017-06-21 16:38 | |
So the pickle issues were because the .gitattributes file changed multiple times since the last release but the files were not modified, so git did not fix them in my build repo. This should cover random and 2to3. Most of the stdlib is correct CRLF. XML should be immune to LF/CRLF differences, so we should harden the test (or the library?) against those. IMO, we should also harden the multibyte tests against newline differences. When they read the test data with 'rb' they can also .replace(b'\r\n', b'\n') - it's totally external to the tests. test_pcbuild_rt should fail in an install (or better yet, be skipped - we don't ship rt.bat). |
|||
msg296566 - (view) | Author: Steve Dower (steve.dower) * ![]() |
Date: 2017-06-21 16:52 | |
For the next build, test_codecencodings_iso2022, test_random, test_sax and test_tools should all pass, as the .gitattributes file excludes those files from conversion. I'm still in favour of hardening the tests. test_pcbuild_rc should be skipped. I don't think this test breaking in an install is a release blocking issue. Up to Ned whether we want to fix these tests before 3.6.2. They may affect users who build from the sdist and do a repo-wide line ending conversion (or fork into another repo that does different line ending correction - I know at least two of those exist). |
|||
msg296583 - (view) | Author: Terry J. Reedy (terry.reedy) * ![]() |
Date: 2017-06-21 20:41 | |
Steve, what should I do to answer you line-ending question, or do you still need the info? Victor Stinner reopened #27425, which was about the exact same line-ending failures. |
|||
msg408463 - (view) | Author: Irit Katriel (iritkatriel) * ![]() |
Date: 2021-12-13 16:41 | |
Shall we close this? I don't think 3.6 test failures will still be looked into. |
|||
msg408470 - (view) | Author: STINNER Victor (vstinner) * ![]() |
Date: 2021-12-13 17:27 | |
It seems like this issue has been fixed in bpo-27425. |
History | |||
---|---|---|---|
Date | User | Action | Args |
2022-04-11 14:58:47 | admin | set | github: 74901 |
2021-12-13 17:27:46 | vstinner | set | superseder: Tests fail because of git's newline preferences on Windows resolution: out of date -> duplicate messages: + msg408470 |
2021-12-13 16:57:29 | terry.reedy | set | status: pending -> closed resolution: out of date stage: resolved |
2021-12-13 16:41:20 | iritkatriel | set | status: open -> pending nosy: + iritkatriel messages: + msg408463 |
2017-06-21 20:41:11 | terry.reedy | set | messages: + msg296583 |
2017-06-21 16:52:59 | steve.dower | set | nosy:
+ vstinner |
2017-06-21 16:52:32 | steve.dower | set | messages: + msg296566 |
2017-06-21 16:42:30 | steve.dower | set | priority: release blocker -> normal |
2017-06-21 16:38:19 | steve.dower | set | messages: + msg296565 |
2017-06-21 14:08:35 | steve.dower | set | messages: + msg296558 |
2017-06-21 03:21:50 | martin.panter | set | nosy:
+ paul.moore, tim.golden, martin.panter, zach.ware, steve.dower messages: + msg296507 components: + Tests, Windows |
2017-06-20 18:55:28 | terry.reedy | create |