This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

classification
Title: Failing test_exceptions and test_threading
Type: behavior Stage:
Components: Tests Versions: Python 3.11
process
Status: open Resolution:
Dependencies: Superseder:
Assigned To: Nosy List: aritra1911, iritkatriel, pablogsal
Priority: normal Keywords:

Created on 2021-10-20 08:57 by aritra1911, last changed 2022-04-11 14:59 by admin.

Messages (9)
msg404405 - (view) Author: Aritra Sarkar (aritra1911) Date: 2021-10-20 08:57
While running `make test` on Python 3.11.0a1, I get this:


== Tests result: FAILURE ==

411 tests OK.

2 tests failed:
    test_exceptions test_threading

14 tests skipped:
    test_devpoll test_gdb test_ioctl test_kqueue test_msilib
    test_ossaudiodev test_startfile test_tix test_tk test_ttk_guionly
    test_winconsoleio test_winreg test_winsound test_zipfile64
0:06:19 load avg: 5.05
0:06:19 load avg: 5.05 Re-running failed tests in verbose mode
0:06:19 load avg: 5.05 Re-running test_exceptions in verbose mode (matching: test_name_error_suggestions_do_not_trigger_for_too_many_locals)
test_name_error_suggestions_do_not_trigger_for_too_many_locals (test.test_exceptions.NameErrorTests) ... test test_exceptions failed
FAIL

======================================================================
FAIL: test_name_error_suggestions_do_not_trigger_for_too_many_locals (test.test_exceptions.NameErrorTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/aritra/local/build/Python-3.11.0a1/Lib/test/test_exceptions.py", line 1843, in test_name_error_suggestions_do_not_trigger_for_too_many_locals
    self.assertNotIn("a1", err.getvalue())
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: 'a1' unexpectedly found in 'Traceback (most recent call last):\n  File "/home/aritra/local/build/Python-3.11.0a1/Lib/test/test_exceptions.py", line 1838, in test_name_error_suggestions_do_not_trigger_for_too_many_locals\n
  f()\n    ^^^\n  File "/home/aritra/local/build/Python-3.11.0a1/Lib/test/test_exceptions.py", line 1835, in f\n    print(a0)\n          ^^\nNameError: name \'a0\' is not defined\n'

----------------------------------------------------------------------
Ran 1 test in 0.006s

FAILED (failures=1)
0:06:19 load avg: 5.05 Re-running test_threading in verbose mode (matching: test_recursion_limit)
test_recursion_limit (test.test_threading.ThreadingExceptionTests) ... test test_threading failed
FAIL

======================================================================
FAIL: test_recursion_limit (test.test_threading.ThreadingExceptionTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/aritra/local/build/Python-3.11.0a1/Lib/test/test_threading.py", line 1290, in test_recursion_limit
    self.assertEqual(p.returncode, 0, "Unexpected error: " + stderr.decode())
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: -11 != 0 : Unexpected error:

----------------------------------------------------------------------
Ran 1 test in 0.161s

FAILED (failures=1)
2 tests failed again:
    test_exceptions test_threading

== Tests result: FAILURE then FAILURE ==

411 tests OK.

2 tests failed:
    test_exceptions test_threading

14 tests skipped:
    test_devpoll test_gdb test_ioctl test_kqueue test_msilib
    test_ossaudiodev test_startfile test_tix test_tk test_ttk_guionly
    test_winconsoleio test_winreg test_winsound test_zipfile64

2 re-run tests:
    test_exceptions test_threading

Total duration: 6 min 19 sec
Tests result: FAILURE then FAILURE




Also here are the CFLAGS I used during the build:

probook $ echo $CFLAGS
-Wall -Wextra -g -O0 -std=c99
msg404407 - (view) Author: Irit Katriel (iritkatriel) * (Python committer) Date: 2021-10-20 09:11
Which system are you testing on?
msg404411 - (view) Author: Aritra Sarkar (aritra1911) Date: 2021-10-20 09:46
Linux on x86_64 hardware:

probook $ uname -a
Linux probook 5.14.12-arch1-1 #1 SMP PREEMPT Wed, 13 Oct 2021 16:58:16 +0000 x86_64 GNU/Linux


GCC version:

probook $ gcc --version
gcc (GCC) 11.1.0
Copyright (C) 2021 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.


GNU Binutils version:

probook $ ld --version
GNU ld (GNU Binutils) 2.36.1
Copyright (C) 2021 Free Software Foundation, Inc.
This program is free software; you may redistribute it under the terms of
the GNU General Public License version 3 or (at your option) a later version.
This program has absolutely no warranty.
msg404419 - (view) Author: Pablo Galindo Salgado (pablogsal) * (Python committer) Date: 2021-10-20 10:33
Unfortunately I am unable to reproduce this failure :(
msg404428 - (view) Author: Aritra Sarkar (aritra1911) Date: 2021-10-20 11:45
I should've given the configuration options I've used as well. They are
as follows:

probook $ ./configure --prefix=/opt/python \
> --with-openssl=/opt/openssl \
> --with-openssl-rpath=/opt/openssl/lib \
> --with-openssl-rpath=/opt/openssl/lib64 \
> --with-ssl-default-suites=openssl \
> --enable-optimizations
msg404431 - (view) Author: Irit Katriel (iritkatriel) * (Python committer) Date: 2021-10-20 11:50
Crash typically refers to a segfault or hang in c code, not an exception. Please don't change the type again.
msg404434 - (view) Author: Aritra Sarkar (aritra1911) Date: 2021-10-20 12:08
Test results from another machine, running an Intel Pentium Dual Core:


== Tests result: FAILURE ==

412 tests OK.

1 test failed:
    test_exceptions

14 tests skipped:
    test_devpoll test_gdb test_ioctl test_kqueue test_msilib
    test_ossaudiodev test_startfile test_tix test_tk test_ttk_guionly
    test_winconsoleio test_winreg test_winsound test_zipfile64
0:18:40 load avg: 2.91
0:18:40 load avg: 2.91 Re-running failed tests in verbose mode
0:18:40 load avg: 2.91 Re-running test_exceptions in verbose mode (matching: test_name_error_suggestions_do_not_trigger_for_too_many_locals)
test_name_error_suggestions_do_not_trigger_for_too_many_locals (test.test_exceptions.NameErrorTests) ... test test_exceptions failed
FAIL

======================================================================
FAIL: test_name_error_suggestions_do_not_trigger_for_too_many_locals (test.test_exceptions.NameErrorTests)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/ray/local/build/Python-3.11.0a1/Lib/test/test_exceptions.py", line 1843, in test_name_error_suggestions_do_not_trigger_for_too_many_locals
    self.assertNotIn("a1", err.getvalue())
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AssertionError: 'a1' unexpectedly found in 'Traceback (most recent call last):\n  File "/home/ray/local/build/Python-3.11.0a1/Lib/test/test_exceptions.py", line 1838, in test_name_error_suggestions_do_not_trigger_for_too_many_locals\n    f()\n    ^^^\n  File "/home/ray/local/build/Python-3.11.0a1/Lib/test/test_exceptions.py", line 1835, in f\n    print(a0)\n          ^^\nNameError: name \'a0\' is not defined\n'

----------------------------------------------------------------------
Ran 1 test in 0.008s

FAILED (failures=1)
1 test failed again:
    test_exceptions

== Tests result: FAILURE then FAILURE ==

412 tests OK.

1 test failed:
    test_exceptions

14 tests skipped:
    test_devpoll test_gdb test_ioctl test_kqueue test_msilib
    test_ossaudiodev test_startfile test_tix test_tk test_ttk_guionly
    test_winconsoleio test_winreg test_winsound test_zipfile64

1 re-run test:
    test_exceptions

Total duration: 18 min 40 sec
Tests result: FAILURE then FAILURE
make: *** [Makefile:1318: test] Error 2



Here only `test_exceptions` fails. The previous report was from an Intel
Core i5.


System info:

$ uname -a
Linux archeract 5.15.0-rc6-archeract #1 SMP Mon Oct 18 14:15:15 IST 2021 x86_64 GNU/Linux

$ gcc --version
gcc (GCC) 11.1.0
Copyright (C) 2021 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

$ ld --version
GNU ld (GNU Binutils) 2.36.1
Copyright (C) 2021 Free Software Foundation, Inc.
This program is free software; you may redistribute it under the terms of
the GNU General Public License version 3 or (at your option) a later version.
This program has absolutely no warranty.

$ echo $CC
/usr/bin/gcc

$ echo $CFLAGS
-Wall -Wextra -g -O0 -std=c99

$ echo $LDFLAGS
-L/opt/openssl/lib -L/opt/openssl/lib64 -Wl,-rpath,/opt/openssl/lib -Wl,-rpath,/opt/openssl/lib64
msg404435 - (view) Author: Aritra Sarkar (aritra1911) Date: 2021-10-20 12:14
> Crash typically refers to a segfault or hang in c code, not an exception. Please don't change the type again.

I hadn't noticed that it was changed and I didn't refresh the page.
Hence everytime I sent a message, it automatically changed it back to
crash. Apologies!
msg404436 - (view) Author: Irit Katriel (iritkatriel) * (Python committer) Date: 2021-10-20 12:16
No worries! Thanks for the additional info.
History
Date User Action Args
2022-04-11 14:59:51adminsetgithub: 89697
2021-10-20 12:16:44iritkatrielsetmessages: + msg404436
2021-10-20 12:14:48aritra1911setmessages: + msg404435
2021-10-20 12:09:20aritra1911settype: crash -> behavior
2021-10-20 12:08:08aritra1911settype: behavior -> crash
messages: + msg404434
2021-10-20 11:50:46iritkatrielsettype: crash -> behavior
messages: + msg404431
2021-10-20 11:45:54aritra1911settype: behavior -> crash
messages: + msg404428
2021-10-20 10:33:17pablogsalsetmessages: + msg404419
2021-10-20 10:04:06iritkatrielsettype: crash -> behavior
2021-10-20 10:03:40iritkatrielsetnosy: + pablogsal
2021-10-20 09:46:21aritra1911setmessages: + msg404411
2021-10-20 09:11:36iritkatrielsetnosy: + iritkatriel
messages: + msg404407
2021-10-20 08:57:27aritra1911create