Message409461
I have this happening on Linux with a Flask app after upgrading from Fedora 34 to 35. libpython keeps crashing httpd.
I see this from journalctl:
#0 0x00007fd899baa801 PyObject_Malloc (libpython3.10.so.1.0 + 0xf7801)
#1 0x00007fd899baab47 PyUnicode_New (libpython3.10.so.1.0 + 0xf7b47)
#2 0x00007fd899bb9aae _PyUnicode_FromUCS1 (libpython3.10.so.1.0 + 0x106aae)
#3 0x00007fd899bb9323 r_object (libpython3.10.so.1.0 + 0x106323)
#4 0x00007fd899bb8d46 r_object (libpython3.10.so.1.0 + 0x105d46)
#5 0x00007fd899bb90b4 r_object (libpython3.10.so.1.0 + 0x1060b4)
#6 0x00007fd899bb8d65 r_object (libpython3.10.so.1.0 + 0x105d65)
#7 0x00007fd899bb9088 r_object (libpython3.10.so.1.0 + 0x106088)
#8 0x00007fd899bb8e33 r_object (libpython3.10.so.1.0 + 0x105e33)
#9 0x00007fd899bb9088 r_object (libpython3.10.so.1.0 + 0x106088)
#10 0x00007fd899c35c28 read_object (libpython3.10.so.1.0 + 0x182c28)
#11 0x00007fd899c48f56 marshal_loads (libpython3.10.so.1.0 + 0x195f56)
#12 0x00007fd899bc88d7 cfunction_vectorcall_O (libpython3.10.so.1.0 + 0x1158d7)
#13 0x00007fd899bc0c80 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x10dc80)
#14 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#15 0x00007fd899bbccba _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x109cba)
#16 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#17 0x00007fd899bbbd6d _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108d6d)
#18 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#19 0x00007fd899bbbd6d _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108d6d)
#20 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#21 0x00007fd899bbbac2 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108ac2)
#22 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#23 0x00007fd899bbbac2 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108ac2)
#24 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#25 0x00007fd899bc8a9e object_vacall (libpython3.10.so.1.0 + 0x115a9e)
#26 0x00007fd899bd247c _PyObject_CallMethodIdObjArgs (libpython3.10.so.1.0 + 0x11f47c)
#27 0x00007fd899bd21d7 PyImport_ImportModuleLevelObject (libpython3.10.so.1.0 + 0x11f1d7)
#28 0x00007fd899bbfc8e _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x10cc8e)
#29 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#30 0x00007fd899c360d4 PyEval_EvalCode (libpython3.10.so.1.0 + 0x1830d4)
#31 0x00007fd899c3d091 builtin_exec (libpython3.10.so.1.0 + 0x18a091)
#32 0x00007fd899bc94b0 cfunction_vectorcall_FASTCALL (libpython3.10.so.1.0 + 0x1164b0)
#33 0x00007fd899bc2209 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x10f209)
#34 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#35 0x00007fd899bc0c80 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x10dc80)
#36 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#37 0x00007fd899bbbd6d _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108d6d)
#38 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#39 0x00007fd899bbbac2 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108ac2)
#40 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#41 0x00007fd899bbbac2 _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x108ac2)
#42 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#43 0x00007fd899bc8a9e object_vacall (libpython3.10.so.1.0 + 0x115a9e)
#44 0x00007fd899bd247c _PyObject_CallMethodIdObjArgs (libpython3.10.so.1.0 + 0x11f47c)
#45 0x00007fd899bd21d7 PyImport_ImportModuleLevelObject (libpython3.10.so.1.0 + 0x11f1d7)
#46 0x00007fd899bbfc8e _PyEval_EvalFrameDefault (libpython3.10.so.1.0 + 0x10cc8e)
#47 0x00007fd899bba984 _PyEval_Vector (libpython3.10.so.1.0 + 0x107984)
#48 0x00007fd899c360d4 PyEval_EvalCode (libpython3.10.so.1.0 + 0x1830d4)
#49 0x00007fd899c36006 exec_code_in_module (libpython3.10.so.1.0 + 0x183006)
#50 0x00007fd899ba33e7 PyImport_ExecCodeModuleObject (libpython3.10.so.1.0 + 0xf03e7)
#51 0x00007fd899ba3482 PyImport_ExecCodeModuleWithPathnames (libpython3.10.so.1.0 + 0xf0482)
#52 0x00007fd899e0f542 wsgi_load_source.lto_priv.0 (mod_wsgi_python3.so + 0x17542)
#53 0x00007fd899e107ed wsgi_execute_script.lto_priv.0 (mod_wsgi_python3.so + 0x187ed)
#54 0x00007fd899e1b0f6 wsgi_daemon_thread (mod_wsgi_python3.so + 0x230f6)
#55 0x00007fd89ab52a87 start_thread (libc.so.6 + 0x8da87)
#56 0x00007fd89abd7640 __clone3 (libc.so.6 + 0x112640)
I see this in /var/log/httpd/ssl_error_log:
[Sat Jan 01 05:17:21.248640 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249193 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249222 2022] [wsgi:error] [pid 257749:tid 257758] File "/usr/lib64/python3.10/sqlite3/dbapi2.py", line
83, in register_adapters_and_converters
[Sat Jan 01 05:17:21.249453 2022] [wsgi:error] [pid 257749:tid 257758] register_converter("timestamp", convert_timestamp)
[Sat Jan 01 05:17:21.249469 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'timepart_full'
[Sat Jan 01 05:17:21.249484 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249488 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249493 2022] [wsgi:error] [pid 257749:tid 257758] File "/usr/lib64/python3.10/sqlite3/dbapi2.py", line
83, in register_adapters_and_converters
[Sat Jan 01 05:17:21.249572 2022] [wsgi:error] [pid 257749:tid 257758] register_converter("timestamp", convert_timestamp)
[Sat Jan 01 05:17:21.249582 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'timepart'
[Sat Jan 01 05:17:21.249590 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249594 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249598 2022] [wsgi:error] [pid 257749:tid 257758] File "/usr/lib64/python3.10/sqlite3/dbapi2.py", line
83, in register_adapters_and_converters
[Sat Jan 01 05:17:21.249667 2022] [wsgi:error] [pid 257749:tid 257758] register_converter("timestamp", convert_timestamp)
[Sat Jan 01 05:17:21.249676 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'datepart'
[Sat Jan 01 05:17:21.249697 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249701 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249706 2022] [wsgi:error] [pid 257749:tid 257758] File "<frozen importlib._bootstrap>", line 688, in _
load_unlocked
[Sat Jan 01 05:17:21.249804 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'convert_timestamp'
[Sat Jan 01 05:17:21.249813 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249817 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249822 2022] [wsgi:error] [pid 257749:tid 257758] File "<frozen importlib._bootstrap>", line 688, in _
load_unlocked
[Sat Jan 01 05:17:21.249889 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'convert_date'
[Sat Jan 01 05:17:21.249898 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249901 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249906 2022] [wsgi:error] [pid 257749:tid 257758] File "<frozen importlib._bootstrap>", line 688, in _
load_unlocked
[Sat Jan 01 05:17:21.249946 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'adapt_datetime'
[Sat Jan 01 05:17:21.249971 2022] [wsgi:error] [pid 257749:tid 257758] Exception ignored deletion of interned string failed:
[Sat Jan 01 05:17:21.249977 2022] [wsgi:error] [pid 257749:tid 257758] Traceback (most recent call last):
[Sat Jan 01 05:17:21.249981 2022] [wsgi:error] [pid 257749:tid 257758] File "<frozen importlib._bootstrap>", line 688, in _
load_unlocked
[Sat Jan 01 05:17:21.250021 2022] [wsgi:error] [pid 257749:tid 257758] KeyError: 'adapt_date'
[Sat Jan 01 05:17:22.058701 2022] [wsgi:error] [pid 249217:tid 249327] [client 31.13.127.13:53220] Truncated or oversized response headers received from daemon process 'https_site': /home/site/dmnes-site/viewer.wsgi
libpython is crashing httpd a few times a minute for me, and I definitely was not seeing this with Fedora 34. I have Python 3.10.1 on F35, and had 3.9.9 on F34.
If there's any further information I can provide, I'd be happy to help. |
|
Date |
User |
Action |
Args |
2022-01-01 14:36:31 | uckelman | set | recipients:
+ uckelman, vstinner, petr.viktorin, eric.snow, ndjensen, hroncok, corona10, shihai1991, erlendaasland, graysky, bsteffensmeier, M-Reimer |
2022-01-01 14:36:31 | uckelman | set | messageid: <1641047791.21.0.403276692609.issue46070@roundup.psfhosted.org> |
2022-01-01 14:36:31 | uckelman | link | issue46070 messages |
2022-01-01 14:36:30 | uckelman | create | |
|