classification
Title: test_list() of test_tarfile fails on
Type: behavior Stage: resolved
Components: Tests Versions: Python 3.3, Python 3.4
process
Status: closed Resolution: fixed
Dependencies: Superseder:
Assigned To: serhiy.storchaka Nosy List: lars.gustaebel, python-dev, serhiy.storchaka, vstinner
Priority: normal Keywords: buildbot, patch

Created on 2014-02-18 09:51 by vstinner, last changed 2014-02-19 17:06 by serhiy.storchaka. This issue is now closed.

Files
File name Uploaded Description Edit
test_tarfile_nonutf8.patch serhiy.storchaka, 2014-02-18 12:26 review
Messages (5)
msg211503 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2014-02-18 09:51
http://buildbot.python.org/all/builders/PPC64%20AIX%203.x/builds/1728/steps/test/logs/stdio

======================================================================
FAIL: test_list (test.test_tarfile.Bz2ListTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_tarfile.py", line 244, in test_list
    br'\udcc4\udcd6\udcdc\udce4\udcf6\udcfc\udcdf', out)
AssertionError: b'ustar/umlauts-\\udcc4\\udcd6\\udcdc\\udce4\\udcf6\\udcfc\\udcdf' not found in b'ustar/conttype \nustar/regtype \nustar/dirtype/ \nustar/dirtype-with-size/ \nustar/lnktype \nustar/symtype \nustar/blktype \nustar/chrtype \nustar/fifotype \nustar/sparse \nustar/umlauts-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nustar/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/1234567/longname \n./ustar/linktest2/symtype \nustar/linktest1/regtype \n./ustar/linktest2/lnktype \nsymtype2 \ngnu/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longname \ngnu/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longlink \ngnu/sparse \ngnu/sparse-0.0 \ngnu/sparse-0.1 \ngnu/sparse-1.0 \ngnu/regtype-gnu-uid \nmisc/regtype-old-v7 \nmisc/regtype-hpux-signed-chksum-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nmisc/regtype-old-v7-signed-chksum-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nmisc/dirtype-old-v7/ \nmisc/regtype-suntar \nmisc/regtype-xstar \npax/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longname \npax/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longlink \npax/umlauts-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \npax/regtype1 \npax/regtype2 \npax/regtype3 \npax/regtype4 \npax/bad-pax-\\xe4\\xf6\\xfc \npax/hdrcharset-\\xe4\\xf6\\xfc \nmisc/eof \n'

======================================================================
FAIL: test_list (test.test_tarfile.GzipListTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_tarfile.py", line 244, in test_list
    br'\udcc4\udcd6\udcdc\udce4\udcf6\udcfc\udcdf', out)
AssertionError: b'ustar/umlauts-\\udcc4\\udcd6\\udcdc\\udce4\\udcf6\\udcfc\\udcdf' not found in b'ustar/conttype \nustar/regtype \nustar/dirtype/ \nustar/dirtype-with-size/ \nustar/lnktype \nustar/symtype \nustar/blktype \nustar/chrtype \nustar/fifotype \nustar/sparse \nustar/umlauts-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nustar/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/1234567/longname \n./ustar/linktest2/symtype \nustar/linktest1/regtype \n./ustar/linktest2/lnktype \nsymtype2 \ngnu/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longname \ngnu/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longlink \ngnu/sparse \ngnu/sparse-0.0 \ngnu/sparse-0.1 \ngnu/sparse-1.0 \ngnu/regtype-gnu-uid \nmisc/regtype-old-v7 \nmisc/regtype-hpux-signed-chksum-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nmisc/regtype-old-v7-signed-chksum-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nmisc/dirtype-old-v7/ \nmisc/regtype-suntar \nmisc/regtype-xstar \npax/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longname \npax/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longlink \npax/umlauts-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \npax/regtype1 \npax/regtype2 \npax/regtype3 \npax/regtype4 \npax/bad-pax-\\xe4\\xf6\\xfc \npax/hdrcharset-\\xe4\\xf6\\xfc \nmisc/eof \n'

======================================================================
FAIL: test_list (test.test_tarfile.ListTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/shager/cpython-buildarea/3.x.edelsohn-aix-ppc64/build/Lib/test/test_tarfile.py", line 244, in test_list
    br'\udcc4\udcd6\udcdc\udce4\udcf6\udcfc\udcdf', out)
AssertionError: b'ustar/umlauts-\\udcc4\\udcd6\\udcdc\\udce4\\udcf6\\udcfc\\udcdf' not found in b'ustar/conttype \nustar/regtype \nustar/dirtype/ \nustar/dirtype-with-size/ \nustar/lnktype \nustar/symtype \nustar/blktype \nustar/chrtype \nustar/fifotype \nustar/sparse \nustar/umlauts-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nustar/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/12345/1234567/longname \n./ustar/linktest2/symtype \nustar/linktest1/regtype \n./ustar/linktest2/lnktype \nsymtype2 \ngnu/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longname \ngnu/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longlink \ngnu/sparse \ngnu/sparse-0.0 \ngnu/sparse-0.1 \ngnu/sparse-1.0 \ngnu/regtype-gnu-uid \nmisc/regtype-old-v7 \nmisc/regtype-hpux-signed-chksum-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nmisc/regtype-old-v7-signed-chksum-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \nmisc/dirtype-old-v7/ \nmisc/regtype-suntar \nmisc/regtype-xstar \npax/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longname \npax/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/123/longlink \npax/umlauts-\\xc4\\xd6\\xdc\\xe4\\xf6\\xfc\\xdf \npax/regtype1 \npax/regtype2 \npax/regtype3 \npax/regtype4 \npax/bad-pax-\\xe4\\xf6\\xfc \npax/hdrcharset-\\xe4\\xf6\\xfc \nmisc/eof \n'
msg211504 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2014-02-18 09:51
Another different failure.

http://buildbot.python.org/all/builders/System%20Z%20Linux%203.x/builds/1302/steps/test/logs/stdio

======================================================================
FAIL: test_list_command_verbose (test.test_tarfile.CommandLineTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/dje/cpython-buildarea/3.x.edelsohn-zlinux-z/build/Lib/test/test_tarfile.py", line 1916, in test_list_command_verbose
    self.assertEqual(out, expected)
AssertionError: b'?rw[39 chars]-01-05 18:19:43 ustar/conttype \n?rw-r--r-- ta[6470 chars]f \n' != b'?rw[39 chars]-01-06 00:19:43 ustar/conttype \n?rw-r--r-- ta[6470 chars]f \n'
msg211507 - (view) Author: Serhiy Storchaka (serhiy.storchaka) * (Python committer) Date: 2014-02-18 11:26
> Another different failure.

This is issue20220.
msg211510 - (view) Author: Serhiy Storchaka (serhiy.storchaka) * (Python committer) Date: 2014-02-18 12:26
This failure can be reproduced on Linux:

    LANG=en_US.ISO8859-1 ./python -Wall -m test.regrtest -vG -m test_list test_tarfile

Tarfile use filesystem encoding by default (and UTF-8 on Windows). This test expected the UTF-8 encoding. Here is a patch which fixes the test.
msg211631 - (view) Author: Roundup Robot (python-dev) (Python triager) Date: 2014-02-19 17:04
New changeset b508cbc29acf by Serhiy Storchaka in branch '3.3':
Issue #20672: Fixed tests for TarFile.list() on non-UTF-8 locales.
http://hg.python.org/cpython/rev/b508cbc29acf

New changeset 13d27bad7393 by Serhiy Storchaka in branch 'default':
Issue #20672: Fixed tests for TarFile.list() on non-UTF-8 locales.
http://hg.python.org/cpython/rev/13d27bad7393
History
Date User Action Args
2014-02-19 17:06:17serhiy.storchakasetstatus: open -> closed
stage: patch review -> resolved
resolution: fixed
versions: + Python 3.3
2014-02-19 17:04:58python-devsetnosy: + python-dev
messages: + msg211631
2014-02-18 12:26:15serhiy.storchakasetfiles: + test_tarfile_nonutf8.patch
messages: + msg211510

assignee: serhiy.storchaka
keywords: + patch
type: behavior
stage: patch review
2014-02-18 11:26:59serhiy.storchakasetmessages: + msg211507
2014-02-18 09:51:30vstinnersetmessages: + msg211504
2014-02-18 09:51:09vstinnercreate