two distutils tests fail when running the tests from an installed location. 3.7 branch 20180925, succeeded with a 20180911 snapshot. Is there any locale setting required?

======================================================================
ERROR: test_non_ascii (distutils.tests.test_log.TestLog) (errors='surrogateescape')
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.7/distutils/tests/test_log.py", line 26, in test_non_ascii
    log.debug('Dεbug\tMėssãge')
  File "/usr/lib/python3.7/distutils/log.py", line 41, in debug
    self._log(DEBUG, msg, args)
  File "/usr/lib/python3.7/distutils/log.py", line 34, in _log
    stream.write('%s\n' % msg)
  File "/usr/lib/python3.7/encodings/cp437.py", line 19, in encode
    return codecs.charmap_encode(input,self.errors,encoding_map)[0]
UnicodeEncodeError: 'charmap' codec can't encode character '\u0117' in position 7: character maps to <undefined>

======================================================================
ERROR: test_find_executable (distutils.tests.test_spawn.SpawnTestCase)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python3.7/distutils/tests/test_spawn.py", line 95, in test_find_executable
    rv = find_executable(program)
  File "/usr/lib/python3.7/distutils/spawn.py", line 176, in find_executable
    path = os.environ['PATH']
  File "/usr/lib/python3.7/os.py", line 678, in __getitem__
    raise KeyError(key) from None
KeyError: 'PATH'

----------------------------------------------------------------------

The test in distutils/tests/test_log.py matches the current code (with changes added in issue34421), but the code in distutils/log.py doesn't match the current code. Looks like the stdlib and tests are unsynchronized.

I have reproduced this error by checking out the revision before issue34421 changes.

git checkout 77b92b15a5e5c84b91d3fd9d02f63db432fa8903~ Lib/distutils/log.py
./python -m test -v -m test_log test_distutils

Test case failure regarding test_find_executable was fixed with issue34530 on master and backported.

Thanks

issue34530 was already fixed on 20180904, so there's something else...

I don't understand this bug report.

"./python -m test test_distutils -v -m test_non_ascii" pass in 3.6, 3.7 and master branches.

> two distutils tests fail when running the tests from an installed location. 3.7 branch 20180925, succeeded with a 20180911 snapshot.

I don't know what are these branches.

I tested the v3.7.0 test: "./python -m test test_distutils -v -m test_non_ascii" pass as well. It seems like you tested something between 3.7.0 and the current 3.7 branch.

I suggest you to wait for the 3.7.1 release which should be release next weeks.

--

distutils/log.py evolved a lot. The code now uses:

            try:
                stream.write('%s\n' % msg)
            except UnicodeEncodeError:
                # emulate backslashreplace error handler
                encoding = stream.encoding
                msg = msg.encode(encoding, "backslashreplace").decode(encoding)
                stream.write('%s\n' % msg)

Your traceback shows a stream.write() call on line 34, which isn't the case on the current 3.7 branch. So you are testing an outdated 3.7 commit.

Hum, to be clear, I suggest to close the issue (FIXED), since both failures have been fixed in development branches.

well, it was top of the branch yesterday

> well, it was top of the branch yesterday

Hum, I don't understand because we don't have the same line number:

  File "/usr/lib/python3.7/distutils/log.py", line 34, in _log
    stream.write('%s\n' % msg)

$ git show bbdf8723324e31675f298dd273733cc13e1518df:Lib/distutils/log.py|gvim -

(...)
            try:
                stream.write('%s\n' % msg)
            except UnicodeEncodeError:
                # emulate backslashreplace error handler
                encoding = stream.encoding   # <~~~ line 34
                msg = msg.encode(encoding, "backslashreplace").decode(encoding)
                stream.write('%s\n' % msg)

@doko As an update 3.7.1rc1 is available . The fixes should be there. I think they are worth checking out to see if the cases still fail or if you can add the links for the branches 20180925 and 20180911 snapshot. I can do a clean rebuild of these branches to test them.

3.7.rc1 announcement : https://mail.python.org/pipermail/python-dev/2018-September/155329.html

Thanks

@doko, Is this still reproducible with either 3.7.1rc1 or current 3.7 head? Otherwise, let's consider closing it.

Since there has been no followup on this, I assume it is no longer a problem for anyone and am closing.