This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author vstinner
Recipients David.Sankel, davidsarah, ezio.melotti, lemburg, loewis, pitrou, skrah, tzot, vstinner
Date 2010-11-08.04:11:49
SpamBayes Score 5.551115e-17
Marked as misclassified No
Message-id <1289189512.32.0.346021503816.issue6058@psf.upfronthosting.co.za>
In-reply-to
Content
Different tests proved that cp65001 can *not* be set as an alias to utf-8, and that's why I'm closing this issue.

Anyway, I don't think that cp65001 is configured by default on any Windows setup. It is only set by the user, using the chcp command, to try to display unicode characters in the Windows console: but it is not possible to display any unicode character in this console (see issue #1602). And chcp command should not be used in the Windows console because it does not only change the ANSI code page: it changes also the console code page, which is wrong (the console still expect text encoded to the previous code page).

It is possible to implement a codec for cp65001 using utf-8 existing codec in surrogatepass mode, or by using MultiByteToWideChar() / WideCharToMultiByte() with codepage=CP_UTF8. But I don't think that we need cp65001 at all.

If you need cp65001 for a good reason and you would like to implement a cp65001 Python codec, open a new issue.

If you consider that we should use _O_U8TEXT or  _O_U16TEXT, open another new issue.

_O_U8TEXT or  _O_U16TEXT might improve unicode support if Python output is redirected to a pipe, but I don't think that it would help to display unicode character in the Windows console. I also fear that it breaks existing code and any function not aware of this special mode.
History
Date User Action Args
2010-11-08 04:11:52vstinnersetrecipients: + vstinner, lemburg, loewis, tzot, pitrou, ezio.melotti, skrah, davidsarah, David.Sankel
2010-11-08 04:11:52vstinnersetmessageid: <1289189512.32.0.346021503816.issue6058@psf.upfronthosting.co.za>
2010-11-08 04:11:51vstinnerlinkissue6058 messages
2010-11-08 04:11:49vstinnercreate