Author steve.dower
Recipients David.Sankel, Drekin, akira, amaury.forgeotdarc, christian.heimes, christoph, davidsarah, ezio.melotti, flox, giampaolo.rodola, haypo, hippietrail, lemburg, mark, mhammond, ncoghlan, pitrou, santoso.wijaya, smerlin, sorin, steve.dower, terry.reedy, tim.golden, tzot, v+python
Date 2014-06-21.15:12:48
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1403363569.31.0.596304108183.issue1602@psf.upfronthosting.co.za>
In-reply-to
Content
My understanding is that the best way to write Unicode to the console is through WriteConsoleW(), which seems to be where this discussion ended up. The only apparent sticking point is that this would cause an ordering incompatibility with `stdout.write(); stdout.buffer.write(); stdout.write()`.

Last I heard, the official "advice" was to use PowerShell. Clearly everyone's keen to jump on that... (I'm not even sure it's an instant fix either - PS is a much better shell for file manipulation and certainly handles encoding better than type/echo/etc., but I think it will still go back to the OEM CP for executables.)

One other point that came up was UTF-8 handling after redirecting output to a file. I don't see an issue there - UTF-8 is going to be one of the first guesses (with or without a BOM) for text that is not UTF-16, and apps that assume something else are no worse off than with any other codepage.

So I don't have any great answers, sorry. I'd love to see the defaults handle it properly, but opt-in scripts like Drekin's may be the best way to enable it broadly.
History
Date User Action Args
2014-06-21 15:12:49steve.dowersetrecipients: + steve.dower, lemburg, mhammond, terry.reedy, tzot, amaury.forgeotdarc, ncoghlan, pitrou, haypo, giampaolo.rodola, christian.heimes, tim.golden, mark, christoph, ezio.melotti, v+python, hippietrail, sorin, flox, davidsarah, santoso.wijaya, akira, David.Sankel, smerlin, Drekin
2014-06-21 15:12:49steve.dowersetmessageid: <1403363569.31.0.596304108183.issue1602@psf.upfronthosting.co.za>
2014-06-21 15:12:49steve.dowerlinkissue1602 messages
2014-06-21 15:12:48steve.dowercreate