Message 72477 - Python tracker

➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author	hyeshik.chang
Recipients	benjamin.peterson, brett.cannon, christian.heimes, hyeshik.chang, pitrou
Date	2008-09-04.03:35:42
SpamBayes Score	0.00014792233
Marked as misclassified	No
Message-id	<1220499343.64.0.888312750254.issue3594@psf.upfronthosting.co.za>
In-reply-to

Content
pitrou, that's because Python source code can't be correctly tokenized when it's encoded in few odd encodings like iso-2022 or shift-jis which utilizes \, (, ) and " as second byte of two-byte character sequence. For example, '\x81\\' is HORIZONTAL BAR in shift-jis, exec('print "\x81\\"') fails. because of " is ignored by second byte of '\x81\\'.

pitrou, that's because Python source code can't be correctly tokenized 
when it's encoded in few odd encodings like iso-2022 or shift-jis which 
utilizes \, (, ) and " as second byte of two-byte character sequence.

For example, '\x81\\' is HORIZONTAL BAR in shift-jis,

exec('print "\x81\\"')

fails. because of " is ignored by second byte of '\x81\\'.

History
Date	User	Action	Args
2008-09-04 03:35:43	hyeshik.chang	set	recipients: + hyeshik.chang, brett.cannon, pitrou, christian.heimes, benjamin.peterson
2008-09-04 03:35:43	hyeshik.chang	set	messageid: <1220499343.64.0.888312750254.issue3594@psf.upfronthosting.co.za>
2008-09-04 03:35:43	hyeshik.chang	link	issue3594 messages
2008-09-04 03:35:42	hyeshik.chang	create