This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author vstinner
Recipients benjamin.peterson, eric.araujo, meatballhat, tim.peters, vstinner, ysj.ray
Date 2010-05-20.22:33:15
SpamBayes Score 0.005456862
Marked as misclassified No
Message-id <1274394800.04.0.844742626047.issue8774@psf.upfronthosting.co.za>
In-reply-to
Content
> The correct fix is to use tokenize.detect_encoding, 
> if anyone wants to provide a patch.

done :-) Attached patch opens the file in binary mode to call 
tokenize.detect_encoding() and then use the encoding to open the file a second time (in text (unicode) mode).
History
Date User Action Args
2010-05-20 22:33:20vstinnersetrecipients: + vstinner, tim.peters, benjamin.peterson, eric.araujo, meatballhat, ysj.ray
2010-05-20 22:33:20vstinnersetmessageid: <1274394800.04.0.844742626047.issue8774@psf.upfronthosting.co.za>
2010-05-20 22:33:16vstinnerlinkissue8774 messages
2010-05-20 22:33:16vstinnercreate