This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author gdr@garethrees.org
Recipients benjamin.peterson, gdr@garethrees.org, r.david.murray
Date 2011-08-01.13:40:41
SpamBayes Score 0.0010867144
Marked as misclassified No
Message-id <1312206041.92.0.456560842565.issue12675@psf.upfronthosting.co.za>
In-reply-to
Content
These errors are generated directly by the tokenizer. In tokenizer.c, the tokenizer generates ERRORTOKEN when it encounters something it can't tokenize. This causes parsetok() in parsetok.c to stop tokenizing and return an error.
History
Date User Action Args
2011-08-01 13:40:41gdr@garethrees.orgsetrecipients: + gdr@garethrees.org, benjamin.peterson, r.david.murray
2011-08-01 13:40:41gdr@garethrees.orgsetmessageid: <1312206041.92.0.456560842565.issue12675@psf.upfronthosting.co.za>
2011-08-01 13:40:41gdr@garethrees.orglinkissue12675 messages
2011-08-01 13:40:41gdr@garethrees.orgcreate