This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author vladris
Recipients benjamin.peterson, eric.snow, ezio.melotti,, r.david.murray, vladris
Date 2011-08-02.02:45:31
SpamBayes Score 6.533651e-06
Marked as misclassified No
Message-id <>
How come tokenizer module is not based on actual C tokenizer? Wouldn't that make more sense (and prevent this kind of issues)?
Date User Action Args
2011-08-02 02:45:32vladrissetrecipients: + vladris, benjamin.peterson, ezio.melotti, r.david.murray, eric.snow,
2011-08-02 02:45:32vladrissetmessageid: <>
2011-08-02 02:45:32vladrislinkissue12675 messages
2011-08-02 02:45:31vladriscreate