➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author vladris
Recipients benjamin.peterson, eric.snow, ezio.melotti, gdr@garethrees.org, r.david.murray, vladris
Date 2011-08-02.02:45:31
SpamBayes Score 6.533651e-06
Marked as misclassified No
Message-id <1312253132.6.0.146712421563.issue12675@psf.upfronthosting.co.za>
In-reply-to
Content 
How come tokenizer module is not based on actual C tokenizer? Wouldn't that make more sense (and prevent this kind of issues)?
History
Date User Action Args
2011-08-02 02:45:32vladrissetrecipients: + vladris, benjamin.peterson, ezio.melotti, r.david.murray, eric.snow, gdr@garethrees.org
2011-08-02 02:45:32vladrissetmessageid: <1312253132.6.0.146712421563.issue12675@psf.upfronthosting.co.za>
2011-08-02 02:45:32vladrislinkissue12675 messages
2011-08-02 02:45:31vladriscreate