This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author terry.reedy
Recipients benjamin.peterson, daniel.urban, eric.snow, ezio.melotti,, r.david.murray, terry.reedy, vladris
Date 2011-08-05.19:53:33
SpamBayes Score 0.01514403
Marked as misclassified No
Message-id <>
I have not used tokenize, but if it is *not* intended to exactly reproduce the internal tokenizer  behavior, the claim that it is should be amended.
Date User Action Args
2011-08-05 19:53:34terry.reedysetrecipients: + terry.reedy, benjamin.peterson, ezio.melotti, r.david.murray, daniel.urban, eric.snow, vladris,
2011-08-05 19:53:34terry.reedysetmessageid: <>
2011-08-05 19:53:34terry.reedylinkissue12675 messages
2011-08-05 19:53:33terry.reedycreate