➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author benjamin.peterson
Recipients benjamin.peterson, eric.snow, ezio.melotti, gdr@garethrees.org, r.david.murray, vladris
Date 2011-08-02.04:42:17
SpamBayes Score 0.01000587
Marked as misclassified No
Message-id <1312260138.12.0.274972215839.issue12675@psf.upfronthosting.co.za>
In-reply-to
Content 
tokenize has useful features that the builtin tokenizer does not possess such as the NL token.
History
Date User Action Args
2011-08-02 04:42:18benjamin.petersonsetrecipients: + benjamin.peterson, ezio.melotti, r.david.murray, eric.snow, vladris, gdr@garethrees.org
2011-08-02 04:42:18benjamin.petersonsetmessageid: <1312260138.12.0.274972215839.issue12675@psf.upfronthosting.co.za>
2011-08-02 04:42:17benjamin.petersonlinkissue12675 messages
2011-08-02 04:42:17benjamin.petersoncreate