This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author michael.foord
Recipients barry, loewis, mark.dickinson, michael.foord, trent
Date 2008-03-18.17:52:59
SpamBayes Score 0.0385411
Marked as misclassified No
Message-id <1205862780.25.0.381904856154.issue719888@psf.upfronthosting.co.za>
In-reply-to
Content
That was 'by discussion with wiser heads than I'. The existing module
has an old backwards compatibility interface called 'tokenize'. That can
be deprecated in 2.6.

As 'tokenize' is really the ideal name for the main entry point for the
module, 'generate_tokens' became tokenize for Py3.
History
Date User Action Args
2008-03-18 17:53:00fuzzymansetspambayes_score: 0.0385411 -> 0.0385411
recipients: + fuzzyman, loewis, barry, mark.dickinson, trent
2008-03-18 17:53:00fuzzymansetspambayes_score: 0.0385411 -> 0.0385411
messageid: <1205862780.25.0.381904856154.issue719888@psf.upfronthosting.co.za>
2008-03-18 17:52:59fuzzymanlinkissue719888 messages
2008-03-18 17:52:59fuzzymancreate