This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author rhettinger
Recipients docs@python, martin.panter, mbussonn, rhettinger, takluyver
Date 2018-05-18.01:23:00
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1526606580.63.0.682650639539.issue28418@psf.upfronthosting.co.za>
In-reply-to
Content
Thanks Thomas.  I've been a long term user of tokenize.generate_tokens() and would be sad to see it go.  

The underlying _tokenize() functionality is used else within the module, so there the no benefit to removing the API.
History
Date User Action Args
2018-05-18 01:23:00rhettingersetrecipients: + rhettinger, docs@python, takluyver, martin.panter, mbussonn
2018-05-18 01:23:00rhettingersetmessageid: <1526606580.63.0.682650639539.issue28418@psf.upfronthosting.co.za>
2018-05-18 01:23:00rhettingerlinkissue28418 messages
2018-05-18 01:23:00rhettingercreate