This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author serhiy.storchaka
Recipients Paul.Bonser, armicron, benjamin.peterson, georg.brandl, kbk, loewis, meador.inge, python-dev, roger.serwy, serhiy.storchaka, terry.reedy
Date 2013-09-16.21:19:40
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1379366380.56.0.685274946577.issue18873@psf.upfronthosting.co.za>
In-reply-to
Content
> If there is not now, it would be nice if there were just one python-coded function in Lib/tokenize.py that could be imported and used by the other python code.

Agree. But look how many tokenize issues are opened around.

Thank you for your report Paul.

I left PEP 263 not fixed yet. Perhaps it needs rewording (especially in the light of other issues, such as #18960 and #18961).
History
Date User Action Args
2013-09-16 21:19:40serhiy.storchakasetrecipients: + serhiy.storchaka, loewis, georg.brandl, terry.reedy, kbk, benjamin.peterson, roger.serwy, meador.inge, python-dev, Paul.Bonser, armicron
2013-09-16 21:19:40serhiy.storchakasetmessageid: <1379366380.56.0.685274946577.issue18873@psf.upfronthosting.co.za>
2013-09-16 21:19:40serhiy.storchakalinkissue18873 messages
2013-09-16 21:19:40serhiy.storchakacreate