This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author ammar2
Recipients Isaac Elliott, ammar2, docs@python, gvanrossum, serhiy.storchaka
Date 2018-06-04.05:37:06
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <>
Sorry, I was already working on the patch by the time you posted the comment. If we see above, it seems like the tokenize module doesn't correctly mirror the behavior of the C tokenizer. Do you want to try fixing that as a bug? That would involve making a new bpo ticket and submitting a PR there.
Date User Action Args
2018-06-04 05:37:06ammar2setrecipients: + ammar2, gvanrossum, docs@python, serhiy.storchaka, Isaac Elliott
2018-06-04 05:37:06ammar2setmessageid: <>
2018-06-04 05:37:06ammar2linkissue33766 messages
2018-06-04 05:37:06ammar2create