This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author Aaron.Meurer
Recipients Aaron.Meurer, Jim Fasarakis-Hilliard, meador.inge, skrah, veky
Date 2018-06-06.17:33:01
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1528306382.03.0.592728768989.issue24622@psf.upfronthosting.co.za>
In-reply-to
Content
I would suggest adding this to the what's new document https://docs.python.org/3.7/whatsnew/3.7.html. The change affects user-facing code (the exact_type attribute of TokenInfo is OP for ... and -> tokens prior to this patch). 

I would also point out that this directly contradicts the documentation (from https://docs.python.org/3/library/tokenize.html, "To simplify token stream handling, all operator and delimiter tokens and Ellipsis are returned using the generic OP token type. The exact type can be determined by checking the exact_type property on the named tuple returned from tokenize.tokenize()."), so I don't see why it can't be backported.
History
Date User Action Args
2018-06-06 17:33:02Aaron.Meurersetrecipients: + Aaron.Meurer, skrah, meador.inge, veky, Jim Fasarakis-Hilliard
2018-06-06 17:33:02Aaron.Meurersetmessageid: <1528306382.03.0.592728768989.issue24622@psf.upfronthosting.co.za>
2018-06-06 17:33:02Aaron.Meurerlinkissue24622 messages
2018-06-06 17:33:01Aaron.Meurercreate