This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author Aivar.Annamaa
Recipients Aivar.Annamaa, berker.peksag
Date 2017-09-08.17:36:16
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1504892176.6.0.37874711925.issue31394@psf.upfronthosting.co.za>
In-reply-to
Content
(Sorry, I didn't mean to challenge the authority of a core developer. I simply didn't notice that adding a comment reopens the issue. I hope this time I selected correct parameters and this doesn't happen again)

I'm trying to rephrase my concern. 

Initially I thought there was a mistake in the tokenizer or in the token module.

After you pointed out the documentation about token.OP and exact_type, I'm worried about a smaller detail. The documentation only talks about *operators* and *delimiters* having type attribute set to token.OP. According to my understanding (and also the listings at https://docs.python.org/3/reference/lexical_analysis.html#operators), ellipsis is neither operator nor delimiter. 

Am I right about this? 

(I understand that the source representation of both ELLIPSIS and DOT tokens contains period *character(s)*, but I don't see why is this relevant when we discuss the properties of *tokens*)

Anyway, if ellipsis is neither operator nor delimiter, (and if there is a reason why it is treated similarly with operators and delimiters) then I recommend to update the documentation by replacing 

> all Operators and Delimiters tokens 
> are returned using the generic token.OP token type

with 

> all Operators, Delimiters and Ellipsis tokens
> are returned using the generic token.OP token type


(I understand, that this is not a serious issue. If you prefer not to discuss it further then I'm happy to leave it as it is.)
History
Date User Action Args
2017-09-08 17:36:16Aivar.Annamaasetrecipients: + Aivar.Annamaa, berker.peksag
2017-09-08 17:36:16Aivar.Annamaasetmessageid: <1504892176.6.0.37874711925.issue31394@psf.upfronthosting.co.za>
2017-09-08 17:36:16Aivar.Annamaalinkissue31394 messages
2017-09-08 17:36:16Aivar.Annamaacreate