Message 385553 - Python tracker

➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author	terry.reedy
Recipients	gvanrossum, lys.nikolaou, pablogsal, romanows, terry.reedy
Date	2021-01-23.17:50:19
SpamBayes Score	-1.0
Marked as misclassified	Yes
Message-id	<1611424219.58.0.374242716352.issue42974@roundup.psfhosted.org>
In-reply-to

Content
The question in the issue for tokenizer and virtual newlines is mimicking the C tokenizer versus consistency between and within token 5-tuples. As a tokenizer user, I would lean toward consistency but it is definitely not my call. https://github.com/python/cpython/pull/24260/files has several tokenize.c warnings like this: '=': conversion from '__int64' to 'int', possible loss of data

The question in the issue for tokenizer and virtual newlines is mimicking the C tokenizer versus consistency between and within token 5-tuples.

As a tokenizer user, I would lean toward consistency but it is definitely not my call.

https://github.com/python/cpython/pull/24260/files has several tokenize.c warnings like this:
'=': conversion from '__int64' to 'int', possible loss of data

History
Date	User	Action	Args
2021-01-23 17:50:19	terry.reedy	set	recipients: + terry.reedy, gvanrossum, lys.nikolaou, pablogsal, romanows
2021-01-23 17:50:19	terry.reedy	set	messageid: <1611424219.58.0.374242716352.issue42974@roundup.psfhosted.org>
2021-01-23 17:50:19	terry.reedy	link	issue42974 messages
2021-01-23 17:50:19	terry.reedy	create