Author serhiy.storchaka
Recipients Anthony Sottile, BTaskaya, cstratak, gvanrossum, lys.nikolaou, ned.deily, pablogsal, serhiy.storchaka, vstinner
Date 2020-04-27.19:21:03
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1588015263.18.0.193252949588.issue40334@roundup.psfhosted.org>
In-reply-to
Content
The parser generator imports modules token and tokenize. It is not correct, because they are relevant to the Python version used to run the parser generator, and not to the Python version for which the parser is generated. It works currently only because there is no differences between 3.8 and 3.9, but it will fail when you add a new token or change/remove an old one.

It should either parse the correct Grammar/Tokens file, or read the content of corresponding files Lib/token.py and Lib/tokenize.py and evaluate them with eval(). See for example Tools/scripts/generate_token.py.
History
Date User Action Args
2020-04-27 19:21:03serhiy.storchakasetrecipients: + serhiy.storchaka, gvanrossum, vstinner, ned.deily, Anthony Sottile, cstratak, lys.nikolaou, pablogsal, BTaskaya
2020-04-27 19:21:03serhiy.storchakasetmessageid: <1588015263.18.0.193252949588.issue40334@roundup.psfhosted.org>
2020-04-27 19:21:03serhiy.storchakalinkissue40334 messages
2020-04-27 19:21:03serhiy.storchakacreate