Author serhiy.storchaka
Recipients Albert-Jan Nijburg, benjamin.peterson, matrixise, meador.inge, r.david.murray, serhiy.storchaka, vstinner
Date 2017-05-31.11:10:44
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1496229044.29.0.572035730487.issue30455@psf.upfronthosting.co.za>
In-reply-to
Content 
The regular expression tokenize.Funny also can be generated. Information is not enough for distinguish between Operator, Bracket and Special, but seems this isn't needed.

Some token names can be generated from Grammar/Grammar. But needed an additional mapping for relations between token strings and names ('+' <-> PLUS, etc).
History
Date User Action Args
2017-05-31 11:10:44serhiy.storchakasetrecipients: + serhiy.storchaka, vstinner, benjamin.peterson, r.david.murray, meador.inge, matrixise, Albert-Jan Nijburg
2017-05-31 11:10:44serhiy.storchakasetmessageid: <1496229044.29.0.572035730487.issue30455@psf.upfronthosting.co.za>
2017-05-31 11:10:44serhiy.storchakalinkissue30455 messages
2017-05-31 11:10:44serhiy.storchakacreate