➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author tim.peters
Recipients
Date 2001-03-21.02:22:57
SpamBayes Score
Marked as misclassified
Message-id
In-reply-to
Content 
Logged In: YES 
user_id=31435

Yes, it should be, but Ping doesn't know about NL:  Guido 
added that one.  Python's real tokenizer has no such token 
type.  It was added because-- unlike Python's real 
tokenizer --tokenizer.py passes *everything* on to the 
client, including blank lines and comments, so passes on 
newlines that aren't NEWLINEs too.  Reassigned to Guido in 
case he remembers more about the details ...
History
Date User Action Args
2007-08-23 13:53:37adminlinkissue410155 messages
2007-08-23 13:53:37admincreate