Message348117
Both C and Python tokenizers emit NEWLINE tokens on continued blank lines. Because of this it is possible to emit repeated NEWLINEs, which some tools don't expect to happen.
I've attached example source file which is tokenized into 3 NEWLINE tokens in a row. |
|
Date |
User |
Action |
Args |
2019-07-18 14:13:50 | miedzinski | set | recipients:
+ miedzinski |
2019-07-18 14:13:50 | miedzinski | set | messageid: <1563459230.52.0.916101188848.issue37621@roundup.psfhosted.org> |
2019-07-18 14:13:50 | miedzinski | link | issue37621 messages |
2019-07-18 14:13:50 | miedzinski | create | |
|