Message181241
The current behavior seems consistent with the lexical definition for
blank lines [1]:
"""
A logical line that contains only spaces, tabs, formfeeds and possibly a
comment, is ignored (i.e., no NEWLINE token is generated).
"""
NL and COMMENT are used for items that the CPython tokenizer
ignores (and are not really tokens). Also, the test suite explicitly
tests for this case.
Perhaps the tokenize documentation should be updated
to say something like:
"""
NL tokens are generated when a logical line of code is continued over
multiple physical lines and for blank lines.
"""
[1] http://docs.python.org/3.4/reference/lexical_analysis.html#blank-lines |
|
Date |
User |
Action |
Args |
2013-02-03 04:12:32 | meador.inge | set | recipients:
+ meador.inge, takluyver |
2013-02-03 04:12:32 | meador.inge | set | messageid: <1359864752.74.0.795046293103.issue17061@psf.upfronthosting.co.za> |
2013-02-03 04:12:32 | meador.inge | link | issue17061 messages |
2013-02-03 04:12:32 | meador.inge | create | |
|