This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author meador.inge
Recipients meador.inge, takluyver
Date 2013-02-03.04:12:32
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1359864752.74.0.795046293103.issue17061@psf.upfronthosting.co.za>
In-reply-to
Content
The current behavior seems consistent with the lexical definition for
blank lines [1]:

"""
A logical line that contains only spaces, tabs, formfeeds and possibly a
comment, is ignored (i.e., no NEWLINE token is generated).
"""

NL and COMMENT are used for items that the CPython tokenizer
ignores (and are not really tokens).  Also, the test suite explicitly
tests for this case.

Perhaps the tokenize documentation should be updated
to say something like:

"""
NL tokens are generated when a logical line of code is continued over
multiple physical lines and for blank lines.
"""

[1] http://docs.python.org/3.4/reference/lexical_analysis.html#blank-lines
History
Date User Action Args
2013-02-03 04:12:32meador.ingesetrecipients: + meador.inge, takluyver
2013-02-03 04:12:32meador.ingesetmessageid: <1359864752.74.0.795046293103.issue17061@psf.upfronthosting.co.za>
2013-02-03 04:12:32meador.ingelinkissue17061 messages
2013-02-03 04:12:32meador.ingecreate