Message209137
Consider this simple unit test:
def test_tokenize():
input = "if False:\n\tx=3\n\ty=3\n"
g = list(generate_tokens(io.StringIO(input).readline))
assert untokenize(g) == input
According to the docs, untokenize guarantees the output equals the input to tokenize: http://docs.python.org/2/library/tokenize.html#tokenize.untokenize
As this test fails on Python 2 and Python 3 (use io.BytesIO on Python 2), I believe the test illustrates a violation of this guarantee. The second line in the if block gets its tab replaced by a space.
As the input is valid Python Syntax, this behavior is particularly surprising. |
|
Date |
User |
Action |
Args |
2014-01-24 22:51:15 | jaraco | set | recipients:
+ jaraco |
2014-01-24 22:51:15 | jaraco | set | messageid: <1390603875.19.0.598751073352.issue20387@psf.upfronthosting.co.za> |
2014-01-24 22:51:15 | jaraco | link | issue20387 messages |
2014-01-24 22:51:14 | jaraco | create | |
|