This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author ammar2
Recipients Isaac Elliott, ammar2, serhiy.storchaka
Date 2018-06-04.04:51:27
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1528087887.19.0.592728768989.issue33766@psf.upfronthosting.co.za>
In-reply-to
Content
Actually, echo implicitly puts a newline at the end. If you run with echo -n, this is the output:

$ echo -n 'print("a");print("b")' | python3 -m tokenize
1,0-1,5:            NAME           'print'
1,5-1,6:            OP             '('
1,6-1,9:            STRING         '"a"'
1,9-1,10:           OP             ')'
1,10-1,11:          OP             ';'
1,11-1,16:          NAME           'print'
1,16-1,17:          OP             '('
1,17-1,20:          STRING         '"b"'
1,20-1,21:          OP             ')'
2,0-2,0:            ENDMARKER      ''

No newline token present.
History
Date User Action Args
2018-06-04 04:51:27ammar2setrecipients: + ammar2, serhiy.storchaka, Isaac Elliott
2018-06-04 04:51:27ammar2setmessageid: <1528087887.19.0.592728768989.issue33766@psf.upfronthosting.co.za>
2018-06-04 04:51:27ammar2linkissue33766 messages
2018-06-04 04:51:27ammar2create