Message137028
tokenize processes a line at a time, and noticing that an ending triple quote is missing would mean reading the whole file in the worst case. As tokenize seems to work in a generator-like fashion, it's probably not desired to cache all the input to be able to restart from some previous line.
So, I'd go with documenting the behavior. |
|
Date |
User |
Action |
Args |
2011-05-27 07:07:53 | petri.lehtinen | set | recipients:
+ petri.lehtinen, Devin Jeanpierre |
2011-05-27 07:07:53 | petri.lehtinen | set | messageid: <1306480073.75.0.91611263994.issue12063@psf.upfronthosting.co.za> |
2011-05-27 07:07:53 | petri.lehtinen | link | issue12063 messages |
2011-05-27 07:07:52 | petri.lehtinen | create | |
|