This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

ID Activity Title Status Creator Assigned To Type
42729 23 months ago tokenize, ast: No direct way to parse tokens into AST, a gap in the language processing pipiline has PR closed pfalcon    
38953 23 months ago Untokenize and retokenize does not round-trip open Zac Hatfield-Dodds   behavior
38663 23 months ago Untokenize does not round-trip ws before bs-nl open edreamleo   behavior
35297 23 months ago untokenize documentation is not correct open csernazs docs@python  
35107 23 months ago untokenize() fails on tokenize output when a newline is missing closed gregory.p.smith    
27112 23 months ago tokenize.__all__ list is incomplete has patch open Unit03   enhancement
26199 23 months ago fix broken link to hamcrest.library.integration.match_equality in unittest.mock "getting started" documentation has patch closed das-g docs@python  
25977 23 months ago Typo fixes in Lib/tokenize.py has patch closed johnwalker docs@python enhancement
25661 23 months ago tokenize.untokenize does not maintain the order of tabbed indentations and leading spaces closed Blake Hilliard   behavior
25317 23 months ago Convert test_tokenize to unittests has patch closed serhiy.storchaka serhiy.storchaka enhancement
24447 23 months ago tab indentation breaks in tokenize.untokenize closed gumblex   behavior
24145 23 months ago Support |= for parameters in converters open larry larry enhancement
20750 23 months ago Roundtrip-test tokenize.untokenize(iterable_of_5_tuples) open terry.reedy terry.reedy behavior
20739 23 months ago PEP 463 (except expression) implementation has patch closed twouters   enhancement
20387 23 months ago tokenize/untokenize roundtrip fails with tabs has patch closed jaraco jaraco  
16224 23 months ago tokenize.untokenize() misbehaves when moved to "compatiblity mode" has patch closed eric.snow terry.reedy behavior
16223 23 months ago [doc] untokenize returns a string if no encoding token is recognized has patch open eric.snow terry.reedy behavior
16221 23 months ago tokenize.untokenize() "compat" mode misses the encoding when using an iterator has patch closed eric.snow   behavior
13012 23 months ago Allow keyword argument in str.splitlines() has patch closed mark.dickinson mark.dickinson enhancement
12943 23 months ago tokenize: add python -m tokenize support back has patch closed meador.inge meador.inge enhancement
12691 23 months ago tokenize.untokenize is broken has patch closed gdr@garethrees.org terry.reedy behavior
12675 23 months ago tokenize module happily tokenizes code with syntax errors open gdr@garethrees.org   behavior
12486 23 months ago tokenize module should have a unicode API has patch has PR closed Devin Jeanpierre   enhancement
10386 23 months ago token module should define __all__ has patch closed belopolsky belopolsky  
10335 23 months ago tokenize.open(): open a file with encoding detected from a coding cookie has patch closed vstinner   enhancement
10258 23 months ago Fix resource warnings in test_tokenize has patch closed bbrazil brian.curtin resource usage
9974 23 months ago tokenizer.untokenize not invariant with line continuations closed Brian.Bossé terry.reedy behavior
9969 23 months ago tokenize: add support for tokenizing 'str' objects has patch open meador.inge   enhancement
8566 23 months ago 2to3 should run under python 2.5 has patch closed jyasskin benjamin.peterson  
8478 23 months ago tokenize.untokenize first token missing failure case has patch closed rb terry.reedy behavior
7092 23 months ago Test suite emits many DeprecationWarnings when -3 is enabled has patch closed exarkun ezio.melotti behavior
6143 23 months ago IDLE - clear and restart the shell window has patch has PR open roger.serwy terry.reedy enhancement
5857 23 months ago Return namedtuples from tokenize token generator closed mallyvai rhettinger enhancement
2621 23 months ago rename test_support to support has patch closed benjamin.peterson benjamin.peterson enhancement
2495 23 months ago tokenize doesn't handle __future__.unicode_literals correctly has PR closed christian.heimes    
2134 23 months ago Add new attribute to TokenInfo to report specific token IDs has patch closed gpolo docs@python enhancement
1675363 23 months ago PEP 3114 -- next() -> __next__() has patch closed georg.brandl gvanrossum  
1660500 23 months ago Hide iteration variable in list comprehensions has patch closed ncoghlan georg.brandl  
1548388 23 months ago set comprehensions has patch closed georg.brandl georg.brandl  
719888 23 months ago tokenize module w/ coding cookie has patch closed barry trent  
Download as CSV
Sort on: Descending:
Descending:
Group on: Descending:
Descending: