This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Title: Let's retire pgen
Type: Stage: resolved
Components: Build Versions: Python 3.8
Status: closed Resolution: fixed
Dependencies: Superseder:
Assigned To: Nosy List: BTaskaya, ammar2, eamanu, ethan smith, gvanrossum, levkivskyi, pablogsal, serhiy.storchaka
Priority: low Keywords: patch, patch, patch

Created on 2019-01-23 05:32 by gvanrossum, last changed 2022-04-11 14:59 by admin. This issue is now closed.

Pull Requests
URL Status Linked Edit
PR 11814 merged pablogsal, 2019-02-11 00:49
PR 20405 merged ammar2, 2020-05-26 04:05
Messages (5)
msg334247 - (view) Author: Guido van Rossum (gvanrossum) * (Python committer) Date: 2019-01-23 05:32
Pgen is literally the oldest piece of technology in the CPython repo -- it was the first thing I wrote for Python over 29 years ago. It's not aged well, and building it requires various #if[n]def PGEN hacks in other parts of the code; it also depends more and more on CPython internals. There already is a replacement written in pure Python (Lib/lib2to3/pgen/), it just needs some glue to actually generate the graminit.[ch] files. Note that several other essential generation steps (everything listed for regen-all except regen-importlib and clinic) already depend on having a working Python interpreter around, so let's not worry about the bootstrapping process.
msg334482 - (view) Author: Emmanuel Arias (eamanu) * Date: 2019-01-28 17:53

I can help if you consider it appropriate :-)
msg334488 - (view) Author: Guido van Rossum (gvanrossum) * (Python committer) Date: 2019-01-28 19:57
@eamanu, feel free to submit a PR. I won't be available to guide you through the steps; there are other forums e.g. Zulip.
msg335591 - (view) Author: Serhiy Storchaka (serhiy.storchaka) * (Python committer) Date: 2019-02-15 08:39
I didn't look at the PR yet, but this is a wonderful idea. I planned to do this just after rewriting generators of token-related data and code in Python (issue30455), but Pablo has overfoot me. Great!
msg336972 - (view) Author: Pablo Galindo Salgado (pablogsal) * (Python committer) Date: 2019-03-01 23:34
New changeset 1f24a719e7be5e49b876a5dc7daf21d01ee69faa by Pablo Galindo in branch 'master':
bpo-35808: Retire pgen and use pgen2 to generate the parser (GH-11814)
Date User Action Args
2022-04-11 14:59:10adminsetgithub: 79989
2020-05-26 04:05:22ammar2setnosy: + ammar2

pull_requests: + pull_request19667
2019-03-01 23:35:16pablogsalsetkeywords: patch, patch, patch
status: open -> closed
resolution: fixed
stage: patch review -> resolved
2019-03-01 23:34:46pablogsalsetmessages: + msg336972
2019-02-15 08:39:27serhiy.storchakasetkeywords: patch, patch, patch
nosy: + serhiy.storchaka
messages: + msg335591

2019-02-11 00:50:42pablogsalsetpull_requests: - pull_request11829
2019-02-11 00:50:28pablogsalsetpull_requests: - pull_request11830
2019-02-11 00:49:16pablogsalsetkeywords: + patch
stage: needs patch -> patch review
pull_requests: + pull_request11830
2019-02-11 00:49:08pablogsalsetkeywords: + patch
stage: needs patch -> needs patch
pull_requests: + pull_request11829
2019-02-11 00:49:00pablogsalsetkeywords: + patch
stage: needs patch -> needs patch
pull_requests: + pull_request11828
2019-02-09 16:58:23pablogsalsetnosy: + pablogsal
2019-01-28 19:57:59gvanrossumsetmessages: + msg334488
2019-01-28 17:53:30eamanusetnosy: + eamanu
messages: + msg334482
2019-01-28 11:51:59BTaskayasetnosy: + BTaskaya
2019-01-25 18:40:28levkivskyisetnosy: + levkivskyi
2019-01-23 05:54:47ethan smithsetnosy: + ethan smith
2019-01-23 05:32:17gvanrossumcreate