Title: Eliminate bindings for partial pattern matches
Type: enhancement Stage: patch review
Components: Interpreter Core Versions: Python 3.10
Status: open Resolution:
Dependencies: Superseder:
Assigned To: brandtbucher Nosy List: Mark.Shannon, brandtbucher, gvanrossum, pablogsal
Priority: normal Keywords: patch

Created on 2021-04-06 20:00 by brandtbucher, last changed 2021-04-08 00:14 by brandtbucher.

Pull Requests
URL Status Linked Edit
PR 25229 open brandtbucher, 2021-04-06 20:00
Messages (2)
msg390368 - (view) Author: Brandt Bucher (brandtbucher) * (Python committer) Date: 2021-04-06 20:00
This draft PR contains a couple of pattern matching improvements I'm experimenting with. Most significantly, it implements behavior that several people requested during the PEP 634 feedback process: no more name bindings for partial matches.

(One caveat: all names are bound *before* evaluating the corresponding guard. If the guard fails, these bindings won't be rolled back before matching the next case.)

In short, this is accomplished by storing captured objects on the stack underneath the more immediately important stuff, popping them all on failure or storing them all only once the *entire* pattern for that case matches. The control flow needs to be greatly simplified in order to make this work correctly, so the patch replaces the current "push bools and jump if false a bunch of times" flow with something much more efficient: jumping straight into a run of POP_TOPs on failure. We already do something very similar to this in pattern_helper_sequence_unpack (the comments in the current code explain it well).

Parts of the new code are a bit more complex than before (especially or-patterns, which need to do a bit of juggling on the stack to reorder captured items and avoid popping important data on failure), and other parts can certainly still be improved... but I personally consider it a win to have more intuitive partial match behavior with no performance penalty.

I thought I'd loop a few of you in on it to hear your thoughts before progressing much further.
msg390499 - (view) Author: Brandt Bucher (brandtbucher) * (Python committer) Date: 2021-04-08 00:14
Guido informed me that Mark is currently maintaining a PEP 653 implementation branch. I checked it out today, and it looks like it has *lots* of conflicts with this one.

For the time being, I'm going to experiment with other ways of accomplishing this that don't involve rewriting most of the pattern compiler. That way we can minimize potential merge conflicts.
Date User Action Args
2021-04-08 00:14:13brandtbuchersetmessages: + msg390499
2021-04-06 20:00:41brandtbuchersetkeywords: + patch
stage: patch review
pull_requests: + pull_request23966
2021-04-06 20:00:31brandtbuchercreate