Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

pdb.main is unnecessarily complicated #88720

Closed
jaraco opened this issue Jul 2, 2021 · 3 comments
Closed

pdb.main is unnecessarily complicated #88720

jaraco opened this issue Jul 2, 2021 · 3 comments
Labels
3.11 only security fixes stdlib Python modules in the Lib dir

Comments

@jaraco
Copy link
Member

jaraco commented Jul 2, 2021

BPO 44554
Nosy @jaraco, @miss-islington, @iritkatriel
PRs
  • bpo-44554: refactor pdb targets (and internal tweaks) #26992
  • Note: these values reflect the state of the issue at the time it was migrated and might not reflect the current state.

    Show more details

    GitHub fields:

    assignee = None
    closed_at = <Date 2021-07-19.21:19:19.151>
    created_at = <Date 2021-07-02.20:47:01.988>
    labels = ['library', '3.11']
    title = 'pdb.main is unnecessarily complicated'
    updated_at = <Date 2021-07-19.21:19:19.150>
    user = 'https://github.com/jaraco'

    bugs.python.org fields:

    activity = <Date 2021-07-19.21:19:19.150>
    actor = 'iritkatriel'
    assignee = 'none'
    closed = True
    closed_date = <Date 2021-07-19.21:19:19.151>
    closer = 'iritkatriel'
    components = ['Library (Lib)']
    creation = <Date 2021-07-02.20:47:01.988>
    creator = 'jaraco'
    dependencies = []
    files = []
    hgrepos = []
    issue_num = 44554
    keywords = ['patch']
    message_count = 3.0
    messages = ['396877', '397749', '397774']
    nosy_count = 3.0
    nosy_names = ['jaraco', 'miss-islington', 'iritkatriel']
    pr_nums = ['26992']
    priority = 'normal'
    resolution = 'fixed'
    stage = 'resolved'
    status = 'closed'
    superseder = None
    type = None
    url = 'https://bugs.python.org/issue44554'
    versions = ['Python 3.11']

    @jaraco
    Copy link
    Member Author

    jaraco commented Jul 2, 2021

    While investigating bpo-44461, I observed some complexities to the current pdb.main implementation, some of which likely contributed to the bug being present.

    • variables are initialized to defaults (

      cpython/Lib/pdb.py

      Lines 1677 to 1678 in ec8759b

      commands = []
      run_as_module = False
      ) and then mutated (

      cpython/Lib/pdb.py

      Lines 1684 to 1686 in ec8759b

      commands.append(optarg)
      elif opt in ['-m']:
      run_as_module = True
      ) based on other variables.

    • mainpyfile is conditionally mutated based on previous values of conditionally mutated variables (

      mainpyfile = os.path.realpath(mainpyfile)
      ).

    • There are three different blocks of code (

      cpython/Lib/pdb.py

      Lines 1690 to 1691 in ec8759b

      print('Error:', mainpyfile, 'does not exist')
      sys.exit(1)
      ,

      cpython/Lib/pdb.py

      Lines 1696 to 1698 in ec8759b

      mainpyfile = os.path.realpath(mainpyfile)
      # Replace pdb's dir with script's dir in front of module search path.
      sys.path[0] = os.path.dirname(mainpyfile)
      , and
      pdb._runscript(mainpyfile)
      ) that are conditionally run based on run_as_module.

    These factors mean that all of these lines of code are entangled in ways that are somewhat difficult to reason about. For example, it's unclear what states have been achieved by the time pdb._run* is constructed, or what exceptions may or may not be expected for these calls.

    A functional or OO approach would limit the amount of mutation and entanglement (through encapsulation or scoping).

    An OO approach would have a protocol or interface that captures the different behaviors required prior to and on invocation of Pdb._run*.

    For example, the PDB "targets" (script or module) could be modeled as separate classes and provide symmetric interfaces with (possibly degenerate) equivalent operations for each use-case.

    To be sure, the code that's present is adequate and in my opinion right on the border of benefiting from a more rigorous abstraction. The current imperative approach is fairly readable and mostly comprehensible. It's only because of the surprise behavior in the reported issue that I propose to step back and contemplate ways to alleviate the concerns above.

    @jaraco jaraco added 3.11 only security fixes stdlib Python modules in the Lib dir labels Jul 2, 2021
    @jaraco
    Copy link
    Member Author

    jaraco commented Jul 18, 2021

    Additional problems I noticed while working on the refactor:

    • There is a lot of overlap in behavior between the implementations of _run_script and _run_module (initializing private variables, setting mainpyfile, resetting the __main__ namespace).

    • There are two block comments in _run_script whose behaviors apply to _run_module as well, but the block comments are not associated with those behaviors in _run_module.

    @miss-islington
    Copy link
    Contributor

    New changeset 2c20558 by Jason R. Coombs in branch 'main':
    bpo-44554: refactor pdb targets (and internal tweaks) (GH-26992)
    2c20558

    @ezio-melotti ezio-melotti transferred this issue from another repository Apr 10, 2022
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Labels
    3.11 only security fixes stdlib Python modules in the Lib dir
    Projects
    None yet
    Development

    No branches or pull requests

    3 participants