Can we have a newer bundled version of pip for 3.8/3.9?

In particular, I'd really like to be able to use the new location for a pip.ini inside of sys.prefix, as it will fix the problems with "python3 -m pip" on Windows when obtained from the Store (and we want to default to --user).

I might be doing another bugfix, for https://github.com/pypa/pip/issues/6775. I don't think we've decided how to go about that issue yet.

If a week isn't too long a waiting time, I'd suggest we wait for a week and then vendor whatever is the latest at that point.

I'll be happy to file a PR, if we want to go ahead with this. :)

Oh that's a nasty issue... but it sounds like you're reaching some kind of agreement.

3.8b3 is scheduled for this week, so perhaps we can take the current release for now and then update it when you make the next release?

(Also Pradyun, would you like to be added to https://devguide.python.org/experts/ for pip so that you get nosied with that category? I'm happy to do that for you)

Alrighty! Filed gh-14934.

(Sounds good to me. Filed a PR on devguide, adding me to the devguide: https://github.com/python/devguide/pull/513)

New changeset 5380def8269b24a8a3bc46396373a1dc91b1dd1a by Steve Dower (Pradyun Gedam) in branch 'master':
bpo-37664: Update bundled pip to 19.2.1 and setuptools to 41.0.1 (GH-14934)
https://github.com/python/cpython/commit/5380def8269b24a8a3bc46396373a1dc91b1dd1a

New changeset 0cdb21d6eb3428abe50a55f9291ca0e9728654d9 by Miss Islington (bot) in branch '3.8':
bpo-37664: Update bundled pip to 19.2.1 and setuptools to 41.0.1 (GH-14934)
https://github.com/python/cpython/commit/0cdb21d6eb3428abe50a55f9291ca0e9728654d9

Leaving this open until 3.8b4 in case we want to take another update.

This change seems to have buildbot failure on FreeBSD 10 for master and 3.8 branch. I have opened issue37679 . I couldn't find any issues similar to this during previous upgrades.


https://buildbot.python.org/all/#/builders/167/builds/1380


test_with_pip (test.test_venv.EnsurePipTest) ... FAIL
======================================================================
FAIL: test_with_pip (test.test_venv.EnsurePipTest)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/home/buildbot/python/3.x.koobs-freebsd10.nondebug/build/Lib/test/test_venv.py", line 495, in test_with_pip
    self.do_test_with_pip(False)
  File "/usr/home/buildbot/python/3.x.koobs-freebsd10.nondebug/build/Lib/test/test_venv.py", line 478, in do_test_with_pip
    self.assertEqual(err.rstrip(), "")
AssertionError: "WARNING: The directory '/.cache/pip/http[202 chars]lag." != ''
- WARNING: The directory '/.cache/pip/http' or its parent directory is not owned by the current user and the cache has been disabled. Please check the permissions and owner of that directory. If executing pip with sudo, you may want sudo's -H flag.
+ 
----------------------------------------------------------------------

Actually, we're already ignoring this message, but now it includes "WARNING: " at the start and doesn't match the existing regex. So we can just continue to ignore it.

New changeset b1eb20e68e30c8ab128f9d63d622f0a8b49dcf34 by Steve Dower in branch 'master':
bpo-37664: Update regex for ignoring cache warning on some buildbots (GH-14960)
https://github.com/python/cpython/commit/b1eb20e68e30c8ab128f9d63d622f0a8b49dcf34

New changeset c5033901263d64a533ee47a84c6d286a223540c9 by Miss Islington (bot) in branch '3.8':
bpo-37664: Update regex for ignoring cache warning on some buildbots (GH-14960)
https://github.com/python/cpython/commit/c5033901263d64a533ee47a84c6d286a223540c9

Hey Ned, would you like a bundled pip update for 3.7? We haven't gone that far back.

Yeah, we should update 3.7, too, so people don’t keep getting the upgrade warning.

New changeset 0225d58cc8b786caec12f45e9245f90497610a2d by Miss Islington (bot) in branch '3.7':
bpo-37664: Update regex for ignoring cache warning on some buildbots (GH-14960)
https://github.com/python/cpython/commit/0225d58cc8b786caec12f45e9245f90497610a2d

New changeset ea0f7aa47c5d2e58dc99314508172f0523e144c6 by Miss Islington (bot) in branch '3.7':
bpo-37664: Update bundled pip to 19.2.1 and setuptools to 41.0.1 (GH-14934)
https://github.com/python/cpython/commit/ea0f7aa47c5d2e58dc99314508172f0523e144c6

Is pip 19.2.2 worth taking? Or are we expecting another patch this week?

@steve.dower It will be necessary to update to pip 19.2.3 for Python 3.8.0b4 shortly, as per:
https://github.com/pypa/pip/pull/6874#issuecomment-522220364

When updating pip next time, please update setuptools too.
https://setuptools.readthedocs.io/en/latest/history.html#v41-1-0

> #1788: Changed compatibility fallback logic for html.unescape to avoid accessing HTMLParser.unescape when not necessary. HTMLParser.unescape is deprecated and will be removed in Python 3.9.

This is blocking #37328.

There wasn't a new setuptools release when I updated these the last time,
IIRC.

Anyway, I'll cut a new release for pip, file a new b.p.o. issue and get to
updating both of these sometime this week.

On Mon, 19 Aug 2019 at 11:20 AM, Inada Naoki <report@bugs.python.org> wrote:

>
> Inada Naoki <songofacandy@gmail.com> added the comment:
>
> When updating pip next time, please update setuptools too.
> https://setuptools.readthedocs.io/en/latest/history.html#v41-1-0
>
> > #1788: Changed compatibility fallback logic for html.unescape to avoid
> accessing HTMLParser.unescape when not necessary. HTMLParser.unescape is
> deprecated and will be removed in Python 3.9.
>
> This is blocking #37328.
>
> ----------
> nosy: +inada.naoki
>
> _______________________________________
> Python tracker <report@bugs.python.org>
> <https://bugs.python.org/issue37664>
> _______________________________________
>

There's a need for a pip 19.2.3, since there's a bug in wheel tagging logic hasn't been updated for CPython 3.8's new tags. I'll be cutting that release, and filing a PR for updating bundled pip & setuptools, sometime in the next 24 hours. (I just got back from my final mid-semester exam, and really should relax for a bit)

I'm not sure whether we should mark this a release blocker.

Added lukasz since last beta is by Monday.

Made the release and the PR. <https://github.com/python/cpython/pull/15483>

Just getting Łukasz's attention, as this pip release has a critical 3.8 fix for wheel generation (IIUC).

Pradyun - just looking for a NEWS file update in your PR to make sure we have the right version numbers listed.

Thanks for looping me in. Waiting for this to be merged.

New changeset 10c452b894d95fed06056fe11e8fe8e1a2a60040 by Miss Islington (bot) (Pradyun Gedam) in branch 'master':
bpo-37664: Update ensurepip bundled wheels, again (GH-15483)
https://github.com/python/cpython/commit/10c452b894d95fed06056fe11e8fe8e1a2a60040

New changeset c1c1a3396391dcc948d332607a0f673e4434da97 by Miss Islington (bot) (Steve Dower) in branch '3.7':
[3.7] bpo-37664: Update ensurepip bundled wheels, again (GH-15483) (GH-15529)
https://github.com/python/cpython/commit/c1c1a3396391dcc948d332607a0f673e4434da97

New changeset 04b750740be6e7c4a7693f1135c4788b40a028c1 by Steve Dower in branch '3.8':
bpo-37664: Update ensurepip bundled wheels, again (GH-15483)
https://github.com/python/cpython/commit/04b750740be6e7c4a7693f1135c4788b40a028c1

Going to call this complete now. If there's a reason to take another update before 3.8 releases, we should create a new issue.

New changeset e7e58fe03175adc660c192e724b91ae7ccba9cb6 by Benjamin Peterson in branch '2.7':
[2.7] bpo-37664: Update ensurepip bundled wheels, again (GH-16633)
https://github.com/python/cpython/commit/e7e58fe03175adc660c192e724b91ae7ccba9cb6