This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author ned.deily
Recipients Mariatta, docs@python, matrixise, mdk, ned.deily, steven.daprano
Date 2018-12-07.21:11:44
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1544217104.77.0.788709270274.issue35435@psf.upfronthosting.co.za>
In-reply-to
Content
> I think as it stands, this ticket is "not a bug".

Indeed, this is not only not a bug, it's a feature that the docs for every Python release family are available on-line.  That said, we do have two sets of URLs that point to these docs:

1. https://docs.python.org/release/x.y.z/ which is the canonical link to the docs for a particular release and linked to from https://www.python.org/doc/versions/

2. https://docs.python.org/x.y/ (along with /x) which points to the most recent top of branch doc build for that branch.  For the next feature release branch (master) and branches still in bug-fix mode, the docs are automatically updated several times a day.  For 2.x and 3.x branches in security-fix mode or at end-of-life (retired), there are symlinks here that point to the doc set for the most recent release of that branch, i.e. the same doc set available in https://docs.python.org/release/x.y.z/.

There is already in place a restriction in the robots.txt file for the docs.python.org server to not webcrawl anything under /release but there is nothing (AFAICT) telling webcrawlers to ignore the "symlinked" aliases at /x.y, and that would seem to be the case here.

Without spending too much time on it, it seems to me there are s number of issues here:
1. What URL schemes do we have and want to continue to support?
2. What things do we want to show up in search engine results?
3. How do we make that happen?
4. How do we maintain this going forward?

One possibility that comes to mind:
1. unchanged from today
2. just the most current 3.x maintenance release (e.g. today 3.7)?  People needing accessing to other current or security-fix branches (dev, 3.6, 2.7, 3.5) can access those docsets through the version switcher pulldown on the doc webpages.
3. What isn't so obvious today is how to get to docsets for other, older releases.  For that, perhaps we could add an "Other ..." or some such item to the version switcher list that would link to the complete list at https://www.python.org/doc/versions/ ?
4. If we think it is important to indefinitely provide the links at https://docs.python.org/x.y/ even after the release is retired, we could add a step to the release process to add an entry to robots.txt when a release enters security-fix-mode ?  Or earlier?  That gets back to question 2.

I think this all is something for our release docs expert, Julien, to look into.
History
Date User Action Args
2018-12-07 21:11:44ned.deilysetrecipients: + ned.deily, steven.daprano, docs@python, matrixise, mdk, Mariatta
2018-12-07 21:11:44ned.deilysetmessageid: <1544217104.77.0.788709270274.issue35435@psf.upfronthosting.co.za>
2018-12-07 21:11:44ned.deilylinkissue35435 messages
2018-12-07 21:11:44ned.deilycreate