classification
Title: test_urllib2net: issues with ftp://gatekeeper.research.compaq.com/, ftp://ftp.mirror.nl/ and ftp://ftp.kernel.org/
Type: Stage:
Components: Tests Versions: Python 3.5, Python 3.4, Python 2.7
process
Status: closed Resolution: fixed
Dependencies: Superseder:
Assigned To: Nosy List: python-dev, vstinner
Priority: normal Keywords:

Created on 2015-04-07 10:43 by vstinner, last changed 2015-04-07 13:22 by vstinner. This issue is now closed.

Messages (8)
msg240198 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2015-04-07 10:43
test_urllib2net uses multiple public FTP servers. Since yesterday, there are issues with 2 FTP servers:

(1) ftp://gatekeeper.research.compaq.com/pub/DEC/SRC/research-reports/00README-Legal-Rules-Regs
=> DNS server error

$ host gatekeeper.research.compaq.com 8.8.8.8
Host gatekeeper.research.compaq.com not found: 2(SERVFAIL)
$ host gatekeeper.research.compaq.com 212.27.40.240
Host gatekeeper.research.compaq.com not found: 2(SERVFAIL)

(2) ftp://ftp.mirror.nl/pub/gnu/

* The FTP connection succeeded
* Changing the directory to /pub/gnu succeeded
* but listing the content of /pub/gnu/ takes forever...

In Firefox, I get the error "425 Failed to establish connection".
msg240199 - (view) Author: Roundup Robot (python-dev) Date: 2015-04-07 10:50
New changeset 69d4e199b88e by Victor Stinner in branch '2.7':
Issue #23881: urllib.ftpwrapper constructor now closes the socket if the FTP
https://hg.python.org/cpython/rev/69d4e199b88e

New changeset 7b168db16e67 by Victor Stinner in branch '3.4':
Issue #23881: urllib.request.ftpwrapper constructor now closes the socket if
https://hg.python.org/cpython/rev/7b168db16e67

New changeset 1a72c0a1a50f by Victor Stinner in branch 'default':
(Merge 3.4) Issue #23881: urllib.request.ftpwrapper constructor now closes the
https://hg.python.org/cpython/rev/1a72c0a1a50f
msg240200 - (view) Author: Roundup Robot (python-dev) Date: 2015-04-07 11:00
New changeset 40ddcd785f7b by Victor Stinner in branch '3.4':
Issue #23881: ftp://gatekeeper.research.compaq.com/ and ftp://ftp.debian.org/
https://hg.python.org/cpython/rev/40ddcd785f7b

New changeset 225be6be3893 by Victor Stinner in branch '2.7':
ssue #23881: ftp://gatekeeper.research.compaq.com/ and ftp://ftp.debian.org/
https://hg.python.org/cpython/rev/225be6be3893
msg240201 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2015-04-07 11:03
Python 2.7 used ftp://ftp.kernel.org/pub/linux/kernel/README whereas Python 3.4/3.6 uses ftp://ftp.debian.org/debian/README.

Right now, ftp://ftp.kernel.org/pub/linux/kernel/README doesn't respond. So I also modified Python 2.7 to uses ftp.debian.org as Python 3.4/3.5.

Is there a FTP vulnerability in the wild and some public FTP servers are down because of that? Or is it a network connectivity issue?
msg240202 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2015-04-07 11:09
For ftp.kernel.org, it may be related to a FS data corruption bug:

2015-02-03: FTP limited on mirrors.kernel.org
https://www.kernel.org/ftp-limited-on-mirrorskernelorg.html
"We've had to temporarily limit FTP access to mirrors.kernel.org due to high IO load."
msg240203 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2015-04-07 11:11
> $ host gatekeeper.research.compaq.com 212.27.40.240
> Host gatekeeper.research.compaq.com not found: 2(SERVFAIL)

"What happened to gatekeeper.dec.com?"
http://gatekeeper.dec.com/what-happened-to-gatekeeper.html

Maybe we should use ftp://apotheca.hpl.hp.com/ instead?
msg240204 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2015-04-07 11:17
> (2) ftp://ftp.mirror.nl/pub/gnu/

DNS resolution:

$ host ftp.mirror.nl
ftp.mirror.nl is an alias for download.xs4all.nl.
download.xs4all.nl is an alias for dl.xs4all.nl.
dl.xs4all.nl has address 194.109.21.66
dl.xs4all.nl has IPv6 address 2001:888:0:25:194:109:21:66

http://dl.xs4all.nl/ works well, but this site has no /pub/ directory. Is it related?

See also "Dead mirror: ftp.demon.nl"
https://lists.gnupg.org/pipermail/gnupg-devel/2014-November/029113.html
(but it doesn't look to be related)

xs4all hosted python.org, I don't know if it still host the new CDN of python.org.
https://en.wikipedia.org/wiki/XS4ALL#Corporate_culture
"XS4ALL also sponsors and hosts the sites of many free software projects, like Python, Squirrelmail and Debian."
msg240209 - (view) Author: STINNER Victor (vstinner) * (Python committer) Date: 2015-04-07 13:22
test_urllib2net looks to pass on enough buildbots, I close the issue.
History
Date User Action Args
2015-04-07 13:22:37vstinnersetstatus: open -> closed
resolution: fixed
messages: + msg240209
2015-04-07 11:17:37vstinnersetmessages: + msg240204
2015-04-07 11:11:21vstinnersetmessages: + msg240203
2015-04-07 11:09:01vstinnersetmessages: + msg240202
2015-04-07 11:03:39vstinnersetcomponents: + Tests
versions: + Python 2.7, Python 3.4, Python 3.5
2015-04-07 11:03:32vstinnersetmessages: + msg240201
title: test_urllib2net: issues with ftp://gatekeeper.research.compaq.com/ and ftp://ftp.mirror.nl/ -> test_urllib2net: issues with ftp://gatekeeper.research.compaq.com/, ftp://ftp.mirror.nl/ and ftp://ftp.kernel.org/
2015-04-07 11:00:28python-devsetmessages: + msg240200
2015-04-07 10:50:51python-devsetnosy: + python-dev
messages: + msg240199
2015-04-07 10:43:02vstinnercreate