I'm using python 2.7. My system is windows 7(64-bit). I also use proxy.
urllib2.urlopen usually implements 0,2..1sec but sometimes sends a strange UDP to 137 port (netbios-ns) of the remote server, waits 4..6 sec. and then sends HTTP-request.
If I disable Netbios over TCP/IP in my system settings no UDP to 137 port is sent, but urlopen still implements 4..6sec.
I've found out that the delay happens in
_socket.gethostbyaddr(HostName)
called by socket.getfqdn(HostName)
called by urllib.proxy_bypass_registry(HostName)
called by urllib.proxy_bypass(HostName)
called by urllib2.ProxyHandler.proxy_open
HostName='pykasso.rc-online.ru'
"nslookup pykasso.rc-online.ru" works quickly in my computer
I suppose the problem is that the hostname is passed into gethostbyaddr instead of IP
If I add an IP-verification of the string before socket.getfqdn() call in urllib.proxy_bypass_registry()
try:
socket.inet_aton(rawHost) #### I added this operator
fqdn = socket.getfqdn(rawHost)
if fqdn != rawHost:
host.append(fqdn)
except socket.error:
pass
then no delay happens.
My proposal is to make an IP-verification in urllib.proxy_bypass_registry() or to add an opportunity for a programmer to refuse a proxy bypass attempt
|