Author dualbus
Recipients dualbus, ezio.melotti, orsenthil, terry.reedy
Date 2012-09-09.21:37:59
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <20120909213740.GB5726@claret.lan>
In-reply-to <1347045054.66.0.127391915664.issue15851@psf.upfronthosting.co.za>
Content
I'm not sure what's the best approach here.

1. Avoid changes in the Lib, and document a work-around, which involves
   installing an opener with the specific User-agent. The draw-back is that it
   modifies the behaviour of urlopen() globally, so that change affects any
   other call to urllib.request.urlopen.

2. Revert to the old way, using an instance of a FancyURLopener (or URLopener),
   in the RobotFileParser class. This requires a modification of the Lib, but
   allows us to modify only the behaviour of that specific instance of
   RobotFileParser. The user could sub-class FancyURLopener, set the appropiate
   version string.

I attach a script, tested against the ``default`` branch of the mercurial
repository. It shows the work around for python3.3.
Files
File name Uploaded
test.py dualbus, 2012-09-09.21:37:59
History
Date User Action Args
2012-09-09 21:37:59dualbussetrecipients: + dualbus, terry.reedy, orsenthil, ezio.melotti
2012-09-09 21:37:59dualbuslinkissue15851 messages
2012-09-09 21:37:59dualbuscreate