➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author r.david.murray
Recipients acooke, benmezger, ezio.melotti, mher, r.david.murray
Date 2013-04-21.20:30:35
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1366576235.23.0.193484485923.issue17403@psf.upfronthosting.co.za>
In-reply-to
Content 
Lucaz pointed out on IRC that the problem is that the current robotparser is implementing an outdated robots.txt standard.  He may work on fixing that.
History
Date User Action Args
2013-04-21 20:30:35r.david.murraysetrecipients: + r.david.murray, ezio.melotti, acooke, mher, benmezger
2013-04-21 20:30:35r.david.murraysetmessageid: <1366576235.23.0.193484485923.issue17403@psf.upfronthosting.co.za>
2013-04-21 20:30:35r.david.murraylinkissue17403 messages
2013-04-21 20:30:35r.david.murraycreate