Author r.david.murray
Recipients acooke, benmezger, ezio.melotti, mher.movsisyan, r.david.murray
Date 2013-04-21.20:30:35
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1366576235.23.0.193484485923.issue17403@psf.upfronthosting.co.za>
In-reply-to
Content
Lucaz pointed out on IRC that the problem is that the current robotparser is implementing an outdated robots.txt standard.  He may work on fixing that.
History
Date User Action Args
2013-04-21 20:30:35r.david.murraysetrecipients: + r.david.murray, ezio.melotti, acooke, mher.movsisyan, benmezger
2013-04-21 20:30:35r.david.murraysetmessageid: <1366576235.23.0.193484485923.issue17403@psf.upfronthosting.co.za>
2013-04-21 20:30:35r.david.murraylinkissue17403 messages
2013-04-21 20:30:35r.david.murraycreate