➜

This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author mher
Recipients benmezger, ezio.melotti, mher
Date 2013-03-19.07:11:21
SpamBayes Score -1.0
Marked as misclassified Yes
Message-id <1363677082.04.0.164492308754.issue17403@psf.upfronthosting.co.za>
In-reply-to
Content 
The second patch only normalizes the url. From http://www.robotstxt.org/norobots-rfc.txt it is not clear how to handle multiple rules with the same prefix.
History
Date User Action Args
2013-03-19 07:11:22mhersetrecipients: + mher, ezio.melotti, benmezger
2013-03-19 07:11:22mhersetmessageid: <1363677082.04.0.164492308754.issue17403@psf.upfronthosting.co.za>
2013-03-19 07:11:22mherlinkissue17403 messages
2013-03-19 07:11:21mhercreate