This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author orsenthil
Recipients mikejs, orsenthil, skybrian
Date 2010-07-28.16:37:55
SpamBayes Score 0.0017631685
Marked as misclassified No
Message-id <1280335077.96.0.779122103695.issue6325@psf.upfronthosting.co.za>
In-reply-to
Content
I modified the patch slightly (so that it takes care of path, query, params and fragments).

Fixed in r83209,r83210 and r83211.

I also think that we need to move the robotparser to allow regexs in the allow and disallow patterns. ( Shall open an issue in the tracker, if it is not already present).
History
Date User Action Args
2010-07-28 16:37:58orsenthilsetrecipients: + orsenthil, skybrian, mikejs
2010-07-28 16:37:57orsenthilsetmessageid: <1280335077.96.0.779122103695.issue6325@psf.upfronthosting.co.za>
2010-07-28 16:37:55orsenthillinkissue6325 messages
2010-07-28 16:37:55orsenthilcreate