This issue tracker has been migrated to GitHub, and is currently read-only.
For more information, see the GitHub FAQs in the Python's Developer Guide.

Author mbloore
Recipients mbloore
Date 2008-07-24.15:50:19
SpamBayes Score 0.0311823
Marked as misclassified No
Message-id <1216914625.92.0.56196072599.issue3437@psf.upfronthosting.co.za>
In-reply-to
Content
RobotFileParser.parse() contains the lines

                elif line[0] == "disallow":
                    if state != 0:
                        entry.rulelines.append(RuleLine(line[1], False))
                        state = 2
                elif line[0] == "allow":
                    if state != 0:
                        entry.rulelines.append(RuleLine(line[1], True))

with no 'state = 2' in the 'allow' part.
This causes different behaviour depending on whether the file ends with
'allow' or 'disallow', or an empty line.

Those lines were taken from revision 65118.  My Python 2.5 sources are
similar.  I have not checked others.
History
Date User Action Args
2008-07-24 15:50:27mblooresetspambayes_score: 0.0311823 -> 0.0311823
recipients: + mbloore
2008-07-24 15:50:26mblooresetspambayes_score: 0.0311823 -> 0.0311823
messageid: <1216914625.92.0.56196072599.issue3437@psf.upfronthosting.co.za>
2008-07-24 15:50:23mbloorelinkissue3437 messages
2008-07-24 15:50:21mbloorecreate