[tech] who added these rules?
Ben Rampling
ben at ucc.gu.uwa.edu.au
Sat Nov 27 13:28:20 WST 1999
> On Sat, Nov 27, 1999 at 10:34:55AM +0800, Mark Tearle wrote:
> > Hi
> >
> > Who was the moron who added these rules on mako?
> >
> > 00050 deny ip from 130.95.128.65 to 130.95.13.11
> > 00050 deny ip from 130.95.13.11 to 130.95.128.65
> >
> > robots.txt is the write way to do it
>
> I assume some idiot who is too slack to:
> 1) Discuss it with wheel and
> 2) Actually be aware of the robot exclusion standards.
Me, oddly enough, and we all know how stupid I am. A robots file would've
almost certainly have been useless, even if a user agent specific to that
spider, and no other spider, could've been divined.
Regards,
Ben Rampling
More information about the tech
mailing list