[tech] who added these rules?

Ben Rampling ben at ucc.gu.uwa.edu.au
Sat Nov 27 13:28:20 WST 1999


> On Sat, Nov 27, 1999 at 10:34:55AM +0800, Mark Tearle wrote:
> > Hi
> > 
> > Who was the moron who added these rules on mako?
> > 
> > 00050 deny ip from 130.95.128.65 to 130.95.13.11
> > 00050 deny ip from 130.95.13.11 to 130.95.128.65
> > 
> > robots.txt is the write way to do it
> 
> I assume some idiot who is too slack to:
> 1) Discuss it with wheel and
> 2) Actually be aware of the robot exclusion standards.

Me, oddly enough, and we all know how stupid I am. A robots file would've
almost certainly have been useless, even if a user agent specific to that
spider, and no other spider, could've been divined.

Regards,
Ben Rampling





More information about the tech mailing list