IEEE doesn't like web robots
Wed, 8 Jan 2003 10:36:56 -0800
----- Original Message -----
From: "Luis Villa" <firstname.lastname@example.org>
> On Wed, 2003-01-08 at 12:24, Mr. FoRK wrote:
> > Sure, trying to maintain copyright which is understandable. But the
> > performance' part is funny.
> Have you had a dynamic set of generated pages attacked by google? It's
> not funny at all.
Yes - I have a servlet that exposes nntp & ldap information as xml resources
over http - the link showed up in some mail archives & I'm getting a lot of
spiders hitting it. It's not a particularly efficient set of servlets, so I
sometimes take it down to reduce load.