WWW robots should be identified

• Mail folder: WWW Talk Jul-Oct 1993
• Next message: Marc Andreessen: "Anchors in current file..."
• Previous message: Jay Glicksman: "Re: Figure overlays in HTML+ "

From: Steve Putz <putz@parc.xerox.com>
To: www-talk@nxoc01.cern.ch
Subject: WWW robots should be identified
Message-id: <93Jul15.110144pdt.2445@spoggles.parc.xerox.com>
Date: 	Thu, 15 Jul 1993 11:01:31 PDT
Status: RO

In the interim while we are trying to to figure out how automatic indexing of the web should work, if anyone is running any kind of robot for walking the web (i.e. http servers), please publish your robot's IP address to www-talk and comp.infosystems.www.  That way I can distinguish these accesses when extracting statistics from my http server log files.

Thanks,

Steve Putz
Xerox PARC

<http://pubweb.parc.xerox.com:80/hypertext/people/StevePutz.html>