WWW robots should be identified

Steve Putz <putz@parc.xerox.com>
From: Steve Putz <putz@parc.xerox.com>
To: www-talk@nxoc01.cern.ch
Subject: WWW robots should be identified
Message-id: <93Jul15.110144pdt.2445@spoggles.parc.xerox.com>
Date: 	Thu, 15 Jul 1993 11:01:31 PDT
Status: RO
In the interim while we are trying to to figure out how automatic indexing of the web should work, if anyone is running any kind of robot for walking the web (i.e. http servers), please publish your robot's IP address to www-talk and comp.infosystems.www.  That way I can distinguish these accesses when extracting statistics from my http server log files.


Steve Putz
Xerox PARC