catching a robot or spider - asking too

From: Date: Tue, 19 Nov 2002 22:08:02 +0000
Subject: catching a robot or spider - asking too
References: 1  Groups: php.general 
Request: Send a blank email to php-general+get-125146@lists.php.net to get a copy of this message
> does anybody know a way to make a distinction > between robots and users? > should I use the user agent? Or is this not a safe method. > If the visitor is a spider/robot I want to include some script > containing extra URL's for the robot. I am very interested too in this, as I received visits from a site with a rather strange user agent (well, at least, that I did not expect) on a web site of mine. The user agent was something like "SurveyBot/2.2 <a href=\'http://www.whois.sc\'>Whois Source</a>" I really don't know how I should generate my pages in this case, what kind of stylesheet I should include to make the page correct (if I even have to). Anyway, the real question behind is : Is there a good way to handle the user agent info? Vincent Vandemeulebrouck http://www.leguerriersorde.com/

« previous php.general (#125146) next »