catching a robot or spider - asking too
| From: | Vincent Vandemeulebrouck | Date: | Tue, 19 Nov 2002 22:08:02 +0000 |
| Subject: | catching a robot or spider - asking too | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-125146@lists.php.net to get a copy of this message | ||
> does anybody know a way to make a distinction
> between robots and users?
> should I use the user agent? Or is this not a safe method.
> If the visitor is a spider/robot I want to include some script
> containing extra URL's for the robot.
I am very interested too in this, as I received visits from a site with a
rather strange user agent (well, at least, that I did not expect) on a web
site of mine. The user agent was something like
"SurveyBot/2.2 <a href=\'http://www.whois.sc\'>Whois Source</a>"
I really don't know how I should generate my pages in this case, what kind
of stylesheet I should include to make the page correct (if I even have to).
Anyway, the real question behind is :
Is there a good way to handle the user agent info?
Vincent Vandemeulebrouck
http://www.leguerriersorde.com/