Re: PHP and search engine???
| From: | Tino Didriksen | Date: | Mon, 14 Jan 2002 02:19:28 +0000 |
| Subject: | Re: PHP and search engine??? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-80407@lists.php.net to get a copy of this message | ||
You check the $HTTP_USER_AGENT for what robot is going through your site.
Yahoo, which gets their results from Google, would then have Googlebot
somewhere in the var.
To control webcrawlers more, you can look up robots.txt (
http://www.robotstxt.org/ ).
--|--
Tino Didriksen
http://ProjectJJ.dk/