Re: [php-gtk-webmaster] robots.txt
| From: | Steph Fox | Date: | Mon, 17 Jul 2006 17:02:12 +0000 |
| Subject: | Re: [php-gtk-webmaster] robots.txt | ||
| References: | 1 | Groups: | php.gtk.webmaster |
| Request: | Send a blank email to php-gtk-webmaster+get-3265@lists.php.net to get a copy of this message | ||
What I know of that stuff could comfortably fit on a pinhead. Anyone?
Should we update our robots.txt file? I see a lot of crawling going on, both from search engine crawlers and other stuff. -Andrei -- PHP-GTK Webmaster Mailing List (http://gtk.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php