Re: [php-gtk-webmaster] robots.txt
| From: | Christian Weiske | Date: | Mon, 17 Jul 2006 17:08:33 +0000 |
| Subject: | Re: [php-gtk-webmaster] robots.txt | ||
| References: | 1 | Groups: | php.gtk.webmaster |
| Request: | Send a blank email to php-gtk-webmaster+get-3266@lists.php.net to get a copy of this message | ||
> Should we update our robots.txt file? I see a lot of crawling going on,
> both from search engine crawlers and other stuff.
What do you want to block?
--
Regards/MfG,
Christian Weiske
Attachment: [application/pgp-signature] OpenPGP digital signature signature.asc
Attachment: [application/pgp-signature] OpenPGP digital signature signature.asc