Re: svn: /web/php-bugs/trunk/www/ robots.txt
| From: | Adam Harvey | Date: | Wed, 29 Jun 2011 06:04:33 +0000 |
| Subject: | Re: svn: /web/php-bugs/trunk/www/ robots.txt | ||
| References: | 1 2 3 | Groups: | php.webmaster |
| Request: | Send a blank email to php-webmaster+get-11354@lists.php.net to get a copy of this message | ||
On 29 June 2011 07:20, Felipe Pena <felipensp@gmail.com> wrote:
> Too much web spiders fetching data there. Maybe we should make an
> ignore list then. :)
I'd definitely prefer that to a blanket prohibition, as I've also
found Google's indexing a useful supplement to our own search.
Adam