Re: svn: /web/php-bugs/trunk/www/ robots.txt

2011/6/28 Ferenc Kovacs <tyra3l@gmail.com>: > On Wed, Jun 29, 2011 at 1:02 AM, Felipe Pena <felipe@php.net> wrote: >> felipe                                   Tue, 28 Jun 2011 23:02:01 +0000 >> >> Revision: >> http://svn.php.net/viewvc?view=revision&revision=312606 >> >> Log: >> - No bot! >> >> Changed paths: >>    U   web/php-bugs/trunk/www/robots.txt >> >> Modified: web/php-bugs/trunk/www/robots.txt >> =================================================================== >> --- web/php-bugs/trunk/www/robots.txt   2011-06-28 22:48:09 UTC (rev 312605) >> +++ web/php-bugs/trunk/www/robots.txt   2011-06-28 23:02:01 UTC (rev 312606) >> @@ -1,5 +1,2 @@ >> -User-agent: msnbot >> -Disallow: * >> - >>  User-agent: * >> -Disallow: /bug-pwd-finder.php >> +Disallow: * >> >> > > why? > founding bugs through searching some crypting error message on google > helped me a few times in the past. > Too much web spiders fetching data there. Maybe we should make an ignore list then. :) -- Regards, Felipe Pena