cvs: phpweb / robots.txt
| From: | Jacques Marneweck | Date: | Sat, 15 Mar 2003 00:31:11 +0000 |
| Subject: | cvs: phpweb / robots.txt | ||
| Groups: | php.mirrors | ||
| Request: | Send a blank email to php-mirrors+get-16362@lists.php.net to get a copy of this message | ||
jacques Fri Mar 14 19:31:11 2003 EDT
Modified files:
/phpweb robots.txt
Log:
* Updated to disallow /backend/ as per BUG #22707 seeing that google is
crawling the /backend/ directories.
--jm
Index: phpweb/robots.txt
diff -u phpweb/robots.txt:1.7 phpweb/robots.txt:1.8
--- phpweb/robots.txt:1.7 Sat Jun 1 18:39:18 2002
+++ phpweb/robots.txt Fri Mar 14 19:31:09 2003
@@ -1,4 +1,5 @@
User-agent: *
+Disallow: /backend/
Disallow: /stats/
Disallow: /source.php
Disallow: /search.php