cvs: phpweb / robots.txt
| From: | Gabor Hojtsy | Date: | Sat, 01 Nov 2003 10:33:36 +0000 |
| Subject: | cvs: phpweb / robots.txt | ||
| Groups: | php.mirrors | ||
| Request: | Send a blank email to php-mirrors+get-21732@lists.php.net to get a copy of this message | ||
goba Sat Nov 1 05:33:36 2003 EDT
Modified files:
/phpweb robots.txt
Log:
There is nothing to index for search engines in distributions
Index: phpweb/robots.txt
diff -u phpweb/robots.txt:1.9 phpweb/robots.txt:1.10
--- phpweb/robots.txt:1.9 Sun Aug 24 08:13:41 2003
+++ phpweb/robots.txt Sat Nov 1 05:33:36 2003
@@ -1,5 +1,6 @@
User-agent: *
Disallow: /backend/
+Disallow: /distributions/
Disallow: /stats/
Disallow: /source.php
Disallow: /search.php