cvs: phpweb / robots.txt
| From: | jim winstead | Date: | Sat, 01 Jun 2002 22:39:21 +0000 |
| Subject: | cvs: phpweb / robots.txt | ||
| Groups: | php.mirrors | ||
| Request: | Send a blank email to php-mirrors+get-10606@lists.php.net to get a copy of this message | ||
jimw Sat Jun 1 18:39:21 2002 EDT
Modified files:
/phpweb robots.txt
Log:
disallow robots from indexing stats
Index: phpweb/robots.txt
diff -u phpweb/robots.txt:1.6 phpweb/robots.txt:1.7
--- phpweb/robots.txt:1.6 Tue Nov 20 20:20:12 2001
+++ phpweb/robots.txt Sat Jun 1 18:39:18 2002
@@ -1,4 +1,5 @@
User-agent: *
+Disallow: /stats/
Disallow: /source.php
Disallow: /search.php
Disallow: /manual/add-note.php