cvs: phpweb / robots.txt
| From: | Rasmus Lerdorf | Date: | Thu, 04 Oct 2001 06:10:12 +0000 |
| Subject: | cvs: phpweb / robots.txt | ||
| Groups: | php.mirrors | ||
| Request: | Send a blank email to php-mirrors+get-6856@lists.php.net to get a copy of this message | ||
rasmus Thu Oct 4 02:10:12 2001 EDT
Modified files:
/phpweb robots.txt
Log:
No point in crawling the search
Index: phpweb/robots.txt
diff -u phpweb/robots.txt:1.4 phpweb/robots.txt:1.5
--- phpweb/robots.txt:1.4 Sat Sep 22 04:22:06 2001
+++ phpweb/robots.txt Thu Oct 4 02:10:11 2001
@@ -1,5 +1,6 @@
User-agent: *
Disallow: /source.php
+Disallow: /search.php
Disallow: /manual/add-note.php
Disallow: /manual/admin-notes.php
Disallow: /manual/browse-errata.php