[web-bugs] master: Try to shut up some heavy queries from at least the sensible search engines
| From: | Derick Rethans | Date: | Thu, 17 Jul 2025 14:09:29 +0000 |
| Subject: | [web-bugs] master: Try to shut up some heavy queries from at least the sensible search engines | ||
| Groups: | php.webmaster | ||
| Request: | Send a blank email to php-webmaster+get-33017@lists.php.net to get a copy of this message | ||
Author: Derick Rethans (derickr)
Date: 2025-07-17T14:56:01+01:00
Commit: https://github.com/php/web-bugs/commit/d38d456a8e78033b0c2e421c6cc476cbeebe45a4
Raw diff: https://github.com/php/web-bugs/commit/d38d456a8e78033b0c2e421c6cc476cbeebe45a4.diff
Try to shut up some heavy queries from at least the sensible search engines
Changed paths:
M www/robots.txt
Diff:
diff --git a/www/robots.txt b/www/robots.txt
index 1a352727..2501d4bd 100644
--- a/www/robots.txt
+++ b/www/robots.txt
@@ -1,2 +1,8 @@
User-agent: *
Disallow: /bug-pwd-finder.php
+
+User-agent: *
+Disallow: /rss
+
+User-agent: *
+Disallow: /search