Re: [php-gtk-webmaster] robots.txt
| From: | Andrei Zmievski | Date: | Mon, 17 Jul 2006 17:31:00 +0000 |
| Subject: | Re: [php-gtk-webmaster] robots.txt | ||
| References: | 1 2 | Groups: | php.gtk.webmaster |
| Request: | Send a blank email to php-gtk-webmaster+get-3267@lists.php.net to get a copy of this message | ||
Not sure. That's why I was asking.
-A
On Jul 17, 2006, at 10:08 AM, Christian Weiske wrote:
Should we update our robots.txt file? I see a lot of crawling going on, both from search engine crawlers and other stuff.What do you want to block? -- Regards/MfG, Christian Weiske