Re: robot.txt file
| From: | Marcelo Gulin | Date: | Sat, 07 Jul 2001 14:29:58 +0000 |
| Subject: | Re: robot.txt file | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-56637@lists.php.net to get a copy of this message | ||
Hi Mark!
point your browse to some sites like:
http://www.yahoo.com/robots.txt
http://www.google.com/robots.txt
http://www.linux.org/robots.txt
etc
cheers
Marcelo Gulin
El Sáb 07 Jul 2001 04:36, Mark Lo escribió:
> Hi,
>
> I don't know how to write a robot.txt file. Can anyone send me a
> link or a sample file.
>
> Thank you for your help
>
> Mark Lo