Re: htdig search
| From: | Gabor Hojtsy | Date: | Mon, 16 Dec 2002 15:01:41 +0000 |
| Subject: | Re: htdig search | ||
| References: | 1 2 | Groups: | php.mirrors |
| Request: | Send a blank email to php-mirrors+get-14246@lists.php.net to get a copy of this message | ||
> 2. There's no way to exclude print/printwn directories _serverside_, since
> robots.txt doesn't allow wildcards like "Disallow: */print/*". Is there
any
> way to alter the PHP.net structure to have printable manual pages in
> /print/manual/en/etc. and /printwn/manual/en/etc. Using this method
> robots.txt could be used for denying indexing robots into /print/* and
> /printwn/*.
Well, we already have quite a few backward compatible URL redirects (for
the html directory, manual moves, etc.). I think there are too many links
pointing to our manuals (even printed versions) to just moved them to
another place. BTW manual/LANG/print is much more logical.
BTW I have some ideas of "putting" a robots.txt file into those
print directories. This would also start a discussion on whether
we need indexes of all PHP mirror sites in Google and other search
engines (which some users complained about).
> 3. Indexing years and years of Events data, see
> http://bugs.php.net/bug.php?id=18508
I have assigned this to myself, and will take care of this,
especially as it involves searching, which is my current focus...
Goba