Re: htdig search

From: Date: Mon, 16 Dec 2002 15:01:41 +0000
Subject: Re: htdig search
References: 1 2  Groups: php.mirrors 
Request: Send a blank email to php-mirrors+get-14246@lists.php.net to get a copy of this message
> 2. There's no way to exclude print/printwn directories _serverside_, since > robots.txt doesn't allow wildcards like "Disallow: */print/*". Is there any > way to alter the PHP.net structure to have printable manual pages in > /print/manual/en/etc. and /printwn/manual/en/etc. Using this method > robots.txt could be used for denying indexing robots into /print/* and > /printwn/*. Well, we already have quite a few backward compatible URL redirects (for the html directory, manual moves, etc.). I think there are too many links pointing to our manuals (even printed versions) to just moved them to another place. BTW manual/LANG/print is much more logical. BTW I have some ideas of "putting" a robots.txt file into those print directories. This would also start a discussion on whether we need indexes of all PHP mirror sites in Google and other search engines (which some users complained about). > 3. Indexing years and years of Events data, see > http://bugs.php.net/bug.php?id=18508 I have assigned this to myself, and will take care of this, especially as it involves searching, which is my current focus... Goba

« previous php.mirrors (#14246) next »