Re: htdig search
| From: | Toni Viemero | Date: | Mon, 16 Dec 2002 05:22:38 +0000 |
| Subject: | Re: htdig search | ||
| References: | 1 | Groups: | php.mirrors |
| Request: | Send a blank email to php-mirrors+get-14220@lists.php.net to get a copy of this message | ||
Gabor Hojtsy wrote:
Hello
> As it seems, Stig is not on creating the central search engine,
> it would be nice to at least do something about the current
> buggy one (htdig). First of all, it would be nice to exclude the
> "print" and "printwn" subdirectories of the manual directories,
> so manuals won't be indexed three times per language, and results
> won't be given in the printed versions... People don't like it...
I've been trying to install mnoGoSearch into fi.php.net, to see what kind of
search engine it is.
The main problems are:
1. Indexing takes a lot of time (even with dedicated machine and indexing
using file://usr/local/phpweb)
2. There's no way to exclude print/printwn directories _serverside_, since
robots.txt doesn't allow wildcards like "Disallow: */print/*". Is there any
way to alter the PHP.net structure to have printable manual pages in
/print/manual/en/etc. and /printwn/manual/en/etc. Using this method
robots.txt could be used for denying indexing robots into /print/* and
/printwn/*.
3. Indexing years and years of Events data, see
http://bugs.php.net/bug.php?id=18508
--
Toni Viemerö | http://selfdestruct.net
"The ones who dont do anything are always the ones who try to pull you
down."