RE: htdig - Indexing of pages

Another two notes that I had problems that you might want to mention in the page Goba.... 1. You need lots of free disk space when indexing. As I mention I had installed htdig under /usr/local/htdig where I have only 300MB free. I set up the db to /home/htdig where I have about 20GB free... It indexed everything ok but when it got to do the sorting it failed because it used temp under /usr/local/htdig. So it would be nice to mention that you need at least 3 GB free to create a working search engine (I can't really say how much space the sorting takes but I imagine it recreates the database again). Somebody might have more info on this. 2. In my cgi-bin directory I had an old version of htsearch (compiled with different options apparently). I had to erase this file (in cgi-bin) because eventhough htphp.sh clearly states to execute $HTBINDIR/htsearch the file in cgi-bin was executed. Don't know if this was an apache issue or htdig. Somebody please test and confirm this. Spyros P.S. It would be nice to mention in mirror.php which manual languages are indexed since this should be kept by the mirror admin in HTSEARCH_EXCLUDE -----Original Message----- From: Gabor Hojtsy [mailto:gabor@hojtsy.hu] Sent: Friday, February 07, 2003 5:56 PM To: Alain Bidaud Cc: Ioakim Spyros; mirrors@php.net Subject: Re: htdig - Indexing of pages > It took me 3 to 4 hours to create the search db with all the > languages, and it had created a 1.5GB file. But then it took an very > long time to have an answer on the search page > > I restarted the indexing process with only 5 languages activated, and > it took about 30 minutes to finish resulting in 150MB database file Well, this is why we added documentation on language exclusion. :) Do not wonder about it, the php.net search index is not complete, so this is why it is fast... Goba