Re: htdig - Indexing of pages

From: Date: Fri, 07 Feb 2003 07:46:10 +0000
Subject: Re: htdig - Indexing of pages
References: 1  Groups: php.mirrors 
Request: Send a blank email to php-mirrors+get-15565@lists.php.net to get a copy of this message
it took me a few minutes on a highly loaded server (load average of about 20.0) On Fri, 7 Feb 2003, Ioakim Spyros wrote: > How long does htdig take to index the pages? > I started it yesterday when I configured it with the help of Goba but it > is still indexing. > I used the default configuration which means all the languages... > So far it has created a 309MB file and still going.... > I am also noticing that it takes about 5-6 seconds to go from one page > to another in the logfile. > Is that normal or could it be that I'm creating the database on a NFS > volume? > I'm posting a couple of lines of the log file also to see the time: > 195.97.19.130 - - [07/Feb/2003:09:34:13 +0200] "GET > /manual/cs/function.ncurses-insertln.php HTTP/1.0" 200 27440 > "http://gr2.php.net/manual/cs/ref.ncurses.php" > "htdig/3.1.6 > (sioakim@ace-hellas.gr)" > 195.97.19.130 - - [07/Feb/2003:09:34:18 +0200] "GET > /manual/cs/function.ncurses-insstr.php HTTP/1.0" 200 27547 > "http://gr2.php.net/manual/cs/ref.ncurses.php" > "htdig/3.1.6 > (sioakim@ace-hellas.gr)" > 195.97.19.130 - - [07/Feb/2003:09:34:25 +0200] "GET > /manual/cs/function.ncurses-instr.php HTTP/1.0" 200 27493 > "http://gr2.php.net/manual/cs/ref.ncurses.php" > "htdig/3.1.6 > (sioakim@ace-hellas.gr)" > > Spyros > > P.S. CPU usage is at 95% idle > -- Best regards, Shimi ---- "Outlook is a massive flaming horrid blatant security violation, which also happens to be a mail reader." "Sure UNIX is user friendly; it's just picky about who its friends are."

« previous php.mirrors (#15565) next »