Re: htdig - Indexing of pages
| From: | shimi | Date: | Fri, 07 Feb 2003 07:46:10 +0000 |
| Subject: | Re: htdig - Indexing of pages | ||
| References: | 1 | Groups: | php.mirrors |
| Request: | Send a blank email to php-mirrors+get-15565@lists.php.net to get a copy of this message | ||
it took me a few minutes on a highly loaded server (load average of about 20.0)
On Fri, 7 Feb 2003, Ioakim Spyros wrote:
> How long does htdig take to index the pages?
> I started it yesterday when I configured it with the help of Goba but it
> is still indexing.
> I used the default configuration which means all the languages...
> So far it has created a 309MB file and still going....
> I am also noticing that it takes about 5-6 seconds to go from one page
> to another in the logfile.
> Is that normal or could it be that I'm creating the database on a NFS
> volume?
> I'm posting a couple of lines of the log file also to see the time:
> 195.97.19.130 - - [07/Feb/2003:09:34:13 +0200] "GET
> /manual/cs/function.ncurses-insertln.php HTTP/1.0" 200 27440
> "http://gr2.php.net/manual/cs/ref.ncurses.php"
> "htdig/3.1.6
> (sioakim@ace-hellas.gr)"
> 195.97.19.130 - - [07/Feb/2003:09:34:18 +0200] "GET
> /manual/cs/function.ncurses-insstr.php HTTP/1.0" 200 27547
> "http://gr2.php.net/manual/cs/ref.ncurses.php"
> "htdig/3.1.6
> (sioakim@ace-hellas.gr)"
> 195.97.19.130 - - [07/Feb/2003:09:34:25 +0200] "GET
> /manual/cs/function.ncurses-instr.php HTTP/1.0" 200 27493
> "http://gr2.php.net/manual/cs/ref.ncurses.php"
> "htdig/3.1.6
> (sioakim@ace-hellas.gr)"
>
> Spyros
>
> P.S. CPU usage is at 95% idle
>
--
Best regards,
Shimi
----
"Outlook is a massive flaming horrid blatant security violation, which
also happens to be a mail reader."
"Sure UNIX is user friendly; it's just picky about who its friends are."