Re: multi-threading within php?
| From: | Stefan Rusterholz | Date: | Thu, 24 Jan 2002 14:22:46 +0000 |
| Subject: | Re: multi-threading within php? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-81878@lists.php.net to get a copy of this message | ||
Sorry, I don't have an answer on your question, but a question to you:
I'm currently building a class to browse a page and was interested in the
source of your script. Especially on that part extracting the links.
Would you mind providing the source or is it a commercial?
best regards
Stefan Rusterholz
----- Original Message -----
From: "Mattias Andersson" <mattias.andersson@humany.com>
To: <php-general@lists.php.net>
Sent: Thursday, January 24, 2002 2:52 PM
Subject: [PHP] multi-threading within php?
> Hello!
>
> I was making a spider for a simple searchengine and all was well until I
> started testing it on larger sites.
> The problem isn't that it doesn't work, it does, but it is very very slow,
> just handling one connection at the time.
> Basically, it just downloads a page, extract all links from it, then
> downloads those pages, extract their links, until all pages on a site has
> been downloaded and archived.
> Is there any way to do it in several threads so that it handles several
> connections simultaneously?
> If it would dynamically allocate threads that would be even better.
>
> Regards,
> Mattias Andersson
>
> Software Developer, humany AB
> Direct: 08-4540701
> Mobile: 0704-526685
>
>