Re: multi-threading within php?

If the links are placed in a db as they are found, then couldn't you run the same script in multiple instances (browser windows, DOS boxes/command lines) against the same db. That way you would be fetching and parsing multiple web pages concurrently. The only 'multi-threading' would be against the db. Your Internet link should be able to cope. =dn ----- Original Message ----- From: "Mattias Andersson" <mattias.andersson@humany.com> To: "'bvr'" <listmail@xs4all.nl>; <php-general@lists.php.net> Sent: 24 January 2002 17:14 Subject: SV: [PHP] multi-threading within php? Then I would have to write a parser when I have already written my own spider. But the problem isn't the spider itself, but rather the lack of multi-threading within PHP (which is needed in quite alot of sitatuations, depending on what you're coding). I'm not sure if it really does lack multi-threading though, it might just be me that doesn't know about it. Is there any way to execute several functions simultaneously? Mvh, Mattias Andersson Mjukvaruutvecklare, humany AB Direkt: 08-4540701 Mobil: 0704-526685 -----Ursprungligt meddelande----- Från: bvr [mailto:listmail@xs4all.nl] Skickat: den 24 januari 2002 15:33 Till: php-general@lists.php.net; Mattias Andersson Ämne: Re: [PHP] multi-threading within php? You may want to use 'wget' spider function, then parse the files with PHP if necessary. http://wget.sunsite.dk/ bvr. On Thu, 24 Jan 2002 14:52:54 +0100, Mattias Andersson wrote: >Hello! > >I was making a spider for a simple searchengine and all was well until I >started testing it on larger sites. >The problem isn't that it doesn't work, it does, but it is very very slow, >just handling one connection at the time. >Basically, it just downloads a page, extract all links from it, then >downloads those pages, extract their links, until all pages on a site has >been downloaded and archived. >Is there any way to do it in several threads so that it handles several >connections simultaneously? >If it would dynamically allocate threads that would be even better. > >Regards, >Mattias Andersson > >Software Developer, humany AB >Direct: 08-4540701 >Mobile: 0704-526685 > > -- PHP General Mailing List (http://www.php.net/) To unsubscribe, e-mail: php-general-unsubscribe@lists.php.net For additional commands, e-mail: php-general-help@lists.php.net To contact the list administrators, e-mail: php-list-admin@lists.php.net