Re: web spider?

From: Date: Mon, 15 Apr 2002 20:20:53 +0000
Subject: Re: web spider?
References: 1  Groups: php.general 
Request: Send a blank email to php-general+get-93078@lists.php.net to get a copy of this message
Ryan, You might want to look into this as a basis for some of your code, http://agent-source.com/sitemapper/ Contains a good ammount of "spidering" code that's broken down into small functions. ( not that I understand half of it ; ) Good luck -- s t e v e b i s s o n n e t t e steve@plankdesign.com PLANK. A multi-faceted-media company. http://www.plankdesign.com v. 514.875.0003 f. 514.875.7611 on 4/15/02 3:42 PM, Ryan Govostes at panic@twcny.rr.com wrote: > i was wondering if it would be possible to make a web spider in PHP. > they work by download a website, then following all the links on the > website to other pages, and then following the links on that page... > > is this possible in PHP without a whole lot of work? i just want to keep > a counter of how many links (not e-mail addresses or file downloads) it > finds. if someone has the time, could you write up a quick recursive > script that i could use as a basis of my project? > > thanks > ~toaster© > > > -- > PHP General Mailing List (http://www.php.net/) > To unsubscribe, visit: http://www.php.net/unsub.php > >

« previous php.general (#93078) next »