Re: web spider?
| From: | Steve Bissonnette | Date: | Mon, 15 Apr 2002 20:20:53 +0000 |
| Subject: | Re: web spider? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-93078@lists.php.net to get a copy of this message | ||
Ryan,
You might want to look into this as a basis for some of your code,
http://agent-source.com/sitemapper/
Contains a good ammount of "spidering" code that's broken down into small
functions. ( not that I understand half of it ; )
Good luck
--
s t e v e b i s s o n n e t t e
steve@plankdesign.com
PLANK. A multi-faceted-media company.
http://www.plankdesign.com
v. 514.875.0003 f. 514.875.7611
on 4/15/02 3:42 PM, Ryan Govostes at panic@twcny.rr.com wrote:
> i was wondering if it would be possible to make a web spider in PHP.
> they work by download a website, then following all the links on the
> website to other pages, and then following the links on that page...
>
> is this possible in PHP without a whole lot of work? i just want to keep
> a counter of how many links (not e-mail addresses or file downloads) it
> finds. if someone has the time, could you write up a quick recursive
> script that i could use as a basis of my project?
>
> thanks
> ~toaster©
>
>
> --
> PHP General Mailing List (http://www.php.net/)
> To unsubscribe, visit: http://www.php.net/unsub.php
>
>