Re: web spider?
| From: | Andrew Brampton | Date: | Mon, 15 Apr 2002 20:17:10 +0000 |
| Subject: | Re: web spider? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-93077@lists.php.net to get a copy of this message | ||
You most certainly can use PHP to do this.
And if i'm not wrong I think there are allready scripts which do this (which
wouldn't be too hard to hack up for yourself)
Check out hotscripts.com
Andrew
----- Original Message -----
From: "Ryan Govostes" <panic@twcny.rr.com>
To: "PHP People" <php-general@lists.php.net>
Sent: Monday, April 15, 2002 8:42 PM
Subject: [PHP] web spider?
i was wondering if it would be possible to make a web spider in PHP.
they work by download a website, then following all the links on the
website to other pages, and then following the links on that page...
is this possible in PHP without a whole lot of work? i just want to keep
a counter of how many links (not e-mail addresses or file downloads) it
finds. if someone has the time, could you write up a quick recursive
script that i could use as a basis of my project?
thanks
~toaster©
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php