web spider?

From: Date: Mon, 15 Apr 2002 19:42:31 +0000
Subject: web spider?
Groups: php.general 
Request: Send a blank email to php-general+get-93067@lists.php.net to get a copy of this message
i was wondering if it would be possible to make a web spider in PHP. they work by download a website, then following all the links on the website to other pages, and then following the links on that page... is this possible in PHP without a whole lot of work? i just want to keep a counter of how many links (not e-mail addresses or file downloads) it finds. if someone has the time, could you write up a quick recursive script that i could use as a basis of my project? thanks ~toaster©

« previous php.general (#93067) next »