PHP web spyder?
| From: | Marc Swanson | Date: | Thu, 27 Jul 2000 21:14:51 +0000 |
| Subject: | PHP web spyder? | ||
| Groups: | php.general | ||
| Request: | Send a blank email to php-general+get-8665@lists.php.net to get a copy of this message | ||
Before I spend a lot of my time coding my own web spyder, I'd thought I'd
ask if anyone has already done this as an open source project?
What I need is something that will follow all links on a supplied URL up to
a specified debth and store them either on the filesystem or in a db
including images on the pages.
Thanks
-Marc-
#/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\#
#Marc Swanson | \|||/ #
#MSwanson Consulting | /o o\ #
#Phone: (603)868-1721 |-ooo----O----ooo-#
#Fax: (603)868-1730 | Solutions in: #
#marcswanson@mediaone.net| 'PHP 'Perl #
# | 'SQL 'C++ #
# | 'HTML 'Sh/Csh#
#/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\/\#