RE: [PHP] PHP web spyder?
| From: | Maciek Uhlig | Date: | Thu, 27 Jul 2000 21:18:36 +0000 |
| Subject: | RE: [PHP] PHP web spyder? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-8668@lists.php.net to get a copy of this message | ||
Try udmsearch - http://search.mnogo.ru . Although I'm not
sure about images
storage. However maybe they could add a feature :-)
Maciek
> -----Original Message-----
> From: Marc Swanson [mailto:marcswanson@mediaone.net]
> Sent: Thursday, July 27, 2000 11:15 PM
> To: Php-General@Lists. Php. Net
> Subject: [PHP] PHP web spyder?
>
>
> Before I spend a lot of my time coding my own web spyder, I'd thought I'd
> ask if anyone has already done this as an open source project?
>
> What I need is something that will follow all links on a supplied
> URL up to
> a specified debth and store them either on the filesystem or in a db
> including images on the pages.