Re: UdmSearch: RE: [PHP] PHP web spyder?
| From: | Alain TESIO | Date: | Thu, 27 Jul 2000 21:51:07 +0000 |
| Subject: | Re: UdmSearch: RE: [PHP] PHP web spyder? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-8675@lists.php.net to get a copy of this message | ||
udmsearch is a search engine which indexes text files, it doesn't store
them. I don't see the use of storing the files in a db if not for indexing.
Most aren't written in PHP which is rather used for dynamic
pages. Search for keywords like mirroring on
http://www.linuxapps.com or similar, it will probably be
written
in c/c++/perl/python
I think that wget has a recursive option to mirror websites.
If it's for windows, I've tried most of them and the one I prefer is
teleport pro.
Alain
----- Message d'origine -----
De : Maciek Uhlig <muhlig@us.edu.pl>
À : Marc Swanson <marcswanson@mediaone.net>; Php-General@Lists. Php. Net
<php-general@lists.php.net>
Cc : Udmsearch@Search. Udm. Net <udmsearch@search.udm.net>
Envoyé : jeudi 27 juillet 2000 23:18
Objet : UdmSearch: RE: [PHP] PHP web spyder?
> Try udmsearch - http://search.mnogo.ru . Although I'm not
> sure about
images
> storage. However maybe they could add a feature :-)
>
> Maciek
>
> > -----Original Message-----
> > From: Marc Swanson [mailto:marcswanson@mediaone.net]
> > Sent: Thursday, July 27, 2000 11:15 PM
> > To: Php-General@Lists. Php. Net
> > Subject: [PHP] PHP web spyder?
> >
> >
> > Before I spend a lot of my time coding my own web spyder, I'd thought
I'd
> > ask if anyone has already done this as an open source project?
> >
> > What I need is something that will follow all links on a supplied
> > URL up to
> > a specified debth and store them either on the filesystem or in a db
> > including images on the pages.