Re: UdmSearch: RE: [PHP] PHP web spyder?

From: Date: Thu, 27 Jul 2000 21:51:07 +0000
Subject: Re: UdmSearch: RE: [PHP] PHP web spyder?
References: 1  Groups: php.general 
Request: Send a blank email to php-general+get-8675@lists.php.net to get a copy of this message
udmsearch is a search engine which indexes text files, it doesn't store them. I don't see the use of storing the files in a db if not for indexing. Most aren't written in PHP which is rather used for dynamic pages. Search for keywords like mirroring on http://www.linuxapps.com or similar, it will probably be written in c/c++/perl/python I think that wget has a recursive option to mirror websites. If it's for windows, I've tried most of them and the one I prefer is teleport pro. Alain ----- Message d'origine ----- De : Maciek Uhlig <muhlig@us.edu.pl> À : Marc Swanson <marcswanson@mediaone.net>; Php-General@Lists. Php. Net <php-general@lists.php.net> Cc : Udmsearch@Search. Udm. Net <udmsearch@search.udm.net> Envoyé : jeudi 27 juillet 2000 23:18 Objet : UdmSearch: RE: [PHP] PHP web spyder? > Try udmsearch - http://search.mnogo.ru . Although I'm not > sure about images > storage. However maybe they could add a feature :-) > > Maciek > > > -----Original Message----- > > From: Marc Swanson [mailto:marcswanson@mediaone.net] > > Sent: Thursday, July 27, 2000 11:15 PM > > To: Php-General@Lists. Php. Net > > Subject: [PHP] PHP web spyder? > > > > > > Before I spend a lot of my time coding my own web spyder, I'd thought I'd > > ask if anyone has already done this as an open source project? > > > > What I need is something that will follow all links on a supplied > > URL up to > > a specified debth and store them either on the filesystem or in a db > > including images on the pages.

« previous php.general (#8675) next »