Re: UdmSearch: RE: [PHP] PHP web spyder?

Alain TESIO wrote: > > udmsearch is a search engine which indexes text files, it doesn't store > them. It has also mirroring feature. So, it can store files. Take a look into indexer.conf-dist for explanation of mirroring usage. >I don't see the use of storing the files in a db if not for indexing. > Most aren't written in PHP which is rather used for dynamic > pages. Search for keywords like mirroring on > http://www.linuxapps.com or similar, it will probably be > written > in c/c++/perl/python > I think that wget has a recursive option to mirror websites. > > If it's for windows, I've tried most of them and the one I prefer is > teleport pro. > > Alain > > ----- Message d'origine ----- > De : Maciek Uhlig <muhlig@us.edu.pl> > ю : Marc Swanson <marcswanson@mediaone.net>; Php-General@Lists. Php. Net > <php-general@lists.php.net> > Cc : Udmsearch@Search. Udm. Net <udmsearch@search.udm.net> > EnvoyИ : jeudi 27 juillet 2000 23:18 > Objet : UdmSearch: RE: [PHP] PHP web spyder? > > > Try udmsearch - http://search.mnogo.ru . Although I'm > > not sure about > images > > storage. However maybe they could add a feature :-) > > > > Maciek > > > > > -----Original Message----- > > > From: Marc Swanson [mailto:marcswanson@mediaone.net] > > > Sent: Thursday, July 27, 2000 11:15 PM > > > To: Php-General@Lists. Php. Net > > > Subject: [PHP] PHP web spyder? > > > > > > > > > Before I spend a lot of my time coding my own web spyder, I'd thought > I'd > > > ask if anyone has already done this as an open source project? > > > > > > What I need is something that will follow all links on a supplied > > > URL up to > > > a specified debth and store them either on the filesystem or in a db > > > including images on the pages. -- Alexander Barkov IZHCOM, Izhevsk email: bar@izhcom.ru | http://www.izhcom.ru Phone: +7 (3412) 51-32-11 | Fax: +7 (3412) 78-70-10 ICQ: 7748759