Re: Metasearches

Hi A good HTML parser may take monthes to create. Since the page you get might not have good HTML style, which mean, a lot of tags are not closed properly, your parser needs tolerate all that, and still generate useful indexes. A good one should take about 1 year to develop and testing, and might only work with the pages that doesn't have javascripts in the links. Or, you can try to use the XML parser in the PHP to parse the HTML pages. Again, since XML parser will halt if the input page is not properly written, your parsing result might not be complete if the page you have contains unclosed tags, miss placement of tags,...etc. This parser doesn't work with the javascript too. But if you know clearly about the structure of page you want to parse, you can use ereg functions to extract part of the page that contains the data you need, and then use XML parser to process this part of page ( if it has good style), you might get what you wanted very quick. By the way, you should also take a look at the robot standard if you are trying to run a robot on someone's search engine or webpages. The document are here: http://www.redhat.com/support/docs/faqs/RH-apache-FAQ/misc/norobots.html http://www.redhat.com/support/docs/faqs/RH-apache-FAQ/c876.html regards, Kenny Kang > > > ----- Original Message ----- > From: Felipe G. Coury <fcoury@creation.com.br> > To: PHP list <php-general@lists.php.net> > Sent: Tuesday, October 10, 2000 7:20 PM > Subject: [PHP] Metasearches > > > > Hi! > > > > I am trying to build a metasearch engine (ie, a search engine that > searches > > other search engines) to compare book prices. I need sort of a HTML > parser. > > > > Does anyone have any additional toughts/resources/ideas about this? > > > > Regards, > > > > Felipe G. Coury > > Gerente de Desenvolvimento > > Creation Internet Business > > http://www.creation.com.br > > > > -------------------------------------------- > > Visite o GuiaBrasil.Net: > > http://www.guiabrasil.net > > -------------------------------------------- > > > > > > > > > > -- > > PHP General Mailing List (http://www.php.net/) > > To unsubscribe, e-mail: php-general-unsubscribe@lists.php.net > > For additional commands, e-mail: php-general-help@lists.php.net > > To contact the list administrators, e-mail: php-list-admin@lists.php.net > > > > >