search!
| From: | Arjun Saha | Date: | Wed, 06 Sep 2000 14:50:18 +0000 |
| Subject: | search! | ||
| Groups: | php.general | ||
| Request: | Send a blank email to php-general+get-15497@lists.php.net to get a copy of this message | ||
Hey all,
I'm trying to make this site search engine in PHP.. I've got most
of it done ..but what still remains is crawling. Basically I need to
crawl only for pages belonging to the site. Is there a neat way to
go about this?
Right now, I've got an index page which contains all the files on
different files. My script reads from this page and makes text files
(can't help that!) containing the html files minus the tags. And then
the script works fine after that. But I need to crawl in those pages
as well.
TIA,
Arjun.