Re: spider
| From: | Daniel Brown | Date: | Fri, 21 Mar 2008 18:40:30 +0000 |
| Subject: | Re: spider | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-271947@lists.php.net to get a copy of this message | ||
On Fri, Mar 21, 2008 at 1:52 PM, tedd <tedd@sperling.com> wrote:
> Hi gang:
>
> How do you spider a remote web site in php?
>
> I get the general idea, which is to take the root page, strip out the
> links and repeat the process on those links. But, what's the code?
I make absolutely no warranty whatsoever, and haven't even looked
back at the code since 4 February when I started screwing with the
idea (except to package it today), so I don't know what's done, what's
not, what works, what doesn't, et cetera.
Take a look. If you can use it, great. If not, great.
http://www.pilotpig.net/code-library/downloads/htmlspider-core-unfinished.tar.gz
--
</Daniel P. Brown>
Forensic Services, Senior Unix Engineer
1+ (570-) 362-0283