Re: PEAR PHP web scraper
| From: | Justin Patrin | Date: | Sat, 01 Jan 2005 20:58:01 +0000 |
| Subject: | Re: PEAR PHP web scraper | ||
| References: | 1 | Groups: | php.pear.general |
| Request: | Send a blank email to pear-general+get-16554@lists.php.net to get a copy of this message | ||
On Sat, 01 Jan 2005 15:42:14 -0500, leegold <leegold2@verizon.net> wrote:
> Is there such a thing as a PHP scraper? The kind of thing you set up to
> automatically go to websites - parse and collect data and deposit the
> data into specific fields in a db. Does PEAR have anything like this? If
> not PEAR any other possibilities?
>
There's HTTP_Client which lets you "browse" a site, keeping session
info intact. There is no system which parses the HTML, runs JS, etc.
For heavy web testing I've used JWebUnit in the past and it's quite
useful.
> Thanks
>
--
Justin Patrin