Re: cURL loop?
| From: | Daniel Brown | Date: | Fri, 29 May 2009 12:53:23 +0000 |
| Subject: | Re: cURL loop? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-293344@lists.php.net to get a copy of this message | ||
On Thu, May 28, 2009 at 23:31, espontaneo <acohlngto@gmail.com> wrote:
>
> Hello! I am currently working on a script that will scrape data from a
> property advertising web page. The web page has multiple pages. What I'm
> getting is only the first page. What I wanted to do is to use curl to scrape
> all the data from that page. I just learned php so I don't know how I can do
> this.
There are a variety of ways, but rather than writing your own
spider script, you may want to look into the built-in spidering
capabilities of
wget and curl from the command line. Both have
Windows and *NIX builds, so platform isn't an issue; so long as you
have access to the shell, you should be fine.
--
</Daniel P. Brown>
daniel.brown@parasane.net || danbrown@php.net
http://www.parasane.net/ || http://www.pilotpig.net/
50% Off All Shared Hosting Plans at PilotPig: Use Coupon DOW10000