CURL and multiple sites at once

From: Date: Sun, 03 Mar 2002 20:01:42 +0000
Subject: CURL and multiple sites at once
Groups: php.general 
Request: Send a blank email to php-general+get-86999@lists.php.net to get a copy of this message
Hi I'm looking for the fastest way to fetch multiple pages from php. Currently I'm trying the curl-lib and it works fine - I just don't understand how to use curl that it stores multiple requests in multiple files. I'll try to explain my problem more detailed: Somewhere are the pages http://foo.bar.com/page1.html http://foo.bar.com/page2.html http://foo.bar.com/page3.html I want to fetch them with php and write them locally to the files foobarpage1.html foobarpage2.html foobarpage3.html And I try to achieve a maximal speed. I tried following code: $fh1 = fopen("foobarpage1.html", "w"); $fh2 = fopen("foobarpage2.html", "w"); $fh3 = fopen("foobarpage3.html", "w"); $ch = curl_init(); curl_setopt($ch, CURLOPT_URL, "http://foo.bar.com/page1.html"); curl_setopt($ch, CURLOPT_FILE, $fh1); curl_exec($ch); //exec1 curl_setopt($ch, CURLOPT_URL, "http://foo.bar.com/page2.html"); curl_setopt($ch, CURLOPT_FILE, $fh2); curl_exec($ch); //exec2 curl_setopt($ch, CURLOPT_URL, "http://foo.bar.com/page3.html"); curl_setopt($ch, CURLOPT_FILE, $fh3); curl_exec($ch); curl_close($ch); fclose($fh1); fclose($fh2); fclose($fh3); I just tells me that it's not capable of executing one handler multiple times. If I delete the lines with exec1 and exec2 it works but only stores the last page... Who can help? TIA & greets Stefan Rusterholz

« previous php.general (#86999) next »