Re: Re: Can this be done?
| From: | Miller, Terion | Date: | Tue, 05 May 2009 13:35:45 +0000 |
| Subject: | Re: Re: Can this be done? | ||
| References: | 1 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-292268@lists.php.net to get a copy of this message | ||
On 5/5/09 8:31 AM, "php news feed" <maartensc@scullix.co.za> wrote:
post the script, and example of data
""Miller, Terion"" <tmiller@springfi.gannett.com> wrote in message
news:C6259E7B.E91%kmiller13@springfi.gannett.com...
Ok I have a script that grabs data from a page and puts it in a db, I need
to run this script 26 times on 26 different pages on the same site, is there
a way to do this without making 26 different scripts load? Should I post the
script?
Thanks,
T.Miller
__________ Information from ESET Smart Security, version of virus signature
database 4053 (20090505) __________
The message was checked by ESET Smart Security.
http://www.eset.com
__________ Information from ESET Smart Security, version of virus signature database 4053 (20090505)
__________
The message was checked by ESET Smart Security.
http://www.eset.com
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php
Here is the script:
<?php include("inc/dbconn_open.php"); include("inc/dom.php");
error_reporting(E_ALL); $TESTING = TRUE; $target_url = "http://www.greenecountymo.org/sheriff/warrants.php";
$userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)'; $ch = curl_init();
curl_setopt($ch, CURLOPT_USERAGENT, $userAgent); curl_setopt($ch, CURLOPT_URL,$target_url);
curl_setopt($ch, CURLOPT_FAILONERROR, true); curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true);
curl_setopt($ch, CURLOPT_AUTOREFERER, true); curl_setopt($ch, CURLOPT_RETURNTRANSFER,true);
curl_setopt($ch, CURLOPT_TIMEOUT, 300); $html = curl_exec($ch); if (!$html) { echo "<br
/>cURL error number:" .curl_errno($ch); echo "<br />cURL error:" .
curl_error($ch); exit; } // Create DOM from URL or file $html = file_get_html('http://www.greenecountymo.org/sheriff/warrants.php?search=C');
// Find table foreach($html->find('table') as $table) {
foreach($table->find('tr') as $tr) { // Grab children
$cells = $tr->children(); if($cells[0]->plaintext != "Name")
{ for ($i = 0; $i < count($cells); $i++) {
switch ($i){ case 0: // Name $name =
$cells[$i]->plaintext; echo $cells[$i]->plaintext;
break; case 1: // Age $age = $cells[$i]->plaintext;
break; case 2: // Warrant type $warrant =
$cells[$i]->plaintext; break; case 3: // Bond amount
$bond = $cells[$i]->plaintext; break; case 4: //
Warrant number $wnumber = $cells[$i]->plaintext; break;
case 5: // Offence description $crime = $cells[$i]->plaintext;
break; Default: echo "Uh-oh<br
/>"; } }
} // Build your INSERT statement here
$query = "INSERT into warrants (wid, name, age, warrant, bond, wnumber, crime) VALUES (";
$query .= " '$wid', '$name', '$age', '$warrant',
'$bond', '$wnumber', '$crime' )"; //$wid =
mysql_insert_id(); echo $query; // run query mysql_query($query)
or die (mysql_error()); } } ?>