Re: Re: Can this be done?

From: Date: Tue, 05 May 2009 13:47:14 +0000
Subject: Re: Re: Can this be done?
References: 1 2  Groups: php.general 
Request: Send a blank email to php-general+get-292269@lists.php.net to get a copy of this message
can try the foreach, put all the urls in one array.... something like this might work: <?php include("inc/dbconn_open.php"); include("inc/dom.php"); error_reporting(E_ALL); $TESTING = TRUE; $targets[] = "http://www.greenecountymo.org/sheriff/warrants.php"; $targets[] = "http://www.greenecountymo.org/sheriff/page2.php"; $targets[] = "http://www.greenecountymo.org/sheriff/page3.php"; foreach ($targets as $target_url){ $userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)'; $ch = curl_init(); curl_setopt($ch, CURLOPT_USERAGENT, $userAgent); curl_setopt($ch, CURLOPT_URL,$target_url); curl_setopt($ch, CURLOPT_FAILONERROR, true); curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true); curl_setopt($ch, CURLOPT_AUTOREFERER, true); curl_setopt($ch, CURLOPT_RETURNTRANSFER,true); curl_setopt($ch, CURLOPT_TIMEOUT, 300); $html = curl_exec($ch); if (!$html) { echo "<br />cURL error number:" .curl_errno($ch); echo "<br />cURL error:" . curl_error($ch); exit; } // Create DOM from URL or file $html = file_get_html('http://www.greenecountymo.org/sheriff/warrants.php?search=C'); // Find table foreach($html->find('table') as $table) {
  foreach($table->find('tr') as $tr)    {                     // Grab children
$cells = $tr->children(); if($cells[0]->plaintext != "Name") {
    for ($i = 0; $i < count($cells); $i++) {
     switch ($i){
      case 0: // Name
       $name = $cells[$i]->plaintext;
       echo $cells[$i]->plaintext;
       break;
      case 1: // Age
       $age = $cells[$i]->plaintext;
       break;
      case 2: // Warrant type
       $warrant = $cells[$i]->plaintext;
       break;
      case 3: // Bond amount
       $bond = $cells[$i]->plaintext;
       break;
      case 4: // Warrant number
       $wnumber = $cells[$i]->plaintext;
       break;
      case 5: // Offence description
       $crime = $cells[$i]->plaintext;
       break;
      Default:
       echo "Uh-oh<br />";
   }                                                               }                                   }
// Build your INSERT statement here $query = "INSERT into warrants (wid, name, age, warrant, bond, wnumber, crime) VALUES ("; $query .= " '$wid', '$name', '$age', '$warrant', '$bond', '$wnumber', '$crime' )"; //$wid = mysql_insert_id(); echo $query; // run query mysql_query($query) or die (mysql_error()); } } } ?> ""Miller, Terion"" <tmiller@springfi.gannett.com> wrote in message news:C625AAE1.E9B%kmiller13@springfi.gannett.com... On 5/5/09 8:31 AM, "php news feed" <maartensc@scullix.co.za> wrote: post the script, and example of data ""Miller, Terion"" <tmiller@springfi.gannett.com> wrote in message news:C6259E7B.E91%kmiller13@springfi.gannett.com... Ok I have a script that grabs data from a page and puts it in a db, I need to run this script 26 times on 26 different pages on the same site, is there a way to do this without making 26 different scripts load? Should I post the script? Thanks, T.Miller __________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________ The message was checked by ESET Smart Security. http://www.eset.com __________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________ The message was checked by ESET Smart Security. http://www.eset.com -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php Here is the script: <?php include("inc/dbconn_open.php"); include("inc/dom.php"); error_reporting(E_ALL); $TESTING = TRUE; $target_url = "http://www.greenecountymo.org/sheriff/warrants.php"; $userAgent = 'Googlebot/2.1 (http://www.googlebot.com/bot.html)'; $ch = curl_init(); curl_setopt($ch, CURLOPT_USERAGENT, $userAgent); curl_setopt($ch, CURLOPT_URL,$target_url); curl_setopt($ch, CURLOPT_FAILONERROR, true); curl_setopt($ch, CURLOPT_FOLLOWLOCATION, true); curl_setopt($ch, CURLOPT_AUTOREFERER, true); curl_setopt($ch, CURLOPT_RETURNTRANSFER,true); curl_setopt($ch, CURLOPT_TIMEOUT, 300); $html = curl_exec($ch); if (!$html)
{    echo "<br />cURL error number:" .curl_errno($ch);    echo "<br />cURL error:" . curl_error($ch);    exit; } // Create DOM from URL or file $html = file_get_html('http://www.greenecountymo.org/sheriff/warrants.php?search=C'); // Find table foreach($html->find('table') as $table) { foreach($table->find('tr') as $tr)    {                     // Grab children $cells = $tr->children();                      if($cells[0]->plaintext != "Name")        {                    for ($i = 0; $i < count($cells); $i++) {                                  switch ($i){                 case 0: // Name                     $name = $cells[$i]->plaintext; echo $cells[$i]->plaintext;                     break;                 case 1: // Age                     $age = $cells[$i]->plaintext; break;                 case 2: // Warrant type                     $warrant = $cells[$i]->plaintext;                     break;                 case 3: // Bond amount                     $bond = $cells[$i]->plaintext; break;                 case 4: // Warrant number $wnumber = $cells[$i]->plaintext;                     break; case 5: // Offence description                     $crime = $cells[$i]->plaintext;                     break;                 Default: echo "Uh-oh<br                       }                                   } // Build your INSERT statement here              $query = "INSERT into warrants (wid, name, age, warrant, bond, wnumber, crime) VALUES ("; $query .= " '$wid', '$name', '$age', '$warrant', '$bond', '$wnumber', '$crime' )";        //$wid = mysql_insert_id();                echo $query; // run query     mysql_query($query) or die                 }                } ?>
__________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________ The message was checked by ESET Smart Security. http://www.eset.com __________ Information from ESET Smart Security, version of virus signature database 4053 (20090505) __________ The message was checked by ESET Smart Security. http://www.eset.com

« previous php.general (#292269) next »