Re: memory allocation
| From: | Marcelo Bianchi | Date: | Tue, 25 Sep 2012 12:33:56 +0000 |
| Subject: | Re: memory allocation | ||
| References: | 1 2 | Groups: | php.general |
| Request: | Send a blank email to php-general+get-319249@lists.php.net to get a copy of this message | ||
Uhm, Okay,
I get it ... I am loading all at once, will try this out.
Here is what I do:
-- begin code
$network = "IA";
$station = "BJI";
$channel = "BHZ";
$year = 2011;
$top = NULL;
$result = mysql_query('select '.$year.' as year, net, station, loc, channel, start_day, start_time, end_day, end_time from data_'.$year.' where net = "'.$network.'" and station = "'.$station.'" and scal_date BETWEEN "'.$year.'-01-01" AND "'.$year.'-12-31" and channel = "'.$channel.'" ') or die(mysql_error());
echo "Loading $year ... ";
while ($r = mysql_fetch_array($result, MYSQL_ASSOC)) {
if ($top === NULL)
$top = new Segments($r, 120);
$top->add($r);
unset ($r);
}
echo "Done\n";
echo "Nothing free: ".memory_get_usage(True)." \n";
mysql_free_result($result);
mysql_close($db_link);
unset($result);
echo "SQL free: ".memory_get_usage(True)." \n";
unset($top);
echo "Segments free: ".memory_get_usage(True)." \n";
-- end code
The Segments object is a class with some functionality but, after processing the results of each row it stores two integers (or floats due to the large numbers, number of seconds from epoch * 10000.0 + microseconds).
I will try to implement this chunk mode of fetching the data from sql to see if the php consumption goes down.
regards,
Marcelo
On 09/25/2012 02:23 PM, shiplu wrote:
I would like to see how you are reading data from database? There are many ways to reduce memory usage. Here is a very common way reduce memory. instead of $res = mysql_query("select * from table1 limit 10000000"); while($row = mysql_fetch_assoc($res)){ /// process row. } Do this, for($x = 0; $x< 10000000; $x+=100;}$res = mysql_query(sprintf("select required_col1, required_col2,... from table1 limit %d, %d",$x, 100));while($row = mysql_fetch_assoc($res)){ /// process row. }} -- Shiplu.Mokadd.im <http://Shiplu.Mokadd.im> ImgSign.com | A dynamic signature machine Innovation distinguishes between follower and leader