Re: Memory Size Help Please

From: Date: Wed, 19 Nov 2003 17:27:33 +0000
Subject: Re: Memory Size Help Please
References: 1 2  Groups: php.general 
Request: Send a blank email to php-general+get-170325@lists.php.net to get a copy of this message
Hi, Jay's comment was a fair one. It's not always possible to help without full info. You could try writing your data directly to disk instead of keeping them in memory as your code seems to be doing. In that case your regex function might need to go into the character data handler. Nick Wilson wrote:
* and then Jay Blanchard declared....
Nope, not enough info to spot the problem. I could point you in a
Spare me the sarcasm. Here's the code if anyone can help, thanks. <? $xml=file('http://www.weblogs.com/changes.xml'); $xml=implode("\n", $xml); // Pattern match string $urlpattern = '/((http|https|ftp):\/\/|www)[a-z0-9\-\._]+\/?[a-z0-9_\.\-\?\+\/~=&#;,]*[a-z0-9\/]{1}/si'; $p=xml_parser_create(); xml_parse_into_struct($p, $xml, $vals, $index); xml_parser_free($p); print("<h1>Starting</h1>"); print("<ol>"); foreach($vals as $key => $val) { /* if its the correct tag, do stuff... */ if($val['tag']=="WEBLOG" && $val['attributes']['WHEN']<120) {
       /* print the url so I can keep track */
       print("<li>".$val['attributes']['URL']."</li>\n");
       /* Changed this from file() to fopen() to see... */
       $pagehandle=fopen($val['attributes']['URL'],r);
       $page=fread($pagehandle,30000);
       fclose($pagehandle);
       preg_match_all($urlpattern, $page, $matches);
       unset($page);
       foreach($matches[0] as $pageurl) {
           $parsedurl=parse_url($pageurl);
           if($parsedurl['host']=='amazon') {
               $urlfile=fopen('urls.txt',"a");
               fwrite($urlfile,$pageurl."\n");
               fclose($urlfile);
           }
       }
       unset($matches);
       unset($pageurl);
       unset($parsedurl);
} } print("</ol>"); print("<h1>Done!</h1>"); ?>
-- Raditha Dissanayake. ------------------------------------------------------------------------ http://www.radinks.com/sftp/ | http://www.raditha.com/megaupload Lean and mean Secure FTP applet with | Mega Upload - PHP file uploader Graphical User Inteface. Just 150 KB | with progress bar.

« previous php.general (#170325) next »