Re: Bug #10299 Updated: CPU and Memory Spike

i dont suppose this is a session garbage collection?? Cameron goten@mylaptop.com wrote: > ID: 10299 > User Update by: goten@mylaptop.com > Status: Critical > Bug Type: Performance problem > Operating system: FreeBSD 4.2 Stable > PHP Version: 4.0.4pl1 > Description: CPU and Memory Spike > > What I found out is that using a lot of include_once, require_once + session will trigger the > CPU and memory spike. Add database access to the script can speed up the frequency of the spike. > And I also found out require_once DO leak memory. pstat -T show that file in use will always > increase. Somehow require_once forgot to close the file after use. lsof can give you a clear > picture when you use require_once() > > I changed my code using cookie and require() statement now. And I delete all sess_files in > /tmp seems to correct the problem. This is the only change I made to eliminate the problem. > > I can't reproduce the error now because the code that have problems have been changed and > I don't have the backup. But the combination of A lot of include_once, require_once, and > session will trigger the spike, I am pretty sure because after I changed all that, the problem > disappear. Old session file in /tmp also contribute to the problem as well. > > BTW, the last time I checked, CVS version 4.06 in late April still have the problem. > > Previous Comments: > --------------------------------------------------------------------------- > > [2001-05-08 19:26:01] zeev@php.net > Is this fairly reproducible? > If it is, any chance you could build Apache with debug information (--enable-debug in > configure), attach to an offending process (gdb /path/to/httpd <PID>), and run a backtrace > ('bt')? > > --------------------------------------------------------------------------- > > [2001-05-07 12:44:51] derick@php.net > marking critical for php 4.0.6 > > --------------------------------------------------------------------------- > > [2001-04-14 09:00:57] goten@mylaptop.com > I found the problem. since the script I use have a lot of include and require statement. just > a script include a bunch of files and keep reloading the page will kill the server in no time. I > attach a sample config file I usually include, just make a test.php and include this file like 10 > times to simulate a lot of include files. And then, just keep reloading test.php. You should see > the script take a lot of CPU time and eventually the httpd eat all the CPU time and the process > hang. From command "top", one of the httpd process keep eating up CPU time. > > The following is the sample config file > > <? > > /*Root directory */ > $config[root_path] = "/usr2/home/business/test/www"; > $config[w3b_path] = "/usr2/home/business/test/www/wwwthreads"; > $config[data_path] = "/usr2/home/business/test/data"; > $config[rdf_path] = "/usr2/home/business/test/www/rdf"; > > /* database */ > > include $config[root_path]."/db.php"; > > /* global */ > $config[sitename] = "www.test.net"; > $config[root_url] = "http://www.test.net/"; > > // Cookie Setting > $config[cookie_path] = "/"; # web root directory > $config[CookieURL] = ".test.net"; > $config[cookieTTL] = 7200; // in seconds > > $config[minpass] = 3; # Minimum user password length in characters > > /* language and locale */ > $config[language] = "english"; # [english] english, [big5] BIG5 code > > $config[locale] = "english"; # Used for translation of date-related stuff > > /* story control */ > $config[commentmax] = 4096; > $config[abstractlen] = 4996; #length of abstract show on first page > > $config[icon_width] = 100; # Topic icons width > $config[timezone] = "HKT"; #Time zone > > $config[limitnews] = 10; # default number of stories per page > $config[older_story_num] = 10; # number of older stories to display > > $config[anon_users] = 0; # 1 to allow anonymous postings > # 0 to disable > > /* theme control */ > > $config[def_theme] = "Main"; # name of default theme (see themes/ directory for > list) > > /* mail settings */ > $config[use_fake_email] = 1; # Displays fake email addresses for users instead of the real ones > > $config[notifyEmail] = "webmaster@test.net"; #address where you want to > receive notice > > //$config[CensorList] = > array('fuck','cunt','fucker','fucking','pussy','cock','c0ck','cum','bitch','shit'); > $config[CensorList] = array("/fuck/s","/fuck/s","/fuck/s", > "/[a-z]*fuck[a-z]*/is", > "/[a-z]*cunt[a-z]*/is", > "/[a-z]*pussy[a-z]*/is", > "/[a-z]*cock[a-z]*/is", > "/[a-z]*c0ck[a-z]*/is", > "/[a-z]*shit[a-z]*/is", > "/[a-z]*bitch[a-z]*/is", > "/[a-z]*diu[a-z]*/is" > ); > # See also specific LOCALE definitions > > $config[CensorMode] = 3; # 0: no filtering > # 1: exact match > # 2: match word beginnings > # 3: match string anywhere in words > $config[CensorReplace] = "[CENSORED]" ; > > /* allowable HTML tags. Used by check_html() > Happily lifted (with mods) from phpslash */ > $config[AllowableHTML] = array("p"=>1, # 2 means accept all qualifiers: <foo > bar> > "b"=>1, # 1 means accept the tag only: <foo> > "i"=>1, > "a"=>2, > "em"=>1, > "br"=>1, > "strong"=>1, > "blockquote"=>1, > "img"=>2, > "tt"=>1, > "hr"=>1, > "li"=>1, > "ol"=>1, > "div"=>1, > "ul"=>1); > > $config[AllowableHTMLtag] = > "<b>,<i>,<a>,<em>,<br>,<strong>,<blockquote>,<tt>,<hr>,<li>,<ol>,<div>,<ul>"; > > /* poll settings */ > > $config[maxOptions] = 12; # maximal number of options allowed > $config[BarScale] = 1; # scale of result bar (in multiples of 100 pixels) > > $config[warnCheaters] = 1; # 1 - a notice issued on vote second try > # 0 - silently ignores the vote > > $config[maxOptions] = 10; > > /* story stuff */ > > $reasons = array('As is', # "Normal" > 'Offtopic', # Bad Responses > 'Flamebait', > 'Troll', > 'Redundant', > 'Insightful', # Good Responses > 'Interesting', > 'Informative', > 'Funny', > 'Overrated', # Last two are "special" > 'Underrated'); > > if ($config[dateString] == "") { > switch ($config[locale]) { > // specifier specs can be found on > http://www.php.net/manual/function.strftime.php /menthos > case "english": $config[dateString] = "%a, %b %d,%Y @ %I:%M > %p"; break; > case "french": $config[dateString] = "%a %d %B %Y &agrave; > %H:%M"; break; > case "german": $config[dateString] = "%a, %d. %b %Y > %H:%M"; break; > case "italian": $config[dateString] = "%a %d %b %Y %H:%M"; > break; > case "swedish": $config[dateString] = "%a %d %b %Y, %H:%M"; > break; > case "dutch": $config[dateString] = "%a, %d. %b %Y > %H:%M"; break; > case "spanish": $config[dateString] = "%a %d %b %Y %H:%M"; > break; > default: $config[dateString] = "%a %b %d @ %H:%M"; break; > } > } > > ?> > > --------------------------------------------------------------------------- > > [2001-04-14 07:59:05] goten@mylaptop.com > This is vmstat show if I keep reloading the script > > procs memory page disks faults cpu > r b w avm fre flt re pi po fr sr da0 da1 in sy cs us sy id > 1 4 0 73860 13432 4 0 0 0 0 0 2 0 382 3804 258 16 1 83 > 0 4 0 73860 13424 4 0 0 0 0 0 0 0 357 3789 245 15 4 81 > 1 4 0 73860 13424 4 0 0 0 0 0 0 0 373 3763 263 14 3 83 > 2 4 0 73860 13416 142 0 0 0 139 0 0 0 402 6155 285 26 4 70 > 0 4 0 73860 13408 4 0 0 0 4 0 11 0 366 3179 220 11 2 87 > 1 4 0 73860 13400 4 0 0 0 0 0 0 0 358 3943 257 15 3 82 > 2 4 0 73860 13400 4 0 0 0 0 0 0 0 340 4201 240 12 42 45 > 2 4 0 73860 13400 4 0 0 0 0 0 0 0 240 1842 90 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 19 0 265 1802 98 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 241 1753 93 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 239 1729 96 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 241 1612 94 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 243 1576 97 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 243 1541 98 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 239 1487 102 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 241 1401 93 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 251 1405 100 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 246 1338 101 0 100 0 > 2 4 0 73116 13400 4 0 0 0 0 0 0 0 238 1297 94 0 100 0 > 2 4 0 73860 13400 4 0 0 0 0 0 0 2 243 1282 100 0 100 0 > 2 4 0 73860 13400 4 0 0 0 0 0 0 0 239 1223 89 0 100 0 > 2 4 0 73860 13400 4 0 0 0 2 0 9 16 300 1180 92 0 100 0 > procs memory page disks faults cpu > r b w avm fre flt re pi po fr sr da0 da1 in sy cs us sy id > 3 4 0 73860 13400 4 0 0 0 0 0 0 0 251 1156 90 0 100 0 > 3 4 0 50296 13400 4 0 0 0 0 0 6 0 258 1116 93 0 100 0 > 2 4 0 50296 13400 4 0 0 0 0 0 0 0 240 1108 83 0 100 0 > 3 4 0 50296 13400 4 0 0 0 0 0 0 0 245 1064 92 0 100 0 > 3 4 0 46988 13400 4 0 0 0 0 0 0 0 242 1031 83 0 100 0 > 3 4 0 46988 13400 4 0 0 0 0 0 0 0 242 989 82 0 100 0 > 2 4 0 46988 13400 4 0 0 0 0 0 0 0 243 1010 85 0 100 0 > 2 4 0 46988 13400 4 0 0 0 0 0 1 0 241 985 81 0 100 0 > 2 4 0 46988 13400 4 0 0 0 0 0 0 0 241 971 89 1 99 0 > 2 4 0 46988 13400 4 0 0 0 0 0 0 0 243 940 74 0 100 0 > 3 4 0 46988 13400 4 0 0 0 2 0 8 0 250 926 80 0 100 0 > 2 4 0 46988 13400 4 0 0 0 0 0 1 0 245 930 88 0 100 0 > 3 4 0 46988 13400 4 0 0 0 0 0 0 0 240 905 80 0 100 0 > 2 4 0 46988 13400 4 0 0 0 0 0 7 0 253 920 100 0 98 2 > 3 4 0 47332 13056 90 0 0 0 0 0 0 0 239 2113 116 3 97 0 > 2 4 0 46588 13048 4 0 0 0 0 0 1 0 243 2334 103 1 99 0 > 1 4 0 46244 13392 4 0 0 0 86 0 8 0 276 4383 140 7 19 74 > 1 4 0 47896 13184 59 0 0 0 0 0 2 0 275 621 56 7 1 92 > 0 4 0 47896 13152 20 0 0 0 0 0 1 0 253 471 46 6 1 93 > 1 4 0 47492 13372 18 0 0 0 64 0 0 0 251 478 43 0 1 99 > 0 4 0 47492 13372 4 0 0 0 0 0 0 0 235 440 40 0 0 100 > 0 4 0 47492 13372 4 0 0 0 0 0 0 0 238 442 40 0 2 98 > > The CPU time drop from 80 all the way to zero and make the Apache hang for like 30 seconds and > the resume back again. It happens VERY often if I only have like 30 users surf the website at the > same time. It pretty much bring the web server down if I have around 50 users surft the site > > --------------------------------------------------------------------------- > > [2001-04-11 18:03:59] goten@mylaptop.com > I am running on FreeBSD 4.2 Stable, Apache 1.3.19 + PHP 4.0.4pl1 + Modssl on a Dual P2 400mhz > with 256mb ram. From time to time, one of the httpd process will eat up all the CPU time and > memory, and after around 5 to 10 seconds, it goes back to normal Even a Very simple script like > > <? > echo "test"; > ?> > > can make it happen. 1 out of 25 reload of the above script can make the spike happen. But the > web server do not crash though. If I run on a script with heavy database access, it happen 1 out of > 10 if I press reload button continously. > > BTW, is that normal for Apache to take up 30% of the CPU time to excute one single > PHP-database-driven page? > > I search the bugs database and I found another user have the exact problem like what I am > having right now. His bug id is #9154. > > This is how I configure PHP > ./configure --with-mysql=/usr/local/mysql --with-apxs=/usr/local/apache/bin/apxs > --with-config-file-path=/usr/local/etc --enable-track-vars --enable-ftp --with-gd=/usr/local > --with-pcre-regex=/usr/local/ > --with-jpeg-dir=/usr/local --with-xpm-dir=/usr/X11R6 > > With or Without modssl enable does not make a difference. Both can cause the spike. > > --------------------------------------------------------------------------- > > The remainder of the comments for this report are too long. To view the rest of the comments, > please view the bug report online. > > Full Bug description available at: > http://bugs.php.net/?id=10299 > > -- > PHP Development Mailing List <http://www.php.net/> > To unsubscribe, e-mail: php-dev-unsubscribe@lists.php.net > For additional commands, e-mail: php-dev-help@lists.php.net > To contact the list administrators, e-mail: php-list-admin@lists.php.net