Re: Re: PHP Benchmark
| From: | George Schlossnagle | Date: | Mon, 17 Nov 2003 00:53:55 +0000 |
| Subject: | Re: Re: PHP Benchmark | ||
| References: | 1 2 3 | Groups: | php.internals |
| Request: | Send a blank email to internals+get-5505@lists.php.net to get a copy of this message | ||
On Nov 16, 2003, at 7:44 PM, Christian Schneider wrote:
Mike Robinson wrote:You can always add that. It doesn't at all invalidate the results. Thats why they are broken into individual tests instead of being a single monolithic benchmark (which would in fact tell you almost nothing).The benchmark provides insight into changes in PHP speed between versions, major and minor. IMHO that's useful information, niceIt tackles very little of PHP. One of the main changes of PHP5 (object references vs. copying) is missing for example.
Of course it could be extended to contain more tests. But you'd also have to make sure that the test environment is always the same (that's why it's nonsense to post individual benchmark results here).Welcome to the wonderful world of statistics. I agree posting individual benchmarks is useless (though I can understand the appeal - sorta like posting mips numbers).
Running the benchmark twice will give differing results, even if my quick test showed only around 0.35% difference on a completely idle machine, it's still there.Welcome to the wonderful world of statistics. Thats why you ensure that you create a consistent environment and use a large enough sample space that your number are statistically significant. George