Re: Re: [RFC] Better benchmarks for PHP

I think that can be viewed as part of the project. Compiling a (little) list of interesting applications is a challenging task. For example, we can tweak say phpbb 3 to have it deployed automatically and then use some real world data to build a set of requests that you want to perform and benchmark. I actually run a phpbb forum with a little more than 1 million visitors/month, so I can provide this data. You can also think about e.g. mediawiki. it should be easy to automatize, and we could then ask for stats from the wikipedia guys. Nuno ----- Original Message ----- Since we are talking about benchmarking real world applications, do we have a list of applications we wish to run the benchmarks on? On Sun, Feb 15, 2009 at 5:02 PM, Paul Biggar <paul.biggar@gmail.com> wrote:

On Sun, Feb 15, 2009 at 4:39 PM, Ólafur Waage <olafurw@gmail.com> wrote: I have not delved deep into the tests that are referenced in the rfc but do they include comparison data? Most have very little. Typically, they are built into the benchmark. I've updated the wiki page with everything I know about the data sets. Paul Thanks, Olafur On Sun, Feb 15, 2009 at 4:05 PM, Pierre Joye <pierre.php@gmail.com> wrote:

hi, On Sun, Feb 15, 2009 at 8:18 AM, Sebastian Bergmann <sb@sebastian-bergmann.de> wrote:

Nuno Lopes schrieb:

Comments, criticisms and volunteers especially welcome,

When you do this, think about splitting each benchmark into a

separate

file and have it run by a separate PHP process, see [1].

To split them into separate files/cases is definitively a good thing. I'm not sure we should run them in parallel. As it makes sense for the phpt, it may have counter effects for benchmark tests. Concurrent executions of a given feature/extension could help (for apc and stat cache for example), but maybe not for every part of php, or not by default. Cheers, -- Pierre http://blog.thepimp.net | http://www.libgd.org -- PHP Quality Assurance Mailing List <http://www.php.net/> To unsubscribe, visit: http://www.php.net/unsub.php

-- Paul Biggar paul.biggar@gmail.com