Re: Re: [RFC] Better benchmarks for PHP

Hi Olafur, On Thu, Feb 19, 2009 at 1:30 AM, Ólafur Waage <olafurw@gmail.com> wrote: > I have done a line by line convertion of richards.js from the V8 google test > but i am having some issues with inheritance in it. > > http://cznp.com/php/benchmark/ That's fantastic. I'll have a look in the morning, if no-one beats me to it > If someone can take a look at it, since i am still figuring out what exactly > the code is doing, but meanwhile i did a convertion of one SunSpider test, > the nsieve.js one. Its in the same folder and it can be added if you guys > want. > I am going to look at more SunSpider tests while trying to fix the richards > test. Some of these already exist, especially if they are part of the Computer Language Shootout. I have the set of them here: http://code.google.com/p/phc/source/browse/#svn/trunk/test/subjects/benchmarks/shootout. Paul > > Thanks, > Ólafur Waage > olafurw@gmail.com > > On Mon, Feb 16, 2009 at 10:07 PM, Nuno Lopes <nlopess@php.net> wrote: > >> I think that can be viewed as part of the project. Compiling a (little) >> list of interesting applications is a challenging task. >> For example, we can tweak say phpbb 3 to have it deployed automatically and >> then use some real world data to build a set of requests that you want to >> perform and benchmark. I actually run a phpbb forum with a little more than >> 1 million visitors/month, so I can provide this data. >> >> You can also think about e.g. mediawiki. it should be easy to automatize, >> and we could then ask for stats from the wikipedia guys. >> >> Nuno >> >> >> ----- Original Message ----- >> Since we are talking about benchmarking real world applications, do we have >> a list of applications we wish to run the benchmarks on? >> >> On Sun, Feb 15, 2009 at 5:02 PM, Paul Biggar <paul.biggar@gmail.com> >> wrote: >> >> On Sun, Feb 15, 2009 at 4:39 PM, Ólafur Waage <olafurw@gmail.com> wrote: >>> > I have not delved deep into the tests that are referenced in the rfc but >>> do >>> > they include comparison data? >>> >>> Most have very little. Typically, they are built into the benchmark. >>> I've updated the wiki page with everything I know about the data sets. >>> >>> >>> Paul >>> >>> > >>> > Thanks, >>> > Olafur >>> > >>> > On Sun, Feb 15, 2009 at 4:05 PM, Pierre Joye <pierre.php@gmail.com> >>> wrote: >>> > >>> >> hi, >>> >> >>> >> On Sun, Feb 15, 2009 at 8:18 AM, Sebastian Bergmann >>> >> <sb@sebastian-bergmann.de> wrote: >>> >> > Nuno Lopes schrieb: >>> >> >> Comments, criticisms and volunteers especially welcome, >>> >> > >>> >> > When you do this, think about splitting each benchmark into a >>> separate >>> >> > file and have it run by a separate PHP process, see [1]. >>> >> >>> >> To split them into separate files/cases is definitively a good thing.. >>> >> >>> >> I'm not sure we should run them in parallel. As it makes sense for the >>> >> phpt, it may have counter effects for benchmark tests. Concurrent >>> >> executions of a given feature/extension could help (for apc and stat >>> >> cache for example), but maybe not for every part of php, or not by >>> >> default. >>> >> >>> >> Cheers, >>> >> -- >>> >> Pierre >>> >> >>> >> http://blog.thepimp.net | >>> >> http://www.libgd.org >>> >> >>> >> -- >>> >> PHP Quality Assurance Mailing List >>> >> <http://www.php.net/> >>> >> To unsubscribe, visit: >>> >> http://www.php.net/unsub.php >>> >> >>> >> >>> > >>> >>> >>> >>> -- >>> Paul Biggar >>> paul.biggar@gmail.com >>> >> >> > -- Paul Biggar paul.biggar@gmail.com