Re: Benchmark Suite

Antony Dovgal wrote: > Hello Sebastian. Hello Antony, > What's the status of this? > Do you have anything working? back in February/March when I first posted about this, I discussed this with Marcus. The conclusion was that we wanted to rewrite run-tests.php based on the Iterator approach I used for the benchmark system's prototype. Benchmarks would then be .phpb in addition to .phpt for tests. I did some work on this but stopped when I got negative feedback (on IRC) towards the idea of rewriting "something that works" (run-tests.php). I see several options to continue: - Add .phpb style support for benchmarks to the current run-tests.php. - Improve run-tests.php to also collect Peak Memory Usage, store the data in SQLite, and have a test (optionally) fail when it takes more memory than it did in the past (one of the ideas that I had for the rewrite). - Do the rewrite. Opinions? -- Sebastian Bergmann http://sebastian-bergmann.de/ GnuPG Key: 0xB85B5D69 / 27A7 2B14 09E4 98CD 6277 0E5B 6867 C514 B85B 5D69