Re: QA Reports aggregator

On 20 May 2011 16:10, Olivier Doucet <webmaster@ajeux.com> wrote: > Hi Richard, >> >> What sort of visualisation exists to view the test results? > > There was some drafts a few years ago: > http://marc.info/?l=php-qa&m=124615232603972&w=2 > As I can see, the building part has already been done. It would be great to > merge results from it. I may be available to code part of this project, all > we have to do is decide what informations we need. Any screenshot of > "buildbot results" you like ? > To my mind, we should merge the results done in controlled environments with > outside tests (run by users all over the world). The interface will then > have a button to filter results from  "controlled sources" or not. > Olivier > For a particular set of tests, showing the failures across multiple versions/OS/chipsets/threadsafety/etc. Being able to say just display branch 5.3 vs 5.4 (Windows/x86/nts) for example. I'd also like to be able to add my results to the comparison. Probably a file or text upload. Depending upon the turnaround, if I run the test locally, then submit them for analysis, getting an ID for those results via email with a link so that I can compare my results with the baselines ... even nicer.! -- Richard Quadling Twitter : EE : Zend : PHPDoc @RQuadling : e-e.com/M_248814.html : bit.ly/9O8vFY : bit.ly/lFnVea