Re: QA Reports aggregator

On Fri, May 20, 2011 at 5:46 PM, Pierre Joye <pierre.php@gmail.com> wrote: > On Fri, May 20, 2011 at 5:10 PM, Olivier Doucet <webmaster@ajeux.com> > wrote: > > Hi Richard, > >> > >> What sort of visualisation exists to view the test results? > > > > There was some drafts a few years ago: > > http://marc.info/?l=php-qa&m=124615232603972&w=2 > > As I can see, the building part has already been done. It would be great > to > > merge results from it. I may be available to code part of this project, > all > > we have to do is decide what informations we need. Any screenshot of > > "buildbot results" you like ? > > To my mind, we should merge the results done in controlled environments > with > > outside tests (run by users all over the world). The interface will then > > have a button to filter results from "controlled sources" or not. > > Exactly, and every results (phpt and other tests) should be displayed > in a kind of dashboard (summary only with delta with previous > revisions, for example). That's the plan at least. > > > if we go to that direction, maybe we could also consider some de facto build or continuous integration tool. for example with Jenkins(Hudson) we could have many slaves with different OS, and we could run matrix-styled jobs for each branch. it could build the branches in parallel on different OSs with different version of libraries or build tools and we could also run tests on the source or if with the rmtools we could also add the phpt tests to the results and properly display it. many apache project uses it for example: https://builds.apache.org/hudson/ I'm a little bit biased toward hudson, but in general if we need such feature maybe we could consider using some already existing solution and not writing our own. what do you think? Tyrael