Re: make test statistics

On Jul 1, 2009, at 11:26 AM, Sebastian Nohn wrote:

Johannes Schlüter wrote:

On Wed, 2009-07-01 at 09:44 -0700, Philip Olson wrote:

Greetings QA geeks, It appears we do not compile [failed] make test data currently, except that qa.reports is a database of failures. Are there plans to compile this data or do people have thoughts about making this idea nicer? It appears currently we'd need to parse emails from the list.

Sebastian Nohn (on CC) once had a small app which indeed parsed the mails, unfortunately the tool isn't available anymore but archive.org has a copy where one can see what it looked like, probably Sebastian has the sources still available: http://web.archive.org/web/20080115182419/http://dev.nohn.org/

I still have it available on some backup DVD, I need to grab for it. It is however true, that I just parsed the emails, a more parseable output (json, serialized, xml, whatever) but help a lot.

Let's have a look, and also determine an alternative friendly form of storage for such tools. I'm unfamiliar with the status (or behaviour) of phpruntests but it sounds like something that could accommodate. And while people (Olivier?) explore other approaches (like CDash and the like) we could also play with Sebastian's code to gain insight and ideas today. I like the PHP friendly features it offers, like an ability to sort by ./configure option. Regards, Philip