RE: [PHP-QA] cvs: qaweb / buildtest-process.php

From: Date: Tue, 17 Dec 2002 17:57:16 +0000
Subject: RE: [PHP-QA] cvs: qaweb / buildtest-process.php
References: 1  Groups: php.qa 
Request: Send a blank email to php-qa+get-7312@lists.php.net to get a copy of this message
Good point, And to answer the first comment, remember people are more likely to submit a test report if tests actually failed. Also, not that PHP is a bad product, but I don't expect to see a 100% perfect test report any time soon considering there are so many platforms out there and so many components changing every day and even the test suites do not always reflect perfectly the level of stability and reliability of PHP running on a particular system... bugs-wise. And now for the second comment, Statistics would definitely be a nice thing to have and your representation of it would be much easier to read but there are still a few issues... For example it's good to know a component did not work in a particular scenario, but it's no good if you don't know what caused the error, what type of configuration that system was using, what exact error was returned, and the overall severity of this error, that means it would probably be a good idea to also keep getting the reports on this list. On Tue, 2002-12-17 at 08:03, Sebastian Nohn wrote: > > -----Original Message----- > > From: Phil Driscoll [mailto:phil@dialsolutions.co.uk] > > Sent: Tuesday, December 17, 2002 11:41 AM > > To: jim winstead; php-qa@lists.php.net > > Subject: Re: [PHP-QA] cvs: qaweb / buildtest-process.php > > > > > > While you're in there, is it worth mailing a short message for > > 100% successful > > tests (perhaps including a list of skipped tests) just so we get a better > > overall picture of how many tests are actually being done? > > To do this, we first would need to modify the run-tests.php, as won't mail > anything if all test succeed. > > If we do something like this we should think about posting the results to > some script in a computer-readable form, insert them into a database, write > some nice interface like the one I proposed some months ago > (http://php.nohn.net/autotest-stats.php) and finally send some daily summary > of the tests to the list. > > Regards, > Sebastian Nohn > -- > sebastian@nohn.net - http://www.nohn.net/ > PGP Key Available - Did I help you? Consider a gift: > http://www.amazon.de/exec/obidos/wishlist/3HYH6NR8ZI0WI/ -- Xavier Spriet <xavier@wuug.org>

« previous php.qa (#7312) next »