RE: [PHP-QA] cvs: qaweb / buildtest-process.php
| From: | Xavier Spriet | Date: | Tue, 17 Dec 2002 17:57:16 +0000 |
| Subject: | RE: [PHP-QA] cvs: qaweb / buildtest-process.php | ||
| References: | 1 | Groups: | php.qa |
| Request: | Send a blank email to php-qa+get-7312@lists.php.net to get a copy of this message | ||
Good point,
And to answer the first comment, remember people are more likely to
submit a test report if tests actually failed.
Also, not that PHP is a bad product, but I don't expect to see a 100%
perfect test report any time soon considering there are so many
platforms out there and so many components changing every day and even
the test suites do not always reflect perfectly the level of stability
and reliability of PHP running on a particular system... bugs-wise.
And now for the second comment,
Statistics would definitely be a nice thing to have and your
representation of it would be much easier to read but there are still a
few issues... For example it's good to know a component did not work in
a particular scenario, but it's no good if you don't know what caused
the error, what type of configuration that system was using, what exact
error was returned, and the overall severity of this error, that means
it would probably be a good idea to also keep getting the reports on
this list.
On Tue, 2002-12-17 at 08:03, Sebastian Nohn wrote:
> > -----Original Message-----
> > From: Phil Driscoll [mailto:phil@dialsolutions.co.uk]
> > Sent: Tuesday, December 17, 2002 11:41 AM
> > To: jim winstead; php-qa@lists.php.net
> > Subject: Re: [PHP-QA] cvs: qaweb / buildtest-process.php
> >
> >
> > While you're in there, is it worth mailing a short message for
> > 100% successful
> > tests (perhaps including a list of skipped tests) just so we get a better
> > overall picture of how many tests are actually being done?
>
> To do this, we first would need to modify the run-tests.php, as won't mail
> anything if all test succeed.
>
> If we do something like this we should think about posting the results to
> some script in a computer-readable form, insert them into a database, write
> some nice interface like the one I proposed some months ago
> (http://php.nohn.net/autotest-stats.php) and finally send some daily summary
> of the tests to the list.
>
> Regards,
> Sebastian Nohn
> --
> sebastian@nohn.net - http://www.nohn.net/
> PGP Key Available - Did I help you? Consider a gift:
> http://www.amazon.de/exec/obidos/wishlist/3HYH6NR8ZI0WI/
--
Xavier Spriet <xavier@wuug.org>