Re: run-tests re-write
| From: | Olivier Doucet | Date: | Thu, 16 Apr 2009 17:43:55 +0000 |
| Subject: | Re: run-tests re-write | ||
| References: | 1 2 3 4 5 6 7 8 9 | Groups: | php.qa |
| Request: | Send a blank email to php-qa+get-64778@lists.php.net to get a copy of this message | ||
Hello,
here is my feedback (tested against googlecode trunk with PHP 5.2.3) :
- \n missing at the end of error strings (about TEST_PHP_EXECUTABLE or no
test given in command line for example).
- Warning: preg_match(): Unknown modifier 'a' in
/****/src/testcase/rtTestDifference.php on line 182
- Many tests failed and we cannot see why / where (no verbose output ?) <=
it seems executed with PHP 5.3 everything is working just fine.
I also have many ideas about how to improve testing in PHP with
run-tests.php, and this is the perfect time to talk about it :)
- Reports sent to PHP website / mailing list qa-reports should be more
detailed :
We can add in the report all tests results (success, skip, failed) : we can
then parse those reports to see tests that are 100% successful, 100%
failure, and others, compared to version/revision. A web interface can then
be easily made to compare all this data: test results per version, per test,
... Possibilities are infinite as soon as we have the data. We don't have to
process everything first, but adding a functionality is easy and we can
reprocess all reports to have results quickly.
It seems it may have been a perfect GSOC project, unfortunately it's too
late...
Please give your feedback about this (is it a good or a bad idea and why).
Olivier