Re: run-tests re-write

From: Date: Thu, 16 Apr 2009 17:43:55 +0000
Subject: Re: run-tests re-write
References: 1 2 3 4 5 6 7 8 9  Groups: php.qa 
Request: Send a blank email to php-qa+get-64778@lists.php.net to get a copy of this message
Hello, here is my feedback (tested against googlecode trunk with PHP 5.2.3) : - \n missing at the end of error strings (about TEST_PHP_EXECUTABLE or no test given in command line for example). - Warning: preg_match(): Unknown modifier 'a' in /****/src/testcase/rtTestDifference.php on line 182 - Many tests failed and we cannot see why / where (no verbose output ?) <= it seems executed with PHP 5.3 everything is working just fine. I also have many ideas about how to improve testing in PHP with run-tests.php, and this is the perfect time to talk about it :) - Reports sent to PHP website / mailing list qa-reports should be more detailed : We can add in the report all tests results (success, skip, failed) : we can then parse those reports to see tests that are 100% successful, 100% failure, and others, compared to version/revision. A web interface can then be easily made to compare all this data: test results per version, per test, ... Possibilities are infinite as soon as we have the data. We don't have to process everything first, but adding a functionality is easy and we can reprocess all reports to have results quickly. It seems it may have been a perfect GSOC project, unfortunately it's too late... Please give your feedback about this (is it a good or a bad idea and why). Olivier

« previous php.qa (#64778) next »