Re: running the 5.2 test cases against 5.3

till wrote:

I wanted to run it too, did you guys come up with anything yet? :) Not very much. Here are the results of a quick experiment:

Checked out PHP52 into directory php52XX and PHP53 into directory php53XX. I ran buildconf, configure and make. Then I ran the PHP52 tests using this script: #!/bin/sh export TEST_PHP_EXECUTABLE=/mnt/workspace/php52XX/sapi/cli/php $TEST_PHP_EXECUTABLE /mnt/workspace/php52XX/run-tests.php php52XX I had to remove php52XX/ext/pdo* and php52XX/ext/sqlite* because run-tests.php chokes on them (not sure why it should). Anyway the results of that were as follows:

Number of tests : 5844              4217

Tests skipped : 1627 ( 27.8%) --------

Tests warned    :    1 (  0.0%) (  0.0%)
Tests failed    :   22 (  0.4%) (  0.5%)
Expected fail   :    4 (  0.1%) (  0.1%)
Tests passed    : 4190 ( 71.7%) ( 99.4%)

---------------------------------------------------------------------

Time taken      :  198 seconds

Next I ran the following script to copy the tests from PHP53XX: #!/bin/sh find php52XX -name "*phpt" | xargs -i mv {} {}_bak find php52XX -name "*inc" | xargs -i mv {} {}_bak # find php53XX -name "*phpt" | sed 's/php53XX//' | xargs -i cp php53XX{} php52XX{} find php53XX -name "*inc" | sed 's/php53XX//' | xargs -i cp php53XX{} php52XX{} The I re-ran all tests and got the following summary:

Number of tests : 7048              4992

Tests skipped : 2056 ( 29.2%) --------

Tests warned    :    1 (  0.0%) (  0.0%)
Tests failed    : 1133 ( 16.1%) ( 22.7%)
Expected fail   :    7 (  0.1%) (  0.1%)
Tests passed    : 3851 ( 54.6%) ( 77.1%)

---------------------------------------------------------------------

Time taken      :  220 seconds

So, in summary 1133 tests fail, BUT - this could be: 1) differences as a result of using zend_parse_parameters 2) differences in var_dump output 3) differences in run-tests.php (eg the %unicode|string% is new in php53 tests) 4) missing pre-reqs because I didn't copy across everything that the test needs 5) other things I haven't thought of 6)BC breaks.. I'm not sure if there is a better way of doing this - suggestions welcome. Zoe