cvs: phpruntests /QA README

zoe Tue Jul 7 17:18:13 2009 UTC Modified files: /phpruntests/QA README Log: update instructions http://cvs.php.net/viewvc.cgi/phpruntests/QA/README?r1=1.3&r2=1.4&diff_format=u Index: phpruntests/QA/README diff -u phpruntests/QA/README:1.3 phpruntests/QA/README:1.4 --- phpruntests/QA/README:1.3 Mon Jul 6 21:03:47 2009 +++ phpruntests/QA/README Tue Jul 7 17:18:12 2009 @@ -1,15 +1,15 @@ Checking the the output from phpruntests against run-tests.php ============================================================== -1) The output from running run-tests.php for each of the top-level directories is -in the directory 'results'. For example rt_ext is the output from running all the tests under ext. +1) Extract the file QATESTS.tgz into a directory called (for example) QA. -2) Run the new run tests with flags -o csv, against each of the top level directories. +2) Run the new run tests with flags -o csv against the QA directory, eg run-tests.php -o csv -s phprt_out QA -3) Cpmpare the number of failures by using: +3) Run the old run-tests.php against the QA directory and redirect the output to a file called rt_out + +4) compare teh reulsts using + php compareNewOld.php phprt_out rt_out QA -php fail_compare.php new_run_tests_output old_run_tests_output ext -(or substitute Zend/tests/sapi for ext).