com phpruntests: update instructions: QA/README

Commit: f9050e5a5a1364eb7845fdcb8adbbbc40d1b7d59 Author: Zoe Slattery <zoe@php.net> Tue, 7 Jul 2009 17:18:12 +0000 Parents: fb65c1e7e6b156bbe2f098c4f7a10468fc101f88 Branches: master Link: http://git.php.net/?p=phpruntests.git;a=commitdiff;h=f9050e5a5a1364eb7845fdcb8adbbbc40d1b7d59 Log: update instructions Changed paths: M QA/README Diff: diff --git a/QA/README b/QA/README index 713e393..aa11756 100644 --- a/QA/README +++ b/QA/README @@ -1,15 +1,15 @@ Checking the the output from phpruntests against run-tests.php ============================================================== -1) The output from running run-tests.php for each of the top-level directories is -in the directory 'results'. For example rt_ext is the output from running all the tests under ext. +1) Extract the file QATESTS.tgz into a directory called (for example) QA. -2) Run the new run tests with flags -o csv, against each of the top level directories. +2) Run the new run tests with flags -o csv against the QA directory, eg run-tests.php -o csv -s phprt_out QA -3) Cpmpare the number of failures by using: +3) Run the old run-tests.php against the QA directory and redirect the output to a file called rt_out + +4) compare teh reulsts using + php compareNewOld.php phprt_out rt_out QA -php fail_compare.php new_run_tests_output old_run_tests_output ext -(or substitute Zend/tests/sapi for ext).