run-tests.php - Every available test run.

From: Date: Sun, 01 Feb 2004 03:55:06 +0000
Subject: run-tests.php - Every available test run.
References: 1 2  Groups: php.pear.qa 
Request: Send a blank email to pear-qa+get-455@lists.php.net to get a copy of this message
Okay. I completely cleaned up my pear intsall, and started from scratch with the ``lynx -source go-pear.org | php'' command. The run-tests.php script was the one posted by Greg earlier. Running ``pear run-tests /usr/share/pear/'' made it run the tests, however almost all of them FAILed. After setting TEST_PHP_DETAILED, and manually running the commands, I noticed how it complained about not being able to load ./include.inc. I then cd't to the folder this file was located in, ran the tests again, and found the first set of tests to work fine now. * I then cd't to the driver folder, set up a DRIVER_DSN to point to a local mysql's test db, and ran the tests, after which most[1] worked. * Repeating this trick from the tests/XML_Parser/tests also gave me a set off results, in which aswell were several[2][3] failures. * Installed log, found new tests, and ran them. Except for the sqlite[4] all PASSed. The SQLite one failed because it expected to be able to use ``sqlite_fetch_single()'' which wasn't (yet?) available in my version. The main Log module doesn't use this function, so this test should have passed. * Ran File_CSV's test with ``php -f parser.php test.csv'' from its folder, and it gave some warnings[5] * Ran Math_BaseX's test files. One failed because it depended on a non-present PHP-module[6], and another gave overflow errors[7] * Net_Ping's testscript complained it couldn't find "../Ping.php", had to run it from a tmp dir in pear/Net to get it to work[8] * Net_Sieve depended on a file with passwords[9] which was absent, so the test failed. * Pager wouldn't work because it couldn't find directories with files needed to test.[10] These files were nowhere to be found. * Text_Password has phpt files, but are actually normal PHP files. run-tests gives an error here.[11] Running these with php gives an include error[12] Had to move to a tmp dir so ../Password.php would exist. From there all worked fine. * XML_RSS failed 'cause it looked for ../RSS.php[13]. From a temp dir it PASS'd the tests. * XML_image2svg failed 'cause it includes the wrong files[14]. After fixing that, it failed looking for HTML/IT.php[15]. Tried the DBA tests but they weren't much help since they just sprouted a bunch of numbers at me. Cache_Lite seemed to work fine. Crypt_CHAP all matched up nicely and worked. Net-Dime looked fine. Auth, File_Passwd, Date, Validate, MDB, MDQ_Querytool, DB_NestedSet, HTML_CSS, HTML_Progress, HTML_Template_IT, HTML_Template_Sigma, PEAR_PackageFileManager and Text_Statistics all required an older PHPUnit then what's currently supplied with a new install, so couldn't test those currently. Though I could probably install the old seperately. Anyone have any tips for that? It's too late for me to think about things like that right now;) And that concludes a huge check of nearly every single package in PEAR that had something in the pear/tests directory. Since it's now about 3 hours after me wondering how the run-tests works exactly, and it's 5am, I'm off to get some(Well-deserved? ;-) ) rest now. Oh, and yes, before I forget, I'd like to volunteer for PEAR-QA aswell, obviously ;-) Cipriano Groenendal ATT: Logged failures. [1] PASS DB_driver::numRows [09numrows.phpt] FAIL DB_driver::error mapping [10errormap.phpt] PASS DB_driver::row limit [13limit.phpt] --- 10errormap.diff 10errormap.diff 008- DB Error: constraint violation 008+ mysql doesn't consider this an error 010- DB Error: division by zero 010+ mysql doesn't consider this an error 012- DB Error: invalid number 012+ mysql doesn't consider this an error This was a test run on MySQL 4.0.17-log, which is the current production/stable release [2] PASS XML Parser: parse simple string [001.phpt] FAIL XML Parser: parse from file [002.phpt] --- 002.diff 002- setInputFile resource(4) of type (stream) 002+ setInputFile resource(7) of type (stream) This test was run on PHP-4.3.4, in which it seems the resource ID of a stream was changed. [3] FAIL XML Parser: parse from file resource [003.phpt] PASS XML Parser: error class [004.phpt] -- 003.diff 002- fopen resource(4) of type (stream) 002+ fopen resource(7) of type (stream) This test was run on PHP-4.3.4, in which it seems the resource ID of a stream was changed. [4] PASS Log: Singleton [singleton.phpt] FAIL Log: Sqlite Handler [sqlite.phpt] --- sqlite.diff 001- ok 001+ Fatal error: Call to undefined function: sqlite_fetch_single() in /usr/share/pear/tests/Log/tests/sqlite.php on line 16 According to sqlite_libversion this was tested with version 2.8.3, and php-4.3.4. [5] warning: Read more fields than the expected 4 1Array ( [0] => isvalid21 [1] => isvalid22 [2] => isvalid23 [3] => isvalid24 ) warning: Read wrong fields number count: '3' expected 4 1Array ( [0] => isvalid31 [1] => isvalid32 [2] => isvalid33 [3] => isvalid34 ) warning: Read more fields than the expected 4 1Array ( [0] => isvalid41 [1] => isvalid42 [2] => isvalid43 [3] => isvalid44 ) [6] # php -f gmp.integer-test.php Using character set: 'ABCDEF' Fatal error: Call to undefined function: gmp_strval() in /usr/share/pear/Math/Basex.php on line 309 [7] # php -f noext.integer-test.php <...> int4 (Max 42944967297) tobase(43987654321) OVERFLOW! - FAILED - result was FMKGDIOX, expecting FMKGDIOB int8 (Max 18446744073709551616) toBase(18446744073709551610) - FAILED - result was NBTNBSDNXFX, expecting NBTNBSZVFVD int8 (Max 18446744073709551616) tobase(18446744073709551618) OVERFLOW! - FAILED - result was HLHXCZUFUYAEAX, expecting HLHXCZQBGYKMWB [8] # php -f test_result_parsers.php Warning: main(../Ping.php): failed to open stream: No such file or directory in /usr/share/pear/tests/Net_Ping/tests/test_result_parsers.php on line 3 Fatal error: main(): Failed opening required '../Ping.php' (include_path='.:/usr/share/pear:/var/www/smarty') in /usr/share/pear/tests/Net_Ping/tests/test_result_parsers.php on line 3 [9] # php -f test_sieve.php Warning: main(./passwords.php): failed to open stream: No such file or directory in /usr/share/pear/tests/Net_Sieve/test_sieve.php on line 29 Fatal error: main(): Failed opening required './passwords.php' (include_path='.:/usr/share/pear:/var/www/smarty') in /usr/share/pear/tests/Net_Sieve/test_sieve.php on line 29 [10] # php -f all_tests.php Warning: main(../simpletest/unit_tester.php): failed to open stream: No such file or directory in /usr/share/pear/tests/Pager/tests/simple_include.php on line 7 Fatal error: main(): Failed opening required '../simpletest/unit_tester.php' (include_path='.:/usr/share/pear:/var/www/smarty') in /usr/share/pear/tests/Pager/tests/simple_include.php on line 7 [11] Running selected tests. Notice: Undefined index: in /usr/share/pear/run-tests.php on line 578 Notice: Undefined index: FILE in /usr/share/pear/run-tests.php on line 676 Notice: Undefined index: EXPECT in /usr/share/pear/run-tests.php on line 768 [12] #php -f 01-text-password.phpt Warning: main(../Password.php): failed to open stream: No such file or directory in /usr/share/pear/tests/Text_Password/tests/01-text-password.phpt on line 4 Fatal error: main(): Failed opening required '../Password.php' (include_path='.:/usr/share/pear:/var/www/smarty') in /usr/share/pear/tests/Text_Password/tests/01-text-password.phpt on line 4 [13] pear run-tests . Warning: main(../RSS.php): failed to open stream: No such file or directory in /usr/share/pear/tests/XML_RSS/tests/01-parse.php on line 2 Fatal error: main(): Failed opening required '../RSS.php' (include_path='.:/usr/share/pear:/var/www/smarty') in /usr/share/pear/tests/XML_RSS/tests/01-parse.php on line 2 [14] Warning: main(XML_image2svg/image2svg.php): failed to open stream: No such file or directory in <...>/tests/Test_image2svg.php on line 4 Warning: main(): Failed opening 'XML_image2svg/image2svg.php' for inclusion (include_path='.:/usr/share/pear:/var/www/smarty') in <...>/tests/Test_image2svg.php on line 4 Fatal error: Cannot instantiate non-existent class: xml_image2svg in <...>/tests/Test_image2svg.php on line 24 [15] Warning: main(HTML/IT.php): failed to open stream: No such file or directory in /usr/share/pear/XML/image2svg.php on line 58 Fatal error: main(): Failed opening required 'HTML/IT.php' (include_path='.:/usr/share/pear:/var/www/smarty') in /usr/share/pear/XML/image2svg.php on line 58

« previous php.pear.qa (#455) next »