run-tests.php - Every available test run.
| From: | Cipriano Groenendal | Date: | Sun, 01 Feb 2004 03:55:06 +0000 |
| Subject: | run-tests.php - Every available test run. | ||
| References: | 1 2 | Groups: | php.pear.qa |
| Request: | Send a blank email to pear-qa+get-455@lists.php.net to get a copy of this message | ||
Okay.
I completely cleaned up my pear intsall, and started from scratch with the
``lynx -source go-pear.org | php'' command.
The run-tests.php script was the one posted by Greg earlier.
Running ``pear run-tests /usr/share/pear/'' made it run the tests, however
almost all of them FAILed.
After setting TEST_PHP_DETAILED, and manually running the commands, I
noticed how it complained about not being able to load ./include.inc.
I then cd't to the folder this file was located in, ran the tests again,
and found the first set of tests to work fine now.
* I then cd't to the driver folder, set up a DRIVER_DSN to point to a local
mysql's test db, and ran the tests, after which most[1] worked.
* Repeating this trick from the tests/XML_Parser/tests also gave me a set
off results, in which aswell were several[2][3] failures.
* Installed log, found new tests, and ran them. Except for the sqlite[4] all
PASSed. The SQLite one failed because it expected to be able to use
``sqlite_fetch_single()'' which wasn't (yet?) available in my version. The
main Log module doesn't use this function, so this test should have passed.
* Ran File_CSV's test with ``php -f parser.php test.csv'' from its folder,
and it gave some warnings[5]
* Ran Math_BaseX's test files. One failed because it depended on a
non-present PHP-module[6], and another gave overflow errors[7]
* Net_Ping's testscript complained it couldn't find "../Ping.php", had to
run it from a tmp dir in pear/Net to get it to work[8]
* Net_Sieve depended on a file with passwords[9] which was absent, so the
test failed.
* Pager wouldn't work because it couldn't find directories with files needed
to test.[10] These files were nowhere to be found.
* Text_Password has phpt files, but are actually normal PHP files. run-tests
gives an error here.[11] Running these with php gives an include error[12]
Had to move to a tmp dir so ../Password.php would exist. From there all
worked fine.
* XML_RSS failed 'cause it looked for ../RSS.php[13]. From a temp dir it
PASS'd the tests.
* XML_image2svg failed 'cause it includes the wrong files[14]. After fixing
that, it failed looking for HTML/IT.php[15].
Tried the DBA tests but they weren't much help since they just sprouted a
bunch of numbers at me.
Cache_Lite seemed to work fine.
Crypt_CHAP all matched up nicely and worked.
Net-Dime looked fine.
Auth, File_Passwd, Date, Validate, MDB, MDQ_Querytool, DB_NestedSet,
HTML_CSS, HTML_Progress, HTML_Template_IT, HTML_Template_Sigma,
PEAR_PackageFileManager and Text_Statistics all required an older PHPUnit
then what's currently supplied with a new install, so couldn't test those
currently. Though I could probably install the old seperately. Anyone have
any tips for that? It's too late for me to think about things like that
right now;)
And that concludes a huge check of nearly every single package in PEAR that
had something in the pear/tests directory. Since it's now about 3 hours
after me wondering how the run-tests works exactly, and it's 5am, I'm off to
get some(Well-deserved? ;-) ) rest now. Oh, and yes, before I forget, I'd
like to volunteer for PEAR-QA aswell, obviously ;-)
Cipriano Groenendal
ATT: Logged failures.
[1]
PASS DB_driver::numRows [09numrows.phpt]
FAIL DB_driver::error mapping [10errormap.phpt]
PASS DB_driver::row limit [13limit.phpt]
---
10errormap.diff
10errormap.diff
008- DB Error: constraint violation
008+ mysql doesn't consider this an error
010- DB Error: division by zero
010+ mysql doesn't consider this an error
012- DB Error: invalid number
012+ mysql doesn't consider this an error
This was a test run on
MySQL 4.0.17-log, which is the current
production/stable release
[2]
PASS XML Parser: parse simple string [001.phpt]
FAIL XML Parser: parse from file [002.phpt]
---
002.diff
002- setInputFile resource(4) of type (stream)
002+ setInputFile resource(7) of type (stream)
This test was run on PHP-4.3.4, in which it seems the resource ID of a
stream was changed.
[3]
FAIL XML Parser: parse from file resource [003.phpt]
PASS XML Parser: error class [004.phpt]
--
003.diff
002- fopen resource(4) of type (stream)
002+ fopen resource(7) of type (stream)
This test was run on PHP-4.3.4, in which it seems the resource ID of a
stream was changed.
[4]
PASS Log: Singleton [singleton.phpt]
FAIL Log: Sqlite Handler [sqlite.phpt]
---
sqlite.diff
001- ok
001+ Fatal error: Call to undefined function: sqlite_fetch_single() in
/usr/share/pear/tests/Log/tests/sqlite.php on line 16
According to sqlite_libversion this was tested with version 2.8.3, and
php-4.3.4.
[5]
warning: Read more fields than the expected 4
1Array
(
[0] => isvalid21
[1] => isvalid22
[2] => isvalid23
[3] => isvalid24
)
warning: Read wrong fields number count: '3' expected 4
1Array
(
[0] => isvalid31
[1] => isvalid32
[2] => isvalid33
[3] => isvalid34
)
warning: Read more fields than the expected 4
1Array
(
[0] => isvalid41
[1] => isvalid42
[2] => isvalid43
[3] => isvalid44
)
[6]
# php -f gmp.integer-test.php
Using character set: 'ABCDEF'
Fatal error: Call to undefined function: gmp_strval() in
/usr/share/pear/Math/Basex.php on line 309
[7]
# php -f noext.integer-test.php
<...>
int4 (Max 42944967297) tobase(43987654321) OVERFLOW!
- FAILED - result was FMKGDIOX, expecting FMKGDIOB
int8 (Max 18446744073709551616) toBase(18446744073709551610)
- FAILED - result was NBTNBSDNXFX, expecting NBTNBSZVFVD
int8 (Max 18446744073709551616) tobase(18446744073709551618) OVERFLOW!
- FAILED - result was HLHXCZUFUYAEAX, expecting HLHXCZQBGYKMWB
[8]
# php -f test_result_parsers.php
Warning: main(../Ping.php): failed to open stream: No such file or directory
in /usr/share/pear/tests/Net_Ping/tests/test_result_parsers.php on line 3
Fatal error: main(): Failed opening required '../Ping.php'
(include_path='.:/usr/share/pear:/var/www/smarty') in
/usr/share/pear/tests/Net_Ping/tests/test_result_parsers.php on line 3
[9]
# php -f test_sieve.php
Warning: main(./passwords.php): failed to open stream: No such file or
directory in /usr/share/pear/tests/Net_Sieve/test_sieve.php on line 29
Fatal error: main(): Failed opening required './passwords.php'
(include_path='.:/usr/share/pear:/var/www/smarty') in
/usr/share/pear/tests/Net_Sieve/test_sieve.php on line 29
[10]
# php -f all_tests.php
Warning: main(../simpletest/unit_tester.php): failed to open stream: No such
file or directory in /usr/share/pear/tests/Pager/tests/simple_include.php on
line 7
Fatal error: main(): Failed opening required '../simpletest/unit_tester.php'
(include_path='.:/usr/share/pear:/var/www/smarty') in
/usr/share/pear/tests/Pager/tests/simple_include.php on line 7
[11]
Running selected tests.
Notice: Undefined index: in /usr/share/pear/run-tests.php on line 578
Notice: Undefined index: FILE in /usr/share/pear/run-tests.php on line 676
Notice: Undefined index: EXPECT in /usr/share/pear/run-tests.php on line
768
[12]
#php -f 01-text-password.phpt
Warning: main(../Password.php): failed to open stream: No such file or
directory in /usr/share/pear/tests/Text_Password/tests/01-text-password.phpt
on line 4
Fatal error: main(): Failed opening required '../Password.php'
(include_path='.:/usr/share/pear:/var/www/smarty') in
/usr/share/pear/tests/Text_Password/tests/01-text-password.phpt on line 4
[13]
pear run-tests .
Warning: main(../RSS.php): failed to open stream: No such file or directory
in /usr/share/pear/tests/XML_RSS/tests/01-parse.php on line 2
Fatal error: main(): Failed opening required '../RSS.php'
(include_path='.:/usr/share/pear:/var/www/smarty') in
/usr/share/pear/tests/XML_RSS/tests/01-parse.php on line 2
[14]
Warning: main(XML_image2svg/image2svg.php): failed to open stream: No such
file or directory in <...>/tests/Test_image2svg.php on line 4
Warning: main(): Failed opening 'XML_image2svg/image2svg.php' for inclusion
(include_path='.:/usr/share/pear:/var/www/smarty') in
<...>/tests/Test_image2svg.php on line 4
Fatal error: Cannot instantiate non-existent class: xml_image2svg in
<...>/tests/Test_image2svg.php on line 24
[15]
Warning: main(HTML/IT.php): failed to open stream: No such file or directory
in /usr/share/pear/XML/image2svg.php on line 58
Fatal error: main(): Failed opening required 'HTML/IT.php'
(include_path='.:/usr/share/pear:/var/www/smarty') in
/usr/share/pear/XML/image2svg.php on line 58