Bug #67177 [Fbk->Asn]: run-tests.php doesn't work well with LEAK
Edit report at https://bugs.php.net/bug.php?id=67177&edit=1
ID: 67177
Updated by: tyrael@php.net
Reported by: nikic@php.net
Summary: run-tests.php doesn't work well with LEAK
-Status: Feedback
+Status: Assigned
Type: Bug
Package: Testing related
PHP Version: 5.6.0beta2
Assigned To: tyrael
Block user comment: N
Private report: N
Previous Comments:
------------------------------------------------------------------------
[2014-05-02 10:29:26] nikic@php.net
@tyrael: A LEAK&FAIL test is only counted towards the number of leaked tests, but not towards
the number of failed tests (otherwise it would be counted twice). That's why exit status will
be 0 even though there were failed tests (that also happened to have memory errors).
------------------------------------------------------------------------
[2014-05-02 07:28:19] tyrael@php.net
FAILED tests should fail the execution when REPORT_EXIT_STATUS=1 is set, could you show an exemple
where that doesn't work?
when you call run-tests.php with -m, it will mark the leaking tests as LEAKED, which isn't
FAILED, so that won't result in a non-zero exit status.
--show-mem sounds reasonable, and --show-all should also show the .mem if there is one.
------------------------------------------------------------------------
[2014-05-02 07:00:39] nikic@php.net
Description:
------------
* REPORT_EXIT_STATUS=1 results in exit=0 even though there are FAILED&LEAKED tests.
* There is no --show-mem or --show-leak option.
------------------------------------------------------------------------
--
Edit this bug report at https://bugs.php.net/bug.php?id=67177&edit=1
Thread (6 messages)