Re: --XFAIL--
| From: | Pierre Joye | Date: | Wed, 28 May 2008 10:27:34 +0000 |
| Subject: | Re: --XFAIL-- | ||
| References: | 1 2 | Groups: | php.qa |
| Request: | Send a blank email to php-qa+get-64351@lists.php.net to get a copy of this message | ||
On Wed, May 28, 2008 at 11:02 AM, Ulf Wendel <uwendel@mysql.com> wrote:
> zoe schrieb:
>>
>> --XFAIL--
>> This test will fail until bug #123456 is fix
>
> We have had similar discussions at MySQL during the mysqlnd development. QA
> folks asked to skip tests and/or mark them as TODO within the test as they
> aimed for zero test failures all the time. Personally I don't like that
> approach. Its sort of cheating, its hiding the true amount of test
> failures.
Point is to ease the life of those testing, fixing or porting php.
There is too much false positive now and makes my work (to talk about
one I know well ;) harder.
Please note that the goal is to have them for a temporary short
period, ideally they should not even reach a release. However, there
is a couple of cases where they have to be kept. For example when a
buggy library is used, it makes no sense to report a failed tests as
the fault is in the library. In this case, we may add the reasons of
the expected failure in the reports.
Cheers,
--
Pierre
http://blog.thepimp.net | http://www.libgd.org