Re: changing make test for automatic testing

At 11:22 29.01.2003, Kevin Waterson wrote:

This one time, at band camp, Derick Rethans <derick@php.net> wrote: The same tests as usual, but from what I've seen is that most systems are just badly setup :) But of course, there are also a lot of useful tests. I was just trying to point out that it might be a good idea to have a small burden (registering) in order to submit test results. Sounds reasonable.

No distinguish between registered testeres and "normal" testers is what we want. We decided to only set those ini values which we know of beeing relevant to test result. We explicitly decided to let the users test with their own ini files in order to see in which way the tests are affected by uncommon (to us) ini settings - and we had a long discussion on it (iirc).

what do you call a badly setup system. I know mine might be called this as I run automake-1.6.3 and autoconf-2.53, these are the default on RedHat 8.0, I use them because that is what most of the linux people out there will use, not the experienced admins, but the small business people. Would you prefer tests run with a pre-defined set of build tools? perhaps a note on the qa web site saying, 'Your system should have these tools before before testing' or something

We already recomment some tools, otherwise you cannot even build php. Maybe we should allow runing run-test.php only from make but then we would greatly reduce the number of test result inputs. -> We would find less errors... marcus