Re: run-tests re-write

From: Date: Wed, 15 Apr 2009 21:09:02 +0000
Subject: Re: run-tests re-write
References: 1 2 3  Groups: php.qa 
Request: Send a blank email to php-qa+get-64765@lists.php.net to get a copy of this message
- how much time does your implementation takes? I see you have many little files and a lot of code, so I wonder if it can compete with the current implementation. (by looking to gsoc.php.net you can see the process takes a loong time, so we cannot accept big slowdowns).
I've run some comparisons with run-tests.php running all the tests under ext/standard/tests and get very similar timings. If you look in the phpruntests/documentation directory there is a file which says what the times were. I looked at the profile with Xdebug yesterday as well - it was OK but I'm sure we can improve it.
the timings seem fairly good.
- what the gsoc project is about? It seems the thing is done, or am I missing something?
It's the one about running tests in parallel. That was one of the key initial requirements for this project - others are also described in the phpruntests/documentation directory.
Ok.
Now - my turn for questions :-). When I started doing this I ran tests in parallel using the existing code and pcntl() to spawn processes. The code was a lash-up (it's in the prototype directory), but *for the groups of tests that I ran*, it demonstrated that there were no interdependencies between tests in different directories. There is one caveat to that - I know there is nothing that I ran that used --REDIRECTTEST--, so I know this is something we still have to deal with. Anyway - my question for you, what dependencies do you know about between tests in different directories? Or in fact any other interdependencies?
At least all database extensions have dependecies. e.g. mysql, mysqli and pdo_mysql cannot be run at the same time. the same for oci8 and pdo_oci; pgsql and pdo_pgsql These are the ones that I remember right now. I would say that there aren't any other dependecies. Anyway, when you start running it in parallel I think you'll uncover other dependecies, including some false ones (i.e. some tests will conflict with others because they do not support concurrency). Nuno

« previous php.qa (#64765) next »