RE: [PHP-DEV] Re: Stop Breaking Our Apps For the Sake of OO

> Pierre wrote: > > I forgot to mention how vicious such changes can be. Most > of times the > > related tests are "updated" in the same commit (or right after) to > > follow the new behavior. Making nearly impossible to know about the > > breakages without duplicating core tests in our apps. Also commit > > messages or changelog entries are rarely explicit enough to mention > > them. > > Maybe we could set up a testing system that runs the tests > from PHP_4_4, PHP_5_0, PHP_5_1, and HEAD and shows the > differences? That way we would notice that a test that > passed with a previous version fails with a newer one. Would have to diff the various tests too. Perhaps the tests cases should never be removed, but the expected results altered so a diff between differing test suite versions can show what behaviour has changed. Jared