Aggregating most failed tests

Hello everyone, I'm closely looking every PHP release, especially the test part. This is critical to my company to be sure that upgrading PHP won't break anything (we do have specific internal tests as well). For several years now, I haven't seen one release that passed all tests :( I don't know if this is due to the source code, or the test itself :p Nevertheless, I have to check manually what tests are failing and were not in the previous release. That's why I created a tool that parsed QA-REPORTS, from me (but also from other users that execute "make test" and sent the results) and aggregate failed tests. I wondered if the tool I made would be interesting for other users, but also to PHP core developers, to know on which task to focus. For the moment, the source code (in PHP of course) is really crappy, but it won't take much time to clean it up. My project would have been better with new phpruntest project, but it seems it isn't in production yet. For the moment, I only have failed tests and not tests that passed with success. As an example, here are most failed tests for PHP 5.2.17 : /ext/date/tests/010.phpt /ext/date/tests/DateTime_modify_variation1.phpt /ext/date/tests/DateTimeZone_listAbbreviations_basic1.phpt /ext/date/tests/timezone_abbreviations_list_basic1.phpt /ext/date/tests/date_modify_variation2.phpt (416 reports tests them as "failed") And for PHP 5.3.5 : /ext/date/tests/DateTime_modify_variation1.phpt /ext/date/tests/bug51819.phpt /ext/date/tests/date_modify_variation2.phpt /ext/date/tests/bug52290.phpt /ext/date/tests/bug51994.phpt (~350 reports) If this project may interest other people I would be glad to talk about it and tell you what other informations I do have, and what could be done. Olivier