com web/qa: Publish PFTT reports: howto_phpt.html howto _phpunit.html

Commit: 9a523c2fe3531b8964986a74f8d7a9becc2f5272 Author: v-mafick@microsoft.com <v-mafick@microsoft.com> Sun, 23 Mar 2014 23:07:10 -0700 Parents: 3e05045619acba5a39b6c63da9f609a290809f20 Branches: master Link: http://git.php.net/?p=web/qa.git;a=commitdiff;h=9a523c2fe3531b8964986a74f8d7a9becc2f5272 Log: Publish PFTT reports Changed paths: A howto_phpt.html A howto_phpunit.html Diff: diff --git a/howto_phpt.html b/howto_phpt.html new file mode 100755 index 0000000..80ab7f9 --- /dev/null +++ b/howto_phpt.html @@ -0,0 +1,81 @@ +<!DOCTYPE html> +<html><head> +<meta http-equiv="content-type" content="text/html; charset=UTF-8"> + <meta charset="utf-8"> + <meta name="viewport" content="width=device-width, initial-scale=1.0"> + + <title>PHP: Quality Assurance</title> + <link type="text/css" media="all" rel="stylesheet" href="qa-reports_files/defaults.css"> + + <link type="text/css" media="all" rel="stylesheet" href="qa-reports_files/qa.css"> + + <link href="qa-reports_files/css.css" rel="stylesheet" type="text/css"> + <link rel="shortcut icon" href="http://php.net/favicon.ico"> + </head> +<body id="QA"> + +<header> + <div id="mainmenu-toggle-overlay"></div> + <input id="mainmenu-toggle" type="checkbox"> + <nav class="fullscreen"> + <div class="mainscreen"> + <a href="http://qa.php.net/" class="home"><img src="qa-reports_files/logo.jpg" alt="php" height="36" width="72"><span class="subdomain">QA</span></a> + <ul> + <li><a href="http://qa.php.net/projects.php">Goals</a></li> + <li><a href="http://qa.php.net/rc.php">What is RC?</a></li> + <li><a href="http://qa.php.net/howtohelp.php">Contributing</a></li> + <li><a href="http://qa.php.net/handling-bugs.php">Handling Reports</a></li> + <li><a href="qa-reports.htm">Reports</a></li> + <li><a href="http://qa.php.net/pulls/">Github PRs</a></li> + </ul> + </div> + </nav> +</header> +<div id="flash-message"></div> +<nav id="megadropdown"></nav> + +<section class="fullscreen"> + + + +<section class="fullscreen"><script src="qa-reports_files/sorttable.js"></script> +<div style="margin:10px"> + +<img src="howto_phpt.png" /> + +<p><strong>PFTT Command</strong> - Run this command in the <b>PFTT Shell</b> to reproduce the same tests. Use the <b>rg</b> command to get the same release if you don't already have it. Download and install PFTT from <a href="https://github.com/OSTC/PFTT2" target="_blank">https://github.com/OSTC/PFTT2</a>.</p> + +<p><strong>Scenario Set</strong> - Scenarios that are tested (CLI, Apache mod_php ; Opcache, Filesystem, etc...)</p> + +<p><strong>FAILED</strong> - PHPT tests that failed</p> +<p><strong>TIMEOUT</strong> - PHPT tests that did not finish after a minute</p> +<p><strong>CRASH</strong> - PHPT tests that CRASHed PHP</p> +<p><strong>SKIP</strong> - PHPT test that was not run. Should minimize this count as much as possible for better code coverage</p> +<p><strong>XSKIP</strong> - PHPT test that could not be run on OS. It is ok to skip these tests (whereas SKIP tests should be run if possible)</p> + +<p>Report compares ERROR, FAILURE, TIMEOUT, CRASH and PASS for two PHP Builds, the <strong>Base Build</strong> with the <strong>Test Build</strong>. A +X indicates the count increased from Base to Test. A -X indicates the count decreased from Base to Test. If the difference is <font color="green">good</font>, it is shown in <font color="green">green</font> (fe increase in PASS, decrease in FAIL). If the difference is <font color="red">bad</font>, it is shown in <font color="red">red</font> (fe increase in FAIL)..</p> + +<p><a href="https://github.com/OSTC/PFTT2/blob/master/src/com/mostc/pftt/model/core/EPhptTestStatus.java" target="_blank">Full info on PHPT Test Statuses</a></p> + +<p><strong>Result-Pack</strong> All the test logs are compressed into result-packs, which can be downloaded using the two links in the report.</p> + + +</div> +</section> +</section><!-- .fullscreen --> +<footer> + <nav class="fullscreen"> + <ul> + <li><a href="http://php.net/copyright">Copyright ?2001-2014 The PHP Group</a></li> + <li><a href="http://php.net/sites">Other PHP.net sites</a></li> + <li><a href="http://php.net/privacy">Privacy policy</a></li> + </ul> + </nav> +</footer> + +<script src="qa-reports_files/jquery.js"></script> +<script src="qa-reports_files/mousetrap.js"></script> +<script src="qa-reports_files/common.js"></script> + + +</body></html> \ No newline at end of file diff --git a/howto_phpunit.html b/howto_phpunit.html new file mode 100755 index 0000000..f2a1562 --- /dev/null +++ b/howto_phpunit.html @@ -0,0 +1,78 @@ +<!DOCTYPE html> +<html><head> +<meta http-equiv="content-type" content="text/html; charset=UTF-8"> + <meta charset="utf-8"> + <meta name="viewport" content="width=device-width, initial-scale=1.0"> + + <title>PHP: Quality Assurance</title> + <link type="text/css" media="all" rel="stylesheet" href="qa-reports_files/defaults.css"> + + <link type="text/css" media="all" rel="stylesheet" href="qa-reports_files/qa.css"> + + <link href="qa-reports_files/css.css" rel="stylesheet" type="text/css"> + <link rel="shortcut icon" href="http://php.net/favicon.ico"> + </head> +<body id="QA"> + +<header> + <div id="mainmenu-toggle-overlay"></div> + <input id="mainmenu-toggle" type="checkbox"> + <nav class="fullscreen"> + <div class="mainscreen"> + <a href="http://qa.php.net/" class="home"><img src="qa-reports_files/logo.jpg" alt="php" height="36" width="72"><span class="subdomain">QA</span></a> + <ul> + <li><a href="http://qa.php.net/projects.php">Goals</a></li> + <li><a href="http://qa.php.net/rc.php">What is RC?</a></li> + <li><a href="http://qa.php.net/howtohelp.php">Contributing</a></li> + <li><a href="http://qa.php.net/handling-bugs.php">Handling Reports</a></li> + <li><a href="qa-reports.htm">Reports</a></li> + <li><a href="http://qa.php.net/pulls/">Github PRs</a></li> + </ul> + </div> + </nav> +</header> +<div id="flash-message"></div> +<nav id="megadropdown"></nav> + +<section class="fullscreen"> + + + +<section class="fullscreen"><script src="qa-reports_files/sorttable.js"></script> +<div style="margin:10px"> + +<p><img src="howto_phpunit.png" /></p> + +<p><strong>Application</strong> - Application tested (Symfony, Joomla-Platform, Drupal, Mediawiki, Wordpress)</p> +<p><strong>Scenario Set</strong> - Scenarios that are tested (CLI, Apache mod_php ; Opcache, Filesystem, etc...)</p> + +<p><strong>ERROR</strong> - PhpUnit tests that finished with Error(s)</p> +<p><strong>FAILURE</strong> - PhpUnit tests that failed</p> +<p><strong>TIMEOUT</strong> - Tests that did not finish after the maximum amount of time passed (usually one minute)</p> +<p><strong>CRASH</strong> - Tests that Crashed PHP</p> + +<p>Report compares ERROR, FAILURE, TIMEOUT, CRASH and PASS for two PHP Builds, the <strong>Base Build</strong> with the <strong>Test Build</strong>. A +X indicates the count increased from Base to Test. A -X indicates the count decreased from Base to Test. If the difference is <font color="green">good</font>, it is shown in <font color="green">green</font> (fe increase in PASS, decrease in ERROR). If the difference is <font color="red">bad</font>, it is shown in <font color="red">red</font> (fe increase in FAILURE).</p> + +<p><a href="https://github.com/OSTC/PFTT2/blob/master/src/com/mostc/pftt/model/app/EPhpUnitTestStatus.java" target="_blank">Full Info on PFTT's PHPUnit Test Statuses</a></p> + +<p><strong>Result-Pack</strong> All the test logs are compressed into result-packs, which can be downloaded using the two links in the report.</p> + +</div> +</section> +</section><!-- .fullscreen --> +<footer> + <nav class="fullscreen"> + <ul> + <li><a href="http://php.net/copyright">Copyright ?2001-2014 The PHP Group</a></li> + <li><a href="http://php.net/sites">Other PHP.net sites</a></li> + <li><a href="http://php.net/privacy">Privacy policy</a></li> + </ul> + </nav> +</footer> + +<script src="qa-reports_files/jquery.js"></script> +<script src="qa-reports_files/mousetrap.js"></script> +<script src="qa-reports_files/common.js"></script> + + +</body></html> \ No newline at end of file