Bug #76991 [NEW]: Incorrect tokenization of multiple invalid flexible heredoc strings

From: nikic Operating system: PHP version: 7.3.0RC2 Package: Scripting Engine problem Bug Type: Bug Bug description:Incorrect tokenization of multiple invalid flexible heredoc strings Description: ------------ The end label for the second heredoc string is cut off here, with the remainder becoming a T_STRING. Test script: --------------- <?php $code = <<<'CODE' <?php <<<TEST $a TEST; <<<END $a END; CODE; var_dump(token_get_all($code)); Expected result: ---------------- [11]=> array(3) { [0]=> int(384) [1]=> string(3) " END" [2]=> int(9) } Actual result: -------------- [11]=> array(3) { [0]=> int(384) [1]=> string(3) " EN" [2]=> int(9) } [12]=> array(3) { [0]=> int(319) [1]=> string(1) "D" [2]=> int(9) } -- Edit bug report at https://bugs.php.net/bug.php?id=76991&edit=1 -- Try a snapshot (PHP 5.4): https://bugs.php.net/fix.php?id=76991&r=trysnapshot54 Try a snapshot (PHP 5.5): https://bugs.php.net/fix.php?id=76991&r=trysnapshot55 Try a snapshot (trunk): https://bugs.php.net/fix.php?id=76991&r=trysnapshottrunk Fixed in SVN: https://bugs.php.net/fix.php?id=76991&r=fixed Fixed in release: https://bugs.php.net/fix.php?id=76991&r=alreadyfixed Need backtrace: https://bugs.php.net/fix.php?id=76991&r=needtrace Need Reproduce Script: https://bugs.php.net/fix.php?id=76991&r=needscript Try newer version: https://bugs.php.net/fix.php?id=76991&r=oldversion Not developer issue: https://bugs.php.net/fix.php?id=76991&r=support Expected behavior: https://bugs.php.net/fix.php?id=76991&r=notwrong Not enough info: https://bugs.php.net/fix.php?id=76991&r=notenoughinfo Submitted twice: https://bugs.php.net/fix.php?id=76991&r=submittedtwice register_globals: https://bugs.php.net/fix.php?id=76991&r=globals PHP 4 support discontinued: https://bugs.php.net/fix.php?id=76991&r=php4 Daylight Savings: https://bugs.php.net/fix.php?id=76991&r=dst IIS Stability: https://bugs.php.net/fix.php?id=76991&r=isapi Install GNU Sed: https://bugs.php.net/fix.php?id=76991&r=gnused Floating point limitations: https://bugs.php.net/fix.php?id=76991&r=float No Zend Extensions: https://bugs.php.net/fix.php?id=76991&r=nozend MySQL Configuration Error: https://bugs.php.net/fix.php?id=76991&r=mysqlcfg