note 53517 added to function.token-get-all

I don't know if it is a bug or not but you when I use the tokenizer on exactly the same file (in PHP 5.0.4), on folowing code: <code> <? define('ABC', 'hahaha'); echo '2'.ABC.' papa'; ?> </code> not always reports '<' + '?' as T_OPEN_TAG but as two separated tokens '<' and '?' (same goes for '<' + '?' + 'php', which gives 3 tokens '<', '?' and 'php'). So if you use the tokenizer functions for other thing than to play, you should also consider the above sequence of tokens as the php code start tags. Closing tags are ok. ---- Manual Page -- http://www.php.net/manual/en/function.token-get-all.php Edit -- http://master.php.net/manage/user-notes.php?action=edit+53517 Delete: added to the manual -- http://master.php.net/manage/user-notes.php?action=delete+53517&report=yes&reason=added+to+the+manual Delete: bad code -- http://master.php.net/manage/user-notes.php?action=delete+53517&report=yes&reason=bad+code Delete: spam -- http://master.php.net/manage/user-notes.php?action=delete+53517&report=yes&reason=spam Delete: useless -- http://master.php.net/manage/user-notes.php?action=delete+53517&report=yes&reason=useless Delete: other reasons -- http://master.php.net/manage/user-notes.php?action=delete+53517&report=yes Reject -- http://master.php.net/manage/user-notes.php?action=reject+53517&report=yes Search -- http://master.php.net/manage/user-notes.php