note 35435 added to function.token-get-all

It seems that the tokenizer has some chaotic element to it, or perhaps something in level hidden from users, but the function seems to return PHP delimeters as two strings of the two parts respectivly, instead of one delimiter token. I failed to find why, but if your scripts act chaoticly, then you might need to lookout for the PHP Delimeters. The best way to do it that I can see so far is by looking for '<' and '>' strings in the tokens array ( i.e an element in the tokens array that is not an array by itself and has a on character length) followed or prefixed by a '?'. It is then possible to replace those occurances with a proper token element. ---- Manual Page -- http://www.php.net/manual/en/function.token-get-all.php Edit Note -- http://master.php.net/manage/user-notes.php?action=edit+35435 Delete Note -- http://master.php.net/manage/user-notes.php?action=delete+35435&report=yes Reject Note -- http://master.php.net/manage/user-notes.php?action=reject+35435&report=yes