#33857 [Opn->Fbk]: token_get_all() inconsistent results?

ID: 33857 Updated by: sniper@php.net Reported By: sr at brightlight dot ch -Status: Open +Status: Feedback -Bug Type: Unknown/Other Function +Bug Type: Scripting Engine problem Operating System: Mac OS X 10.4.1 PHP Version: 5.0.4 New Comment: Please try using this CVS snapshot: http://snaps.php.net/php5-latest.tar.gz For Windows: http://snaps.php.net/win32/php5-win32-latest.zip Previous Comments: ------------------------------------------------------------------------ [2005-07-26 00:04:18] sr at brightlight dot ch Description: ------------ Obviously the same problem as in Bug #33093, which is set to bogus (no comment). When I tokenize the very same code over and over again I happen to get different tokens. About 9 times out of 10 I get: Token'<', Token '?', Token T_STRING 'php', Token T_WHITESPACE '\n', About 1 time out of 10 Times I get Token T_OPEN_TAG '<?php\n', So the first case happens far more often. By saying the same code btw. I mean that I put the tokenizing function into a for-loop. So the code doesn't even get touched. PHP 5.0.4 (entropy.ch's binary), Apache 2.0.54, Mac OS X 10.4.1 PPC. The tokenized files encoding (I tried UTF-8 no BOM and ISO- Latin-1) doesn't seem to play a role. Line endings are always Unix-style. ------------------------------------------------------------------------ -- Edit this bug report at http://bugs.php.net/?id=33857&edit=1