Re: [RFC] Replace the flex-based scanner with an re2c [1] based lexer

From: Date: Mon, 03 Mar 2008 18:58:55 +0000
Subject: Re: [RFC] Replace the flex-based scanner with an re2c [1] based lexer
References: 1 2 3  Groups: php.internals 
Request: Send a blank email to internals+get-35917@lists.php.net to get a copy of this message
Hi!
Since there's no documentation about zend-multibyte stuff I spent some time searching for other resources about it, but except bug reports I found nothing whee it was required. I'm sure there are some but comments like "TODO: support widechars" in the code give me the impression that it doesn't really work... and I guess many people just enable it sinceit
It does work and there are people using it, even though I imagine it can have some bugs. I guess it would be best to talk to mbstring maintainer on code details, etc.
If there are good use cases for that switch I won't like to replace some small engine thingy with a huge external library like ICU.
The use cases are scripts written in encodings like shift-JIS, etc.
And I doubt that more than just a few people know what it really does - Marcus and I just found out while working on that stuff over the weekend.
So I guess documentation is important :) Let it be a lesson to us all. -- Stanislav Malyshev, Zend Software Architect stas@zend.com http://www.zend.com/ (408)253-8829 MSN: stas@zend.com

« previous php.internals (#35917) next »