Bug #52981 [NEW]: Unicode data used by mbstring need to be updated

From: Operating system: PHP version: 5.3.3 Package: Unicode Engine related Bug Type: Bug Bug description:Unicode data used by mbstring need to be updated Description: ------------ mbstring functions seem to use old Unicode data, so the functions are not able to cope with new characters introduced to Unicode lately (e.g. mb_strtoupper ignores lower-case characters because it does not know them). AFAICT (and I am no PHP expert, mind you), what is needed to be done is to update ext/mbstring/unicode_data.h (possibly just regenerating the file, as it says “It was generated by a modified version of ucgendat, part of the ucdata-2.5 package”). Test script: --------------- function test($str) { $upper = mb_strtoupper($str, 'UTF-8'); $len = strlen($upper); for ($i = 0; $i < $len; ++$i) echo dechex(ord($upper[$i])) . ' '; echo "\n"; } // OK test("\xF0\x90\x90\xB8");// U+10438 DESERET SMALL LETTER H (added in 3.1.0, March 2001) // not OK test("\xE2\xB0\xB0"); // U+2C30 GLAGOLITIC SMALL LETTER AZU (added in 4.1.0, March 2005) test("\xD4\xA5"); // U+0525 CYRILLIC SMALL LETTER PE WITH DESCENDER (added in 5.2.0, October 2009) Expected result: ---------------- f0 90 90 90 e2 b0 80 d4 a4 Actual result: -------------- f0 90 90 90 e2 b0 b0 d4 a5 -- Edit bug report at http://bugs.php.net/bug.php?id=52981&edit=1 -- Try a snapshot (PHP 5.2): http://bugs.php.net/fix.php?id=52981&r=trysnapshot52 Try a snapshot (PHP 5.3): http://bugs.php.net/fix.php?id=52981&r=trysnapshot53 Try a snapshot (trunk): http://bugs.php.net/fix.php?id=52981&r=trysnapshottrunk Fixed in SVN: http://bugs.php.net/fix.php?id=52981&r=fixed Fixed in SVN and need be documented: http://bugs.php.net/fix.php?id=52981&r=needdocs Fixed in release: http://bugs.php.net/fix.php?id=52981&r=alreadyfixed Need backtrace: http://bugs.php.net/fix.php?id=52981&r=needtrace Need Reproduce Script: http://bugs.php.net/fix.php?id=52981&r=needscript Try newer version: http://bugs.php.net/fix.php?id=52981&r=oldversion Not developer issue: http://bugs.php.net/fix.php?id=52981&r=support Expected behavior: http://bugs.php.net/fix.php?id=52981&r=notwrong Not enough info: http://bugs.php.net/fix.php?id=52981&r=notenoughinfo Submitted twice: http://bugs.php.net/fix.php?id=52981&r=submittedtwice register_globals: http://bugs.php.net/fix.php?id=52981&r=globals PHP 4 support discontinued: http://bugs.php.net/fix.php?id=52981&r=php4 Daylight Savings: http://bugs.php.net/fix.php?id=52981&r=dst IIS Stability: http://bugs.php.net/fix.php?id=52981&r=isapi Install GNU Sed: http://bugs.php.net/fix.php?id=52981&r=gnused Floating point limitations: http://bugs.php.net/fix.php?id=52981&r=float No Zend Extensions: http://bugs.php.net/fix.php?id=52981&r=nozend MySQL Configuration Error: http://bugs.php.net/fix.php?id=52981&r=mysqlcfg