#19257 [Bgs]: strtolower & strtoupper does not work for UTF-8 strings

ID: 19257 Updated by: wez@php.net Reported By: gamid@isayev.net Status: Bogus Bug Type: Strings related Operating System: Linux PHP Version: 4.2.2 New Comment: I forgot to add that you should feed your utf8 data to the input of that little program. Previous Comments: ------------------------------------------------------------------------ [2002-09-10 08:52:58] wez@php.net This is not a bug in PHP; it's down to whether your system can support this and has the appropriate locales installed. A quick and dirty example might look this this in C: #include <ctype.h> main() { char buff[1024]; while(fgets(buff, sizeof(buff), stdin)) { int i, l; l = strlen(buff); for (i = 0; i < l; i++) buff[i] = toupper(buff[i]); puts(buff); } } If that little program works, your system supports this conversion. If it doesn't, then PHP doesn't either. ------------------------------------------------------------------------ [2002-09-10 08:44:36] gamid@isayev.net > So you didn't try it..? Yes, I set LC_ALL/LANG to 'en_US' and try it. > I only tried your test script and got the expected result. > Whatever the characters are.. I've no idea of them anyway.. I think your confused by looking on the result of test script with encoding set to 'ISO-8859-x' instead of 'UTF-8'. In this case it looks as some characters changed to lower/upper case. BUT they are not UTF-8 lower/upper case characters: 1) 0xC39C changed to 0xE39C, should be 0xC3BC 2) 0xD0AF changed to 0xF0AF, should be 0xD18F As result we have not UTF-8 string but a garbage. If you really like test this issue you should set 'default_charset=utf-8' in php.ini or set encoding to 'UTF-8' in your browser. > btw. AFAIK, setting LANG / LC_ALL to UTF-8 is not correct > way to do it.. > According to that HOWTO, it should be something like > ru_RU.UTF-8 (and only if you really have UTF-8 locales) I try en_US.UTF-8, de_DE.UTF-8, ru_RU.UTF-8 - no lack. > I'm bogusing this since it really isn't anything PHP can > affect.. So, no way in PHP convert UTF-8 string to lower/upper case? ------------------------------------------------------------------------ [2002-09-09 17:06:43] sniper@php.net So you didn't try it..? I only tried your test script and got the expected result. Whatever the characters are..I've no idea of them anyway.. btw. AFAIK, setting LANG / LC_ALL to UTF-8 is not correct way to do it.. http://melkor.dnp.fmph.uniba.sk/~garabik/debian-utf8/howto.h tml According to that HOWTO, it should be something like ru_RU.UTF-8 (and only if you really have UTF-8 locales) I'm bogusing this since it really isn't anything PHP can affect.. ------------------------------------------------------------------------ [2002-09-09 11:28:45] gamid@isayev.net > I tried setting LANG/LC_ALL to that and it indeed > didn't work. When I set those to "en_US" it works just fine. What you mean "works just fine"? Did it convert 0xC39C ('Ü' in UTF-8 encoding) into 0xC3BC ('ü' in UTF-8 encoding)? Or 0xD0AF (Russian capital "ya" in UTF-8 encoding) into 0xD18F (Russian lowercase "ya" in UTF-8 encoding)? ------------------------------------------------------------------------ [2002-09-09 10:45:05] sniper@php.net I didn't know UTF-8 is a locale.. I tried setting LANG/LC_ALL to that and it indeed didn't work. When I set those to "en_US" it works just fine. ------------------------------------------------------------------------ The remainder of the comments for this report are too long. To view the rest of the comments, please view the bug report online at http://bugs.php.net/19257 -- Edit this bug report at http://bugs.php.net/?id=19257&edit=1