Bug #75063 [Asn->Fbk]: Many filesystem-related functions do not work with multibyte file names

Edit report at https://bugs.php.net/bug.php?id=75063&edit=1 ID: 75063 Updated by: ab@php.net Reported by: anrdaemon at freemail dot ru Summary: Many filesystem-related functions do not work with multibyte file names -Status: Assigned +Status: Feedback Type: Bug Package: Filesystem function related Operating System: Windows PHP Version: 7.1.8 Assigned To: ab Block user comment: N Private report: N New Comment: @arndaemon which exact build did you use? From the supplied archive - the folder in the root is shown as "ΓÑßΓ-75063". It might be either a packaging error, or possibly something on the HD that could be a cause. If latter, which kind of FS is that, like local HD, NTFS, Samba, etc.? Thanks. Previous Comments: ------------------------------------------------------------------------ [2017-08-11 15:19:10] anrdaemon at freemail dot ru The bug #72555 (parent of those mentioned) is about dealing with console codepage. The present issue is strictly internal. Here, I modified the test script a little and supplied the example output from running it with "php -nf ..." http://www.rootdir.org/upload/Bugs/PHP-75063/php-75063.zip ------------------------------------------------------------------------ [2017-08-11 13:02:33] requinix@php.net I can get the correct result and various different incorrect results, but not your result. You're running PHP 7.1.8 and not an earlier version? What does echo chcp show? Have you looked at the comments in other similar bug reports (like #74589, #72555, and your earlier #73716) for anything that appears relevant? ------------------------------------------------------------------------ [2017-08-11 12:04:29] anrdaemon at freemail dot ru Weird. Works for me if only filename contains multibyte characters, but breaks when path contains them also, but again, only for multibyte file names. Can you please try it with parent directory name contaning multibyte characters? Another interesting finding: getcwd() returns natively encoded filename. $ php.exe -nf opendir.php <?php print file_get_contents(__FILE__) . "-- \n"; print ini_get("internal_encoding") . "\n"; print ini_get("default_charset") . "\n"; print getcwd() . "\n"; print iconv('CP1251', 'UTF-8', getcwd()) . "\n"; foreach(["test", "тест"] as $fn) file_put_contents("$fn.txt", ""); if ($dh = opendir(getcwd())) { while (($file = readdir($dh)) !== false) { echo "filename: $file : filetype: " . filetype($file) . "\n"; } closedir($dh); } -- UTF-8 C:\dev\temp\ C:\dev\temp\тест filename: . : filetype: dir filename: .. : filetype: dir filename: opendir.php : filetype: file filename: test.txt : filetype: file filename: UTF-8.php : filetype: file Warning: filetype(): Lstat failed for тест.txt in C:\dev\temp\тест\opendir.php on line 12 filename: тест.txt : filetype: ------------------------------------------------------------------------ [2017-08-11 10:40:15] requinix@php.net Works for me. Are you sure you saved the file in UTF-8 format? ------------------------------------------------------------------------ [2017-08-11 10:14:29] anrdaemon at freemail dot ru Description: ------------ Many filesystem functions that read, write or otherwise deal with file names are unable to work with multibyte encoded filenames, such as when internal_encoding is equal to UTF-8. Even the example in https://php.net/opendir doesn't work, if a path contains multibyte sequences. Test script: --------------- <?php print ini_get("internal_encoding") . "\n"; print ini_get("default_charset") . "\n"; foreach(["test", "тест"] as $fn) file_put_contents("$fn.txt", ""); print_r(glob("*.txt")); Expected result: ---------------- $ php -nf ./xx.php UTF-8 Array ( [0] => test.txt [1] => тест.txt ) Actual result: -------------- $ php -nf ./xx.php UTF-8 Array ( [0] => test.txt ) ------------------------------------------------------------------------ -- Edit this bug report at https://bugs.php.net/bug.php?id=75063&edit=1