#35711 [Opn->Asn]: ISO-8859 charset not correctly detected when

From: Date: Fri, 16 Dec 2005 16:51:14 +0000
Subject: #35711 [Opn->Asn]: ISO-8859 charset not correctly detected when
References: 1  Groups: php.bugs 
Request: Send a blank email to php-bugs+get-90561@lists.php.net to get a copy of this message
 ID:               35711
 Updated by:       sniper@php.net
 Reported By:      matteo at beccati dot com
-Status:           Open
+Status:           Assigned
 Bug Type:         mbstring related
 Operating System: Debian GNU/Linux
 PHP Version:      5.1.1
-Assigned To:      
+Assigned To:      moriyoshi
 New Comment:

Moriyoshi, if ext/mbstring is not maintained anymore, please let us
know.


Previous Comments:
------------------------------------------------------------------------

[2005-12-16 17:18:27] matteo at beccati dot com

Description:
------------
I was evaluating the mbstring extension because of its capabilities to
filter and convert input parameter to the correct encoding. During my
test I found out that an ISO-8859-1 string which ends with an an
accented character is wrongly detected as UTF-8, even if it ends with
an incomplete multibyte character (using iconv to convert the string
raises such notice).

Also reproduced with PHP 4.3.11 on FreeBSD 4 and 5.0.2 on Win32.


Reproduce code:
---------------
<?php

error_reporting(E_ALL);
mb_detect_order('ASCII,UTF-8,ISO-8859-1');

// \xE0 is ISO-8859-1 small a grave char
test_bug("Test: \xE0");
test_bug("Test: \xE0a");

function test_bug($s) {
    echo "Trying: ";
    var_dump($s);
    iconv('UTF8', 'UCS2', $s);
    echo "Detected encoding: ".mb_detect_encoding($s)."\n";
    echo "Converted string:";
    var_dump(mb_convert_encoding($s, 'UTF-8',
        'ASCII,UTF-8,ISO-8859-1'));
    echo "\n";
}

?>

Expected result:
----------------
Trying: string(7) "Test: à"

Notice: iconv(): Detected an incomplete multibyte character in input
string in test.php on line 13
Detected encoding: ISO-8859-1
Converted string:string(8) "Test: Ã "

Trying: string(8) "Test: àa"

Notice: iconv(): Detected an illegal character in input string in
/var/www/mbstring/test.php on line 13
Detected encoding: ISO-8859-1
Converted string:string(9) "Test: Ã a"


Actual result:
--------------
Trying: string(7) "Test: à"

Notice: iconv(): Detected an incomplete multibyte character in input
string in test.php on line 13
Detected encoding: UTF-8
Converted string:string(6) "Test: "

Trying: string(8) "Test: àa"

Notice: iconv(): Detected an illegal character in input string in
/var/www/mbstring/test.php on line 13
Detected encoding: ISO-8859-1
Converted string:string(9) "Test: Ã a"



------------------------------------------------------------------------


-- 
Edit this bug report at http://bugs.php.net/?id=35711&edit=1


Thread (18 messages)

« previous php.bugs (#90561) next »