Bug #52971 [Opn->Bgs]: PCRE-Meta-Characters not working with utf-8
| From: | cataphract@php.net | Date: | Sat, 02 Oct 2010 18:26:05 +0000 |
| Subject: | Bug #52971 [Opn->Bgs]: PCRE-Meta-Characters not working with utf-8 | ||
| References: | 1 | Groups: | php.bugs |
| Request: | Send a blank email to php-bugs+get-154836@lists.php.net to get a copy of this message | ||
Edit report at http://bugs.php.net/bug.php?id=52971&edit=1
ID: 52971
Updated by: cataphract@php.net
Reported by: marc dot bennewitz at giata dot de
Summary: PCRE-Meta-Characters not working with utf-8
-Status: Open
+Status: Bogus
Type: Bug
Package: PCRE related
Operating System: Linux
PHP Version: 5.3.3
Block user comment: N
New Comment:
This is by design, it's the way \b and \w are defined in PCRE.
You'll have to use another strategy, like look behind and unicode
character properties.
Previous Comments:
------------------------------------------------------------------------
[2010-10-02 17:58:41] marc dot bennewitz at giata dot de
Description:
------------
PCRE-Meta-Characters like \b \w not working with unicode strings.
PHP-5.3.3 (32Bit)
pcre
PCRE (Perl Compatible Regular Expressions) Support => enabled
PCRE Library Version => 8.02 2010-03-19
Directive => Local Value => Master Value
pcre.backtrack_limit => 100000 => 100000
pcre.recursion_limit => 100000 => 100000
iconv
iconv support => enabled
iconv implementation => glibc
iconv library version => 2.10.1
Directive => Local Value => Master Value
iconv.input_encoding => ISO-8859-1 => ISO-8859-1
iconv.internal_encoding => ISO-8859-1 => ISO-8859-1
iconv.output_encoding => ISO-8859-1 => ISO-8859-1
Test script:
---------------
<?php // encoding: UTF-8
$message = 'Der ist ein SüÃwasserpool Süsswasserpool ... verschiedene
Wassersportmöglichkeiten bei ...';
$pattern = '/\bwasser/iu';
preg_match_all($pattern, $message, $match, PREG_OFFSET_CAPTURE);
var_dump($match);
$pattern = '/[^\w]wasser/iu';
preg_match_all($pattern, $message, $match, PREG_OFFSET_CAPTURE);
var_dump($match);
Expected result:
----------------
array(1) {
[0]=>
array(1) {
[0]=>
array(2) {
[0]=>
string(6) "Wasser"
[1]=>
int(61)
}
}
}
array(1) {
[0]=>
array(1) {
[0]=>
array(2) {
[0]=>
string(7) " Wasser"
[1]=>
int(60)
}
}
}
Actual result:
--------------
array(1) {
[0]=>
array(2) {
[0]=>
array(2) {
[0]=>
string(6) "wasser"
[1]=>
int(17)
}
[1]=>
array(2) {
[0]=>
string(6) "Wasser"
[1]=>
int(61)
}
}
}
array(1) {
[0]=>
array(2) {
[0]=>
array(2) {
[0]=>
string(8) "Ãwasser"
[1]=>
int(15)
}
[1]=>
array(2) {
[0]=>
string(7) " Wasser"
[1]=>
int(60)
}
}
}
------------------------------------------------------------------------
--
Edit this bug report at http://bugs.php.net/bug.php?id=52971&edit=1