#43896 [NEW]: htmlspecialchars returns empty string on invalid unicode sequence

From:	arnaud dot lb at gmail dot com	Date:	Sun, 20 Jan 2008 02:12:01 +0000
Subject:	#43896 [NEW]: htmlspecialchars returns empty string on invalid unicode sequence
Groups:	php.bugs
Request:	Send a blank email to php-bugs+get-121410@lists.php.net to get a copy of this message

From:             arnaud dot lb at gmail dot com
Operating system: Any
PHP version:      5.2.5
PHP Bug Type:     Unicode Function Upgrades related
Bug description:  htmlspecialchars returns empty string on invalid unicode sequence

Description:
------------
htmlspecialchars/htmlentities returns an empty string when the input 
contains an invalid unicode sequence.

I think these functions should just skip the invalid sequences or 
encode them byte by byte (e.g. 0xE9 => é), instead of 
discarding the whole string.

Sometimes you have to display arbitrary strings of unknow encoding. 
So you make them more safe using htmlspecialchars($string, 
ENT_COMPAT, "site_encoding, utf-8 in my case"), but if there is at 
least one invalid sequence in the string, it returns an empty 
string :/

Reproduce code:
---------------
$string = "Voil\xE0"; // "Voilà", in ISO-8859-15

var_dump(htmlspecialchars($string, ENT_COMPAT, "utf-8"));


Expected result:
----------------
string(4) "Voil"

OR 

string(10) "Voilà"

Actual result:
--------------
string(0) ""

-- 
Edit bug report at http://bugs.php.net/?id=43896&edit=1
-- 
Try a CVS snapshot (PHP 4.4): http://bugs.php.net/fix.php?id=43896&r=trysnapshot44
Try a CVS snapshot (PHP 5.2): http://bugs.php.net/fix.php?id=43896&r=trysnapshot52
Try a CVS snapshot (PHP 5.3): http://bugs.php.net/fix.php?id=43896&r=trysnapshot53
Try a CVS snapshot (PHP 6.0): http://bugs.php.net/fix.php?id=43896&r=trysnapshot60
Fixed in CVS:                 http://bugs.php.net/fix.php?id=43896&r=fixedcvs
Fixed in release:             http://bugs.php.net/fix.php?id=43896&r=alreadyfixed
Need backtrace:               http://bugs.php.net/fix.php?id=43896&r=needtrace
Need Reproduce Script:        http://bugs.php.net/fix.php?id=43896&r=needscript
Try newer version:            http://bugs.php.net/fix.php?id=43896&r=oldversion
Not developer issue:          http://bugs.php.net/fix.php?id=43896&r=support
Expected behavior:            http://bugs.php.net/fix.php?id=43896&r=notwrong
Not enough info:              http://bugs.php.net/fix.php?id=43896&r=notenoughinfo
Submitted twice:              http://bugs.php.net/fix.php?id=43896&r=submittedtwice
register_globals:             http://bugs.php.net/fix.php?id=43896&r=globals
PHP 3 support discontinued:   http://bugs.php.net/fix.php?id=43896&r=php3
Daylight Savings:             http://bugs.php.net/fix.php?id=43896&r=dst
IIS Stability:                http://bugs.php.net/fix.php?id=43896&r=isapi
Install GNU Sed:              http://bugs.php.net/fix.php?id=43896&r=gnused
Floating point limitations:   http://bugs.php.net/fix.php?id=43896&r=float
No Zend Extensions:           http://bugs.php.net/fix.php?id=43896&r=nozend
MySQL Configuration Error:    http://bugs.php.net/fix.php?id=43896&r=mysqlcfg


   

Thread (24 messages)

• arnaud dot lb at gmail dot comSun, 20 Jan 2008 02:12:01 +0000
  • arnaud dot lb at gmail dot comThu, 24 Jan 2008 12:29:58 +0000#43896 [Opn]: htmlspecialchars returns empty string on invalid unicode sequence
  • tallyce at gmail dot comThu, 24 Jan 2008 20:51:11 +0000#43896 [Com]: htmlspecialchars returns empty string on invalid unicode sequence
  • andreas dot ravnestad at gmail dot comSun, 17 Feb 2008 13:25:23 +0000#43896 [Com]: htmlspecialchars returns empty string on invalid unicode sequence
  • heurika at gmail dot comMon, 05 May 2008 21:00:38 +0000#43896 [Com]: htmlspecialchars returns empty string on invalid unicode sequence
  • sillyxone at yaoo dot comFri, 27 Jun 2008 17:32:43 +0000#43896 [Com]: htmlspecialchars returns empty string on invalid unicode sequence
  • d dot herrlitz at klemm-hensen dot deThu, 17 Jul 2008 11:15:37 +0000#43896 [Com]: htmlspecialchars returns empty string on invalid unicode sequence
  • jani@php.netThu, 17 Jul 2008 23:46:56 +0000#43896 [Opn->Ctl]: htmlspecialchars returns empty string on invalid unicode sequence
  • moriyoshi@php.netFri, 18 Jul 2008 00:10:45 +0000#43896 [Ctl]: htmlspecialchars returns empty string on invalid unicode sequence
  • moriyoshi@php.netTue, 22 Jul 2008 16:06:28 +0000#43896 [Ctl->Opn]: htmlspecialchars returns empty string on invalid unicode sequence
  • jani@php.netSun, 27 Jul 2008 20:24:10 +0000#43896 [Opn->Fbk]: htmlspecialchars returns empty string on invalid unicode sequence
  • yunosh@php.netThu, 11 Sep 2008 12:52:17 +0000#43896 [NoF->Opn]: htmlspecialchars returns empty string on invalid unicode sequence
  • jani@php.netTue, 21 Oct 2008 12:08:39 +0000#43896 [Opn]: htmlspecialchars returns empty string on invalid unicode sequence
  • jani@php.netSun, 02 Nov 2008 13:27:46 +0000#43896 [Opn->Asn]: htmlspecialchars() returns empty string on invalid unicode sequence
  • lbarnaud@php.netWed, 26 Nov 2008 04:30:42 +0000#43896 [Asn]: htmlspecialchars() returns empty string on invalid unicode sequence
  • lbarnaud@php.netWed, 26 Nov 2008 04:31:24 +0000#43896 [Asn]: htmlspecialchars() returns empty string on invalid unicode sequence
  • lbarnaud@php.netWed, 26 Nov 2008 04:33:22 +0000#43896 [Asn->Tbd]: htmlspecialchars() returns empty string on invalid unicode sequence
  • cataphract@php.netMon, 11 Oct 2010 01:16:23 +0000Bug #43896 [Tbd->Csd]: htmlspecialchars() returns empty string on invalid unicode sequence
  • shaun dot bruno at gmail dot comSun, 06 Feb 2011 19:58:07 +0000Bug #43896 [Com]: htmlspecialchars() returns empty string on invalid unicode sequence
  • shaun dot bruno at gmail dot comSun, 06 Feb 2011 20:02:51 +0000Bug #43896 [Com]: htmlspecialchars() returns empty string on invalid unicode sequence
  • hardin at boulder dot nist dot govThu, 11 Aug 2011 04:59:39 +0000Bug #43896 [Com]: htmlspecialchars() returns empty string on invalid unicode sequence
  • cataphract@php.netThu, 11 Aug 2011 09:38:26 +0000Bug #43896 [Csd]: htmlspecialchars() returns empty string on invalid unicode sequence
  • hardin at boulder dot nist dot govFri, 12 Aug 2011 22:18:04 +0000Bug #43896 [Com]: htmlspecialchars() returns empty string on invalid unicode sequence
  • hardin at boulder dot nist dot govFri, 12 Aug 2011 23:01:55 +0000Bug #43896 [Com]: htmlspecialchars() returns empty string on invalid unicode sequence