Re: json_encode() and non-UTF8 strings
| From: | Rasmus Lerdorf | Date: | Tue, 03 Apr 2012 01:46:44 +0000 |
| Subject: | Re: json_encode() and non-UTF8 strings | ||
| References: | 1 | Groups: | php.internals |
| Request: | Send a blank email to internals+get-59335@lists.php.net to get a copy of this message | ||
On 04/02/2012 06:35 PM, Charlie Somerville wrote:
> Hi internals,
>
> I've created a pull request (https://github.com/php/php-src/pull/33) that changes
> json_encode to fall back to ASCII for strings that are not valid UTF-8.
>
> I ran into an issue in a production application involving PayPal IPN callbacks (which are sent
> encoded as windows-1252) and json_encode(). If there was an accented character present in the data,
> json_encode() would fail to encode the string and serialize it as 'null'.
>
> I've modified the behaviour of the underlying json_escape_string() implementation to
> attempt to encode strings anyway while still producing a warning.
JSON with non-Unicode strings is no longer JSON. The spec is explicit
that all strings must be Unicode. The default encoding is UTF-8, but it
could be UTF-16/32 as well.
See http://www.ietf.org/rfc/rfc4627.txt
-Rasmus