#49660 [Opn->Csd]: libxml 2.7.3+ limits text nodes to 10MB

From: Date: Tue, 01 Dec 2009 02:06:14 +0000
Subject: #49660 [Opn->Csd]: libxml 2.7.3+ limits text nodes to 10MB
References: 1  Groups: php.bugs 
Request: Send a blank email to php-bugs+get-145253@lists.php.net to get a copy of this message
 ID:               49660
 Updated by:       felipe@php.net
 Reported By:      sta at netimage dot dk
-Status:           Open
+Status:           Closed
 Bug Type:         SOAP related
 Operating System: FreeBSD 7.1
-PHP Version:      5.2.11
+PHP Version:      *
 New Comment:

This bug has been fixed in SVN.

Snapshots of the sources are packaged every three hours; this change
will be in the next snapshot. You can grab the snapshot at
http://snaps.php.net/.
 
Thank you for the report, and for helping us make PHP better.




Previous Comments:
------------------------------------------------------------------------

[2009-12-01 02:05:29] svn@php.net

Automatic comment from SVN on behalf of felipe
Revision: http://svn.php.net/viewvc/?view=revision&revision=291533
Log: - Fixed bug #49660 (libxml 2.7.3+ limits text nodes to 10MB).
(Felipe)
- Added LIBXML_PARSEHUGE constant to overrides the maximum text size of
a
  single text node when using libxml2.7.3+. (Kalle)
[DOC]

------------------------------------------------------------------------

[2009-09-28 11:31:14] sta at netimage dot dk

Hi Kalle.

Thanks for replying so soon.

Your patch does fix the issue when loading directly with 
simplexml_load_file('file.xml', 'SimpleXMLElement', LIBXML_PARSEHUGE);

However the error was not originally encountered using simplexml, but
using SoapClient - and there does not seem to be a way to pass
libxml-options to SoapClient.

So as far as I can tell, the problem remains when using SoapClient.

/Thing

------------------------------------------------------------------------

[2009-09-26 12:12:14] kalle@php.net

I guess we could expose the constant value from ext/libxml if available
like:
Index: libxml.c
===================================================================
--- libxml.c	(revision 288659)
+++ libxml.c	(working copy)
@@ -622,6 +622,9 @@
 	REGISTER_LONG_CONSTANT("LIBXML_COMPACT",	XML_PARSE_COMPACT,		CONST_CS
| CONST_PERSISTENT);

	REGISTER_LONG_CONSTANT("LIBXML_NOXMLDECL",	XML_SAVE_NO_DECL,		CONST_CS
| CONST_PERSISTENT);
 #endif
+#if LIBXML_VERSION >= 20703
+	REGISTER_LONG_CONSTANT("LIBXML_PARSEHUGE",	XML_PARSE_HUGE,			CONST_CS
| CONST_PERSISTENT);
+#endif

	REGISTER_LONG_CONSTANT("LIBXML_NOEMPTYTAG",	LIBXML_SAVE_NOEMPTYTAG,	CONST_CS
| CONST_PERSISTENT);
 
 	/* Error levels */


Does this work for you when passing it to SimpleXML's $option
parameter?

(Patch made against PHP_5_3, but is just a 3 line c/p to other
branches)

------------------------------------------------------------------------

[2009-09-24 15:37:58] sta at netimage dot dk

Description:
------------
Since version 2.7.3 libxml limits the maximum size of a single text
node to 10MB.
The limit can be removed with a new option, XML_PARSE_HUGE.
PHP has no way to specify this option to libxml.

I found the bug when making af SOAP-request where the reply contained a
20MB string.
SoapClient->__call() threw an exception: 'looks like we got no XML
document'

Using libxml_use_internal_errors(true) and libxml_get_errors() I could
narrow it down to a LibXMLError, code 5, 'Extra content at the end of
the document' - but the specified line and column was in the middle of a
large text node.

Using SoapClient->__getLastResponse() I saved the response to a file.
The xmllib program xmllint then revealed the cause:
> xmllint --noout soap_response.txt 
soap_response.txt:111834: error: xmlSAX2Characters: huge text node: out
of memory

We need a way to specify the XML_PARSE_HUGE option to libxml - perhaps
something like a new function: libxml_parse_huge(true).


Reproduce code:
---------------
<?php
$xml = "<?xml version='1.0' encoding='utf-8' standalone='yes'
?><test>"
. str_repeat('A', 12000000) . "</test>";
file_put_contents('file.xml', $xml);
$sxe = simplexml_load_file('file.xml');
if ($sxe instanceof SimpleXMLElement) {
	echo 'OK\n';
}
else {
	var_dump($sxe);
}


Expected result:
----------------
OK

Actual result:
--------------
PHP Warning:  simplexml_load_file(): file.xml:1: error:
xmlSAX2Characters: huge text node: out of memory in
/usr/dana/data/developers/holst/mobilmap/cron/xml.php on line 5
PHP Warning:  simplexml_load_file():
AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA
in /usr/dana/data/developers/holst/mobilmap/cron/xml.php on line 5
PHP Warning:  simplexml_load_file():                                   
                                            ^ in
/usr/dana/data/developers/holst/mobilmap/cron/xml.php on line 5
bool(false)


------------------------------------------------------------------------


-- 
Edit this bug report at http://bugs.php.net/?id=49660&edit=1



Thread (7 messages)

« previous php.bugs (#145253) next »