large csv text file import into postgresql via PHP

From: Date: Thu, 25 Sep 2003 16:08:46 +0000
Subject: large csv text file import into postgresql via PHP
Groups: php.db 
Request: Send a blank email to php-db+get-30693@lists.php.net to get a copy of this message
we have a number of csv dumps that occasionally have to be used to update tables in a postgres database... normally this is done by uploading the file and whomever running a php based parser which opens the file into an array, does a split on the comma, then executes an insert or update to the database with the split array values. we have a new upload that involves a 143mb file, compared to previous upload sizes of 10k to 150k. Is there a more efficient way to handle this rather than having PHP load the entire file into an array (which would have to be in memory during the operation, correct?). thanks Dave

« previous php.db (#30693) next »