RE: [PHP] huge file to insert into postgres db
| From: | Mark Douglas | Date: | Tue, 22 Apr 2003 07:39:06 +0000 |
| Subject: | RE: [PHP] huge file to insert into postgres db | ||
| Groups: | php.general | ||
| Request: | Send a blank email to php-general+get-144784@lists.php.net to get a copy of this message | ||
What exactly is preventing you from doing more than 10000 records at a time?
How are you shopping the file into "manageable bits" at present?
-----Original Message-----
From: Matt MacLeod [mailto:matt@bigbarn.co.uk]
Sent: Tuesday, April 22, 2003 3:31 AM
To: php-general@lists.php.net
Subject: [PHP] huge file to insert into postgres db
Hi,
I have a large CSV file containing UK postcodes with their n/e
co-ordinates which I need to put into a postgresql database. Its become
very hard to handle as my machine cannot handle the whole CSV file so
I've been chopping it into more manageable pieces and creating PHP
insert scripts with the 'chopped bits'.
Unfortunately, my PC can only handle about 10000 records at a time and
there are 2 million+. I don't have time to do 200 scripts, so does
anybody have any further ideas.
Matt
--
PHP General Mailing List (http://www.php.net/)
To unsubscribe, visit: http://www.php.net/unsub.php