RE: Bulk Insert into PostgreSQL
От
Tsunakawa, Takayuki
Тема
RE: Bulk Insert into PostgreSQL
Дата
Msg-id
0A3221C70F24FB45833433255569204D1FA27379@G01JPEXMBYT05
Ответ на
Re: Bulk Insert into PostgreSQL (Srinivas Karthik V)
Список
Дерево обсуждения
Bulk Insert into PostgreSQL Srinivas Karthik V <skarthikv.iitb@gmail.com>
Re: Bulk Insert into PostgreSQL Pavel Stehule <pavel.stehule@gmail.com>
Re: Bulk Insert into PostgreSQL Don Seiler <don@seiler.us>
Re: Bulk Insert into PostgreSQL Srinivas Karthik V <skarthikv.iitb@gmail.com>
RE: Bulk Insert into PostgreSQL "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Bulk Insert into PostgreSQL Peter Geoghegan <pg@bowt.ie>
RE: Bulk Insert into PostgreSQL "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Bulk Insert into PostgreSQL Srinivas Karthik V <skarthikv.iitb@gmail.com>
Re: Bulk Insert into PostgreSQL Peter Geoghegan <pg@bowt.ie>
Re: Bulk Insert into PostgreSQL Srinivas Karthik V <skarthikv.iitb@gmail.com>
Re: Bulk Insert into PostgreSQL Craig Ringer <craig@2ndquadrant.com>
Re: Bulk Insert into PostgreSQL Ashwin Agrawal <aagrawal@pivotal.io>
RE: Bulk Insert into PostgreSQL ROS Didier <didier.ros@edf.fr>
From: Srinivas Karthik V [mailto:skarthikv.iitb@gmail.com] > I was using copy command to load. Removing the primary key constraint on > the table and then loading it helps a lot. In fact, a 400GB table was loaded > and the primary constraint was added in around 15 hours. Thanks for the > wonderful suggestions. 400 GB / 15 hours = 7.6 MB/s That looks too slow. I experienced a similar slowness. While our user tried to INSERT (not COPY) a billion record, they reported INSERTs slowed down by 10 times or so after inserting about 500 million records. Periodic pstack runs on Linux showed that the backend was busy in btree operations. I didn't pursue the cause due to other businesses, but there might be something to be improved. Regards Takayuki Tsunakawa
В списке pgsql-hackers по дате отправления
