any solution for doing a data file import spawning it on multiple processes

Поиск
Список
Период
Сортировка
От hb@101-factory.eu
Тема any solution for doing a data file import spawning it on multiple processes
Дата
Msg-id 8AEB78AA-CF8E-4F0F-AECF-0333451B6C3A@101-factory.eu
обсуждение исходный текст
Ответы Re: any solution for doing a data file import spawning it on multiple processes  (Edson Richter <edsonrichter@hotmail.com>)
Список pgsql-general
hi there,

I am trying to import large data files into pg.
for now i used the. xarg linux command to spawn the file line for line and set  and use the  maximum available
connections. 

we use pg pool as connection pool to the database, and so try to maximize the concurrent data import of the file.

problem for now that it seems to work well but we miss a line once in a while, and that is not acceptable. also it
createszombies ;(.  

does anybody have any other tricks that will do the job?

thanks,

Henk

В списке pgsql-general по дате отправления:

Предыдущее
От: Gabriele Bartolini
Дата:
Сообщение: Re: Smaller multiple tables or one large table?
Следующее
От: Edson Richter
Дата:
Сообщение: Re: any solution for doing a data file import spawning it on multiple processes