Re: INSERT performance deteriorates quickly during a large import

Поиск
Список
Период
Сортировка
От Márcio Geovani Jasinski
Тема Re: INSERT performance deteriorates quickly during a large import
Дата
Msg-id fc73093f0711090352i241b42e0x9a99a84c32b0bd00@mail.gmail.com
обсуждение исходный текст
Ответ на Re: INSERT performance deteriorates quickly during a large import  (Chris Browne <cbbrowne@acm.org>)
Список pgsql-general
Hello Krasimir,

You got a lot of good advices above and I would like to add another one:

d) Make sure of your PHP code is not recursive. As you said the memory is stable so I think your method is iterative.
A recursive method certainly will increase a little time for each insert using more memory.
But iterative methods must be correctly to be called just once and maybe your code is running much more than need.

Pay attention on Tomas advices, and after that (I agree with Cris) "there should be no reason for loading data to get more costly as
the size of the table increases" - Please check your code.

I did some experiences long time ago with 40000 data with a lot of BLOBs. I used PHP code using SELECT/INSERT from Postgres to Postgres and the time wasn't constant but wasn't so bad as your case.  (And I didn't the Tomas a, b and c advices)

Good Luck
--
Márcio Geovani Jasinski

В списке pgsql-general по дате отправления:

Предыдущее
От: "Leif B. Kristensen"
Дата:
Сообщение: Re: any way for ORDER BY x to imply NULLS FIRST in 8.3?
Следующее
От: Karsten Hilbert
Дата:
Сообщение: Re: Warning about max_fsm_pages: what's that?