Massive update, memory usage

Поиск
Список
Период
Сортировка
От Trenta sis
Тема Massive update, memory usage
Дата
Msg-id AANLkTiniK=6ZLjiQJYHnRSO_zsePYjqGf=cm733JG+3R@mail.gmail.com
обсуждение исходный текст
Ответы Re: Massive update, memory usage
Re: Massive update, memory usage
Список pgsql-performance

Hi,

I have a Linux Server (Debian) with Postgres 8.3 and I have problems with a massive update, about 400000 updates/inserts.
If I execute about 100000 it seems all ok, but when I execute 400000, I have the same problem with or without a transaction (I need to do with a transaction) increase memory usage and disk usage.
With a execution of 400.000 inserts/update server begin woring well, but after 100 seconds of executions increase usage of RAM, and then Swap and finally all RAM and swap are used and execution can't finish.
I have made some tuning in server, I have modified:
-shared_buffers 1024 Mb
-work_mem 512 Mb
-effective_cache_size 2048Mb
-random_page_cost 2.0
-checkpoint_segments 64
-wal_buffers 8Mb
-max_prepared_transaction 100
-synchronous_commit off

what is wrong in this configuration to executes this inserts/update?

Server has: 4Gb RAM, 3GB Swap and SATA Disk with RAID5


Thanks

#avg_ls_inline_popup { position:absolute; z-index:9999; padding: 0px 0px; margin-left: 0px; margin-top: 0px; width: 240px; overflow: hidden; word-wrap: break-word; color: black; font-size: 10px; text-align: left; line-height: 13px;}

В списке pgsql-performance по дате отправления:

Предыдущее
От: "Reid Thompson"
Дата:
Сообщение: Re: temporary tables, indexes, and query plans
Следующее
От: Jesper Krogh
Дата:
Сообщение: Re: Postgres insert performance and storage requirement compared to Oracle