Re: pg_xlog size growing untill it fills the partition

Поиск
Список
Период
Сортировка
От Jeff Janes
Тема Re: pg_xlog size growing untill it fills the partition
Дата
Msg-id CAMkU=1x2qTprBvhxoMuP--RXZ8B-2fppR-OVbskFdOpyKMW3SQ@mail.gmail.com
обсуждение исходный текст
Ответ на Re: pg_xlog size growing untill it fills the partition  (Marcin Mańk <marcin.mank@gmail.com>)
Ответы Re: pg_xlog size growing untill it fills the partition  (Michal TOMA <mt@sicoop.com>)
Список pgsql-general
On Mon, Oct 7, 2013 at 6:23 AM, Marcin Mańk <marcin.mank@gmail.com> wrote:
On Thu, Oct 3, 2013 at 11:56 PM, Michal TOMA <mt@sicoop.com> wrote:

This is what I can see in the log:
2013-10-03 13:58:56 CEST   LOG:  checkpoint starting: xlog
2013-10-03 13:59:56 CEST   LOG:  checkpoint complete: wrote 448 buffers (0.2%); 0 transaction log file(s) added, 9 removed, 18 recycled; write=39.144 s, s, sync=12102.311 s, total=12234.608 s; sync files=667, longest=181.374 s, average=18.144 s

2013-10-03 22:30:25 CEST   LOG:  checkpoint starting: xlog time

From your logs, it seems that the writes are spread all over the (fairly large) database. Is that correct? What is the database size? What is the size of the working data set (i.e. the set of rows that are in use)?

I heard of people having good results with setting a low value for shared_buffers (like 128MB) in a high write activity scenarios. Setting it that low would mean that checkpoints would have 16 times less to do.

It looks like most of the actual writing is being done by either the background writer or the backends themselves, not the checkpoint.  And the checkpointer still has to sync all the files, so lowering it further is unlikely to help.

I don't think he ever gave us the specs of the RAID is using.   My guess is that it is way too small for the workload.

Cheers,

Jeff

В списке pgsql-general по дате отправления:

Предыдущее
От: Vick Khera
Дата:
Сообщение: Re: Hi, Friends, are there any ETL tools (free or commercial) available for PostgreSQL?
Следующее
От: Alvaro Herrera
Дата:
Сообщение: Re: Please stop sending me those e-mails