Re: Handing off SLRU fsyncs to the checkpointer

Поиск
Список
Период
Сортировка
Искать
От
Thomas Munro
Тема
Re: Handing off SLRU fsyncs to the checkpointer
Дата
Msg-id
CA+hUKGLpAEXAhW+G0gc1XB=GFMa3dmnjCmVxRm8EivUu3fRULw@mail.gmail.com
Ответ на
Список
Дерево обсуждения
Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Robert Haas <robertmhaas@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Jakub Wartak <Jakub.Wartak@tomtom.com>
Re: Handing off SLRU fsyncs to the checkpointer Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Jakub Wartak <Jakub.Wartak@tomtom.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Andres Freund <andres@anarazel.de>
Re: Handing off SLRU fsyncs to the checkpointer Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Handing off SLRU fsyncs to the checkpointer Jakub Wartak <Jakub.Wartak@tomtom.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Jakub Wartak <Jakub.Wartak@tomtom.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Jakub Wartak <Jakub.Wartak@tomtom.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Tom Lane <tgl@sss.pgh.pa.us>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
Re: Handing off SLRU fsyncs to the checkpointer Thomas Munro <thomas.munro@gmail.com>
On Sat, Aug 29, 2020 at 12:43 AM Jakub Wartak  wrote:
> ... %CPU ... COMMAND
> ... 97.4 ... postgres: startup recovering 000000010000000000000089

So, what else is pushing this thing off CPU, anyway?  For one thing, I
guess it might be stalling while reading the WAL itself, because (1)
we only read it 8KB at a time, relying on kernel read-ahead, which
typically defaults to 128KB I/Os unless you cranked it up, but for
example we know that's not enough to saturate a sequential scan on
NVME system, so maybe it hurts here too (2) we keep having to switch
segment files every 16MB.  Increasing WAL segment size and kernel
readahead size presumably help with that, if indeed it is a problem,
but we could also experiment with a big POSIX_FADV_WILLNEED hint for a
future segment every time we cross a boundary, and also maybe increase
the size of our reads.


В списке pgsql-hackers по дате отправления
От: Robert Haas
Дата:
От: Andy Fan
Дата:
FAQ