Re: WAL prefetch

Поиск
Список
Период
Сортировка
Искать
От
Konstantin Knizhnik
Тема
Re: WAL prefetch
Дата
Msg-id
40408869-067e-d1cf-3fef-4f380a2e5d38@postgrespro.ru
Ответ на
Re: WAL prefetch (Andres Freund)
Список
Дерево обсуждения
WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Stephen Frost <sfrost@snowman.net>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>
Re: WAL prefetch Robert Haas <robertmhaas@gmail.com>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Robert Haas <robertmhaas@gmail.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Thomas Munro <thomas.munro@enterprisedb.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Robert Haas <robertmhaas@gmail.com>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Sean Chittenden <seanc@joyent.com>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Andres Freund <andres@anarazel.de>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Ants Aasma <ants.aasma@eesti.ee>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Thomas Munro <thomas.munro@enterprisedb.com>
Re: WAL prefetch Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WAL prefetch Stephen Frost <sfrost@snowman.net>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>
Re: WAL prefetch Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: WAL prefetch Amit Kapila <amit.kapila16@gmail.com>


On 16.06.2018 22:23, Andres Freund wrote:
> Hi,
>
> On 2018-06-13 16:09:45 +0300, Konstantin Knizhnik wrote:
>> Usage:
>> 1. At master: create extension wal_prefetch
>> 2. At replica: Call pg_wal_prefetch() function: it will not return until you
>> interrupt it.
> FWIW, I think the proper design would rather be a background worker that
> does this work. Forcing the user to somehow coordinate starting a
> permanently running script whenever the database restarts isn't
> great. There's also some issues around snapshots preventing vacuum
> (which could be solved, but not nicely).

As I already wrote, the current my approach with extension and 
pg_wal_prefetch function called by user can be treated only as prototype 
implementation which can be used to estimate efficiency of prefetch. But 
in case of prefetching in shared buffers, one background worker will not 
be enough. Prefetch can can speedup recovery process if it performs 
reads in parallel or background. So more than once background worker 
will be needed for prefetch if we read data to Postgres shared buffers 
rather then using posix_prefetch to load page in OS cache.

>
> Greetings,
>
> Andres Freund


В списке pgsql-hackers по дате отправления
От: Konstantin Knizhnik
Дата:
Сообщение: Re: WAL prefetch
От: Andres Freund
Дата:
Сообщение: Re: WAL prefetch
FAQ