Re: WIP: WAL prefetch (another approach)
От
Thomas Munro
Тема
Re: WIP: WAL prefetch (another approach)
Дата
Msg-id
CA+hUKGLsF8sEE+n3qoaV6+XjmYEwYoFVDbLPbYTGz7oGkL=iZA@mail.gmail.com
Ответ на
Re: WIP: WAL prefetch (another approach) (Thomas Munro)
Список
Дерево обсуждения
WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Alvaro Herrera <alvherre@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Alvaro Herrera <alvherre@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Andres Freund <andres@anarazel.de>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) David Steele <david@pgmasters.net>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Dmitry Dolgov <9erthalion6@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Dmitry Dolgov <9erthalion6@gmail.com>
Re: WIP: WAL prefetch (another approach) Dmitry Dolgov <9erthalion6@gmail.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Alvaro Herrera <alvherre@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Andres Freund <andres@anarazel.de>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
RE: WIP: WAL prefetch (another approach) Jakub Wartak <Jakub.Wartak@tomtom.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
Re: WIP: WAL prefetch (another approach) Andres Freund <andres@anarazel.de>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: WIP: WAL prefetch (another approach) Andres Freund <andres@anarazel.de>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: WIP: WAL prefetch (another approach) Thomas Munro <thomas.munro@gmail.com>
RE: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Sait Talha Nisanci <Sait.Nisanci@microsoft.com>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
RE: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Sait Talha Nisanci <Sait.Nisanci@microsoft.com>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Andres Freund <andres@anarazel.de>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Robert Haas <robertmhaas@gmail.com>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Stephen Frost <sfrost@snowman.net>
RE: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Sait Talha Nisanci <Sait.Nisanci@microsoft.com>
Re: [EXTERNAL] Re: WIP: WAL prefetch (another approach) Robert Haas <robertmhaas@gmail.com>
Here's rebase, on top of Horiguchi-san's v19 patch set. My patches start at 0007. Previously, there was a "nowait" flag that was passed into all the callbacks so that XLogReader could wait for new WAL in some cases but not others. This new version uses the proposed XLREAD_NEED_DATA protocol, and the caller deals with waiting for data to arrive when appropriate. This seems tidier to me. I made one other simplifying change: previously, the prefetch module would read the WAL up to the "written" LSN (so, allowing itself to read data that had been written but not yet flushed to disk by the walreceiver), though it still waited until a record's LSN was "flushed" before replaying. That allowed prefetching to happen concurrently with the WAL flush, which was nice, but it felt a little too "special". I decided to remove that part for now, and I plan to look into making standbys work more like primary servers, using WAL buffers, the WAL writer and optionally the standard log-before-data rule.
В списке pgsql-hackers по дате отправления
От: Magnus Hagander
Дата:
От: Magnus Hagander
Дата: