Re: Exit walsender before confirming remote flush in logical replication
От
Amit Kapila
Тема
Re: Exit walsender before confirming remote flush in logical replication
Дата
Msg-id
CAA4eK1+pD654+XnrPugYueh7Oh22EBGTr6dA_fS0+gPiHayG9A@mail.gmail.com
Ответ на
RE: Exit walsender before confirming remote flush in logical replication (Hayato Kuroda (Fujitsu))
Список
Дерево обсуждения
Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Dilip Kumar <dilipbalaut@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Masahiko Sawada <sawada.mshk@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Masahiko Sawada <sawada.mshk@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Masahiko Sawada <sawada.mshk@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Takamichi Osumi (Fujitsu)" <osumi.takamichi@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Peter Smith <smithpb2250@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Vitaly Davydov <v.davydov@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Michael Paquier <michael@paquier.xyz>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Ronan Dunklau <ronan@dunklau.fr>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Ronan Dunklau <ronan@dunklau.fr>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Japin Li <japinli@hotmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Alexander Korotkov <aekorotkov@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Alexander Korotkov <aekorotkov@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Evgeny Voropaev <evgeny.voropaev@tantorlabs.com>
Re: Exit walsender before confirming remote flush in logical replication Alexander Lakhin <exclusion@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Vitaly Davydov <v.davydov@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Alexander Korotkov <aekorotkov@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication "Vitaly Davydov" <v.davydov@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Peter Smith <smithpb2250@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Dilip Kumar <dilipbalaut@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
On Tue, Dec 27, 2022 at 1:44 PM Hayato Kuroda (Fujitsu) wrote: > > Thanks for checking my proposal! > > > - * Note that if we determine that there's still more data to send, this > > - * function will return control to the caller. > > + * Note that if we determine that there's still more data to send or we are in > > + * the physical replication more, this function will return control to the > > + * caller. > > > > I think in this comment you meant to say > > > > 1. "or we are in physical replication mode and all WALs are not yet replicated" > > 2. Typo /replication more/replication mode > > Firstly I considered 2, but I thought 1 seemed to be better. > PSA the updated patch. > I think even for logical replication we should check whether there is any pending WAL (via pq_is_send_pending()) to be sent. Otherwise, what is the point to send the done message? Also, the caller of WalSndDone() already has that check which is another reason why I can't see why you didn't have the same check in function WalSndDone(). BTW, even after fixing this, I think logical replication will behave differently when due to some reason (like time-delayed replication) send buffer gets full and walsender is not able to send data. I think this will be less of an issue with physical replication because there is a separate walreceiver process to flush the WAL which doesn't wait but the same is not true for logical replication. Do you have any thoughts on this matter? -- With Regards, Amit Kapila.
В списке pgsql-hackers по дате отправления
От: Amit Kapila
Дата: