RE: Exit walsender before confirming remote flush in logical replication

Поиск
Список
Период
Сортировка
Искать
От
Hayato Kuroda (Fujitsu)
Тема
RE: Exit walsender before confirming remote flush in logical replication
Дата
Msg-id
TYAPR01MB586683FC450662990E356A0EF5D99@TYAPR01MB5866.jpnprd01.prod.outlook.com
Ответ на
Список
Дерево обсуждения
Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Dilip Kumar <dilipbalaut@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Masahiko Sawada <sawada.mshk@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Masahiko Sawada <sawada.mshk@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Masahiko Sawada <sawada.mshk@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Takamichi Osumi (Fujitsu)" <osumi.takamichi@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Peter Smith <smithpb2250@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Vitaly Davydov <v.davydov@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Michael Paquier <michael@paquier.xyz>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Ronan Dunklau <ronan@dunklau.fr>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Ronan Dunklau <ronan@dunklau.fr>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Japin Li <japinli@hotmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Alexander Korotkov <aekorotkov@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Alexander Korotkov <aekorotkov@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Evgeny Voropaev <evgeny.voropaev@tantorlabs.com>
Re: Exit walsender before confirming remote flush in logical replication Alexander Lakhin <exclusion@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Chao Li <li.evan.chao@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Vitaly Davydov <v.davydov@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Alexander Korotkov <aekorotkov@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Fujii Masao <masao.fujii@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Andrey Silitskiy <a.silitskiy@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Andres Freund <andres@anarazel.de>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Greg Sabino Mullane <htamfids@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication "Vitaly Davydov" <v.davydov@postgrespro.ru>
Re: Exit walsender before confirming remote flush in logical replication Peter Smith <smithpb2250@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Dilip Kumar <dilipbalaut@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Re: Exit walsender before confirming remote flush in logical replication Amit Kapila <amit.kapila16@gmail.com>
Re: Exit walsender before confirming remote flush in logical replication Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Exit walsender before confirming remote flush in logical replication "Hayato Kuroda (Fujitsu)" <kuroda.hayato@fujitsu.com>
Dear Osumi-san,

Thank you for reviewing! PSA new version.

> (1)
> 
> +          Decides the condition for exiting the walsender process.
> +          'wait_flush', which is the default, the walsender
> +          will wait for all the sent WALs to be flushed on the subscriber side,
> +          before exiting the process. 'immediate' will exit
> +          without confirming the remote flush. This may break the consistency
> +          between publisher and subscriber, but it may be useful for a system
> +          that has a high-latency network to reduce the amount of time for
> +          shutdown.
>
> (1-1)
> 
> The first part "exiting the walsender process" can be improved.
> Probably, you can say "the exiting walsender process" or
> "Decides the behavior of the walsender process at shutdown" instread.

Fixed. Second idea was chosen.

> (1-2)
> 
> Also, the next sentence can be improved something like
> "If the shutdown mode is wait_flush, which is the default, the
> walsender waits for all the sent WALs to be flushed on the subscriber side.
> If it is immediate, the walsender exits without confirming the remote flush".

Fixed.

> (1-3)
> 
> We don't need to wrap wait_flush and immediate by single quotes
> within the literal tag.

This style was ported from the SNAPSHOT options part, so I decided to keep.


> (2)
> 
> +               /* minapplydelay affects SHUTDOWN_MODE option */
> 
> I think we can move this comment to just above the 'if' condition
> and combine it with the existing 'if' conditions comments.

Moved and added some comments.

> (3) 001_rep_changes.pl
> 
> (3-1) Question
> 
> In general, do we add this kind of check when we extend the protocol
> (STREAM_REPLICATION command)
> or add a new condition for apply worker exit ?
> In case when we would like to know the restart of the walsender process in TAP
> tests,
> then could you tell me why the new test code matches the purpose of this patch ?

The replication command is not for normal user, so I think we don't have to test itself.

The check that waits to restart the apply worker was added to improve the robustness.
I think there is a possibility to fail the test when the apply worker recevies a transaction
before it checks new subscription option. Now the failure can be avoided by
confriming to reload pg_subscription and restart.

> (3-2)
> 
> +  "Timed out while waiting for apply to restart after changing min_apply_delay
> to non-zero value";
> 
> Probably, we can partly change this sentence like below, because we check
> walsender's pid.
> FROM: "... while waiting for apply to restart..."
> TO:   "... while waiting for the walsender to restart..."

Right, fixed.

Best Regards,
Hayato Kuroda
FUJITSU LIMITED

В списке pgsql-hackers по дате отправления
От: Aleksander Alekseev
Дата:
От: Hayato Kuroda (Fujitsu)
Дата:
FAQ