RE: Disable WAL logging to speed up data loading
От
osumi.takamichi@fujitsu.com
Тема
RE: Disable WAL logging to speed up data loading
Дата
Msg-id
OSBPR01MB48885361D758639102DCED7BED170@OSBPR01MB4888.jpnprd01.prod.outlook.com
Ответ на
Re: Disable WAL logging to speed up data loading (Laurenz Albe)
Список
Дерево обсуждения
Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Amul Sul <sulamul@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Fujii Masao <masao.fujii@oss.nttdata.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Fujii Masao <masao.fujii@oss.nttdata.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Disable WAL logging to speed up data loading Fujii Masao <masao.fujii@oss.nttdata.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
Re: Disable WAL logging to speed up data loading Fujii Masao <masao.fujii@oss.nttdata.com>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
Re: Disable WAL logging to speed up data loading Fujii Masao <masao.fujii@oss.nttdata.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <masahiko.sawada@2ndquadrant.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Robert Haas <robertmhaas@gmail.com>
Re: Disable WAL logging to speed up data loading Magnus Hagander <magnus@hagander.net>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading "David G. Johnston" <david.g.johnston@gmail.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading "David G. Johnston" <david.g.johnston@gmail.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <sawada.mshk@gmail.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <sawada.mshk@gmail.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <sawada.mshk@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <sawada.mshk@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <sawada.mshk@gmail.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Robert Haas <robertmhaas@gmail.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Disable WAL logging to speed up data loading Masahiko Sawada <sawada.mshk@gmail.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
Re: Disable WAL logging to speed up data loading movead li <lchch1990@sina.cn>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Kyotaro Horiguchi <horikyota.ntt@gmail.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading David Steele <david@pgmasters.net>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading vignesh C <vignesh21@gmail.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Michael Paquier <michael@paquier.xyz>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
Re: Disable WAL logging to speed up data loading Stephen Frost <sfrost@snowman.net>
Re: Disable WAL logging to speed up data loading Laurenz Albe <laurenz.albe@cybertec.at>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Michael Paquier <michael@paquier.xyz>
Re: Disable WAL logging to speed up data loading Simon Riggs <simon@2ndquadrant.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: Disable WAL logging to speed up data loading Michael Paquier <michael@paquier.xyz>
Re: Disable WAL logging to speed up data loading Simon Riggs <simon@2ndquadrant.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "osumi.takamichi@fujitsu.com" <osumi.takamichi@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: Disable WAL logging to speed up data loading "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Hi, Laurenz > > I wrote and attached the first patch to disable WAL logging. > > This patch passes the regression test of check-world already and is > > formatted by pgindent. > > Without reading the code, I have my doubts about that feature. > > While it clearly will improve performance, it opens the door to data loss. Therefore, this feature must avoid that that kind of inconsistent server starts up again. This has been discussed in this thread already. > People will use it to speed up their data loads and then be unhappy if they > cannot use their backups to recover from a problem. > > What happens if you try to do archive recovery across a time where wal_level > was "none"? Will the recovery process fail, as it should, or will you end up > with data corruption? > > We already have a performance-related footgun in the shape of fsync = off. > Do we want to add another one? Further, in this thread, we discuss that this feature is intended to serve under some specific opportunities like DBA wants to load data as soon as possible and/or the operation itself is easily *repeatable*. So, before and after the change of wal_level, DBA needs to take a full backup to prepare the unexpected crash. But anyway, I'll fix and enrich the documents. Thanks. Best, Takamichi Osumi
В списке pgsql-hackers по дате отправления
От: Masahiko Sawada
Дата: