Re: checkpointer continuous flushing - V16
От
Fabien COELHO
Тема
Re: checkpointer continuous flushing - V16
Дата
Msg-id
alpine.DEB.2.10.1602191554320.3927@sto
Ответ на
Re: checkpointer continuous flushing - V16 (Andres Freund)
Список
Дерево обсуждения
checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Tom Lane <tgl@sss.pgh.pa.us>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Peter Geoghegan <pg@heroku.com>
Re: checkpointer continuous flushing - V18 Jeff Janes <jeff.janes@gmail.com>
Re: checkpointer continuous flushing - V18 Peter Geoghegan <pg@heroku.com>
Re: checkpointer continuous flushing - V18 Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Patric Bechtel <patric.bechtel@gmail.com>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Michael Paquier <michael.paquier@gmail.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Cédric Villemain <cedric@2ndQuadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Heikki Linnakangas <hlinnaka@iki.fi>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Michael Paquier <michael.paquier@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <fabien.coelho@mines-paristech.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Hello.
> Based on these results I think 32 will be a good default for
> checkpoint_flush_after? There's a few cases where 64 showed to be
> beneficial, and some where 32 is better. I've seen 64 perform a bit
> better in some cases here, but the differences were not too big.
Yes, these many runs show that 32 is basically as good or better than 64.
I'll do some runs with 16/48 to have some more data.
> I gather that you didn't play with
> backend_flush_after/bgwriter_flush_after, i.e. you left them at their
> default values? Especially backend_flush_after can have a significant
> positive and negative performance impact.
Indeed, non reported configuration options have their default values.
There were also minor changes in the default options for logging (prefix,
checkpoint, ...), but nothing significant, and always the same for all
runs.
>> [...] Ubuntu 12.04 LTS (precise)
>
> That's with 12.04's standard kernel?
Yes.
>> checkpoint_flush_after = { none, 0, 32, 64 }
>
> Did you re-initdb between the runs?
Yes, all runs are from scratch (initdb, pgbench -i, some warmup...).
> I've seen massively varying performance differences due to autovacuum
> triggered analyzes. It's not completely deterministic when those run,
> and on bigger scale clusters analyze can take ages, while holding a
> snapshot.
Yes, I agree that probably the performance changes on long vs short runs
(andres00c vs andres00b) is due to autovacuum.
--
Fabien.
В списке pgsql-hackers по дате отправления