Re: checkpointer continuous flushing - V18

Поиск
Список
Период
Сортировка
Искать
От
Fabien COELHO
Тема
Re: checkpointer continuous flushing - V18
Дата
Msg-id
alpine.DEB.2.10.1603080826300.16765@sto
Ответ на
Список
Дерево обсуждения
checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Tom Lane <tgl@sss.pgh.pa.us>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Peter Geoghegan <pg@heroku.com>
Re: checkpointer continuous flushing - V18 Jeff Janes <jeff.janes@gmail.com>
Re: checkpointer continuous flushing - V18 Peter Geoghegan <pg@heroku.com>
Re: checkpointer continuous flushing - V18 Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Patric Bechtel <patric.bechtel@gmail.com>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Michael Paquier <michael.paquier@gmail.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Cédric Villemain <cedric@2ndQuadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Heikki Linnakangas <hlinnaka@iki.fi>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Michael Paquier <michael.paquier@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <fabien.coelho@mines-paristech.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>

Hello Andres,

>> Now I cannot see how having one context per table space would have a
>> significant negative performance impact.
>
> The 'dirty data' etc. limits are global, not per block device. By having
> several contexts with unflushed dirty data the total amount of dirty
> data in the kernel increases.

Possibly, but how much?  Do you have experimental data to back up that 
this is really an issue?

We are talking about 32 (context size) * #table spaces * 8KB buffers = 4MB 
of dirty buffers to manage for 16 table spaces, I do not see that as a 
major issue for the kernel.

> Thus you're more likely to see stalls by the kernel moving pages into 
> writeback.

I do not see the above data having a 30% negative impact on tps, given the 
quite small amount of data under discussion, and switching to random IOs 
cost so much that it must really be avoided.

Without further experimental data, I still think that the one context per 
table space is the reasonnable choice.

-- 
Fabien.


В списке pgsql-hackers по дате отправления
От: Andres Freund
Дата:
От: Amit Langote
Дата:
FAQ