Re: checkpointer continuous flushing - V18

Поиск
Список
Период
Сортировка
Искать
От
Fabien COELHO
Тема
Re: checkpointer continuous flushing - V18
Дата
Msg-id
alpine.DEB.2.10.1602212250560.3927@sto
Ответ на
Список
Дерево обсуждения
checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Tom Lane <tgl@sss.pgh.pa.us>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Robert Haas <robertmhaas@gmail.com>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Peter Geoghegan <pg@heroku.com>
Re: checkpointer continuous flushing - V18 Jeff Janes <jeff.janes@gmail.com>
Re: checkpointer continuous flushing - V18 Peter Geoghegan <pg@heroku.com>
Re: checkpointer continuous flushing - V18 Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V18 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V18 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Patric Bechtel <patric.bechtel@gmail.com>
Re: checkpointer continuous flushing - V16 Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing - V16 Michael Paquier <michael.paquier@gmail.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Cédric Villemain <cedric@2ndQuadrant.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Heikki Linnakangas <hlinnaka@iki.fi>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Michael Paquier <michael.paquier@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <fabien.coelho@mines-paristech.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Andres Freund <andres@anarazel.de>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>
Re: checkpointer continuous flushing Amit Kapila <amit.kapila16@gmail.com>
Re: checkpointer continuous flushing Fabien COELHO <coelho@cri.ensmp.fr>

>> ISTM that "progress" and "progress_slice" only depend on num_scanned and
>> per-tablespace num_to_scan and total num_to_scan, so they are somehow
>> redundant and the progress could be recomputed from the initial figures
>> when needed.
>
> They don't cause much space usage, and we access the values frequently. 
> So why not store them?

The same question would work the other way around: these values are one 
division away, why not compute them when needed? No big deal.

> [...] Given realistic amounts of memory the max potential "skew" seems 
> fairly small with float8. If we ever flush one buffer "too much" for a 
> tablespace it's pretty much harmless.

I do agree. I'm suggesting that a comment should be added to justify why 
float8 accuracy is okay.

>> I see a binary_heap_allocate but no corresponding deallocation, this
>> looks like a memory leak... or is there some magic involved?
>
> Hm. I think we really should use a memory context for all of this - we
> could after all error out somewhere in the middle...

I'm not sure that a memory context is justified here, there are only two 
mallocs and the checkpointer works for very long times. I think that it is 
simpler to just get the malloc/free right.

> [...] I'm not arguing for ripping it out, what I mean is that we don't 
> set a nondefault value for the GUCs on platforms with just 
> posix_fadivise available...

Ok with that.

-- 
Fabien.


В списке pgsql-hackers по дате отправления
От: Tom Lane
Дата:
От: Stephen Frost
Дата:
FAQ