Re: [HACKERS] GUC for cleanup indexes threshold.

Поиск
Список
Период
Сортировка
Искать
От
Peter Geoghegan
Тема
Re: [HACKERS] GUC for cleanup indexes threshold.
Дата
Msg-id
CAH2-Wzk0VOiPUOhw6Ha7yk78TOmu892Aw0eausoL048Zfq1cYQ@mail.gmail.com
Ответ на
Список
Дерево обсуждения
[HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kuntal Ghosh <kuntalghosh.2007@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. "Ideriha, Takeshi" <ideriha.takeshi@jp.fujitsu.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Simon Riggs <simon@2ndquadrant.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Simon Riggs <simon@2ndquadrant.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Simon Riggs <simon@2ndquadrant.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. David Steele <david@pgmasters.net>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. David Steele <david@pgmasters.net>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: GUC for cleanup indexes threshold. David Steele <david@pgmasters.net>
Re: GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: GUC for cleanup indexes threshold. David Steele <david@pgmasters.net>
Re: GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: GUC for cleanup indexes threshold. Andres Freund <andres@anarazel.de>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Sokolov Yura <y.sokolov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Darafei Praliaskouski <me@komzpa.net>
Re: [HACKERS] GUC for cleanup indexes threshold. Pavel Golub <pavel@microolap.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Sokolov Yura <y.sokolov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Simon Riggs <simon@2ndquadrant.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Darafei "Komяpa" Praliaskouski <me@komzpa.net>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Darafei "Komяpa" Praliaskouski <me@komzpa.net>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Claudio Freire <klaussfreire@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Teodor Sigaev <teodor@sigaev.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Teodor Sigaev <teodor@sigaev.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Masahiko Sawada <sawada.mshk@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] GUC for cleanup indexes threshold. Claudio Freire <klaussfreire@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Claudio Freire <klaussfreire@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Kyotaro HORIGUCHI <horiguchi.kyotaro@lab.ntt.co.jp>
Re: [HACKERS] GUC for cleanup indexes threshold. Claudio Freire <klaussfreire@gmail.com>
Re: [HACKERS] GUC for cleanup indexes threshold. Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] GUC for cleanup indexes threshold. Kuntal Ghosh <kuntalghosh.2007@gmail.com>
On Fri, Mar 3, 2017 at 6:58 PM, Amit Kapila  wrote:
> You are right that we don't want the number of unclaimed-by-FSM
> recyclable pages to grow forever, but I think that won't happen with
> this patch.  As soon as there are more deletions (in heap), in the
> next vacuum cycle, the pages will be reclaimed by lazy_vacuum_index().

Right.

>> (Thinks about it some more...)
>>
>> Unfortunately, I just saw a whole new problem with this patch:
>> _bt_page_recyclable() is the one place in the B-Tree AM where we stash
>> an XID.
>>
>
> Can you be more specific to tell which code exactly you are referring here?

I meant that we stash an XID when a B-Tree page is deleted, used to
determine when it's finally safe to to recycle the page by comparing
it to RecentGlobalXmin (recyling will happen during the next VACUUM).
We can't immediately recycle a page, because an existing index scan
might land on the page while following a stale pointer.

_bt_page_recyclable(), which checks if recycling is safe (no possible
index scan can land of dead page), is a pretty small function. I'm
concerned about what happens when
pg_class.relfrozenxid/pg_database.datfrozenxid are advanced past
opaque->btpo.xact. While I can't see this explained anywhere, I'm
pretty sure that that's supposed to be impossible, which this patch
changes.

-- 
Peter Geoghegan


В списке pgsql-hackers по дате отправления
От: Peter Eisentraut
Дата:
От: Tomas Vondra
Дата:
FAQ