Re: Speed up transaction completion faster after many relations areaccessed in a transaction

Поиск
Список
Период
Сортировка
Искать
От
Tomas Vondra
Тема
Re: Speed up transaction completion faster after many relations areaccessed in a transaction
Дата
Msg-id
20190815223059.fkjsi3oywa4a2jtk@development
Ответ на
Список
Дерево обсуждения
Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Simon Riggs <simon@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Imai, Yoshikazu" <imai.yoshikazu@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction 'Andres Freund' <andres@anarazel.de>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Thomas Munro <thomas.munro@gmail.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Michael Paquier <michael@paquier.xyz>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Yura Sokolov <y.sokolov@postgrespro.ru>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Michael Paquier <michael@paquier.xyz>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Michael Paquier <michael@paquier.xyz>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Zhihong Yu <zyu@yugabyte.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Yura Sokolov <y.sokolov@postgrespro.ru>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Jacob Champion <jchampion@timescale.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Ankit Kumar Pandey <itsankitkp@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction vignesh C <vignesh21@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Amit Langote <amitlangote09@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Heikki Linnakangas <hlinnaka@iki.fi>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Heikki Linnakangas <hlinnaka@iki.fi>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Heikki Linnakangas <hlinnaka@iki.fi>
Re: Speed up transaction completion faster after many relations are accessed in a transaction vignesh C <vignesh21@gmail.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Heikki Linnakangas <hlinnaka@iki.fi>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Heikki Linnakangas <hlinnaka@iki.fi>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations are accessed in a transaction Zhihong Yu <zyu@yugabyte.com>
Re: Speed up transaction completion faster after many relations are accessed in a transaction David Rowley <dgrowleyml@gmail.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Andres Freund <andres@anarazel.de>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Imai, Yoshikazu" <imai.yoshikazu@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Imai, Yoshikazu" <imai.yoshikazu@jp.fujitsu.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction David Rowley <david.rowley@2ndquadrant.com>
Re: Speed up transaction completion faster after many relations areaccessed in a transaction Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: Speed up transaction completion faster after many relations areaccessed in a transaction "Tsunakawa, Takayuki" <tsunakawa.takay@jp.fujitsu.com>
On Wed, Aug 14, 2019 at 07:25:10PM +1200, David Rowley wrote:
>On Thu, 25 Jul 2019 at 05:49, Tom Lane  wrote:
>> On the whole, I don't especially like this approach, because of the
>> confusion between peak lock count and end-of-xact lock count.  That
>> seems way too likely to cause problems.
>
>Thanks for having a look at this.  I've not addressed the points
>you've mentioned due to what you mention above.  The only way I can
>think of so far to resolve that would be to add something to track
>peak lock usage.  The best I can think of to do that, short of adding
>something to dynahash.c is to check how many locks are held each time
>we obtain a lock, then if that count is higher than the previous time
>we checked, then update the maximum locks held, (probably a global
>variable).   That seems pretty horrible to me and adds overhead each
>time we obtain a lock, which is a pretty performance-critical path.
>

Would it really be a measurable overhead? I mean, we only really need
one int counter, and you don't need to do the check on every lock
acquisition - you just need to recheck on the first lock release. But
maybe I'm underestimating how expensive it is ...

Talking about dynahash - doesn't it already track this information?
Maybe not directly but surely it has to track the number of entries in
the hash table, in order to compute fill factor. Can't we piggy-back on
that and track the highest fill-factor for a particular period of time?


regards

-- 
Tomas Vondra                  http://www.2ndQuadrant.com
PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services 


В списке pgsql-hackers по дате отправления
От: Tomas Vondra
Дата:
Сообщение: Re: Extension development
От: Tomas Vondra
Дата:
FAQ