PATCH: optimized DROP of multiple tables within a transaction

Поиск
Список
Период
Сортировка
Искать
От
Tomas Vondra
Тема
PATCH: optimized DROP of multiple tables within a transaction
Дата
Msg-id
503801F2.7070907@fuzzy.cz
Список
Дерево обсуждения
PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tom Lane <tgl@sss.pgh.pa.us>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Craig Ringer <craig@2ndQuadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Shigeru HANADA <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Shigeru Hanada <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Andres Freund <andres@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Andres Freund <andres@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Andres Freund <andres@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Andres Freund <andres@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Robert Haas <robertmhaas@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Robert Haas <robertmhaas@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Shigeru Hanada <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Shigeru Hanada <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Alvaro Herrera <alvherre@2ndquadrant.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Tomas Vondra <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Shigeru Hanada <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Shigeru Hanada <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction 花田 茂 <shigeru.hanada@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction Robert Haas <robertmhaas@gmail.com>
Re: PATCH: optimized DROP of multiple tables within a transaction "Tomas Vondra" <tv@fuzzy.cz>
Re: PATCH: optimized DROP of multiple tables within a transaction Robert Haas <robertmhaas@gmail.com>
Hi,

attached is a patch that improves performance when dropping multiple
tables within a transaction. Instead of scanning the shared buffers for
each table separately, the patch removes this and evicts all the tables
in a single pass through shared buffers.

Our system creates a lot of "working tables" (even 100.000) and we need
to perform garbage collection (dropping obsolete tables) regularly. This
often took ~ 1 hour, because we're using big AWS instances with lots of
RAM (which tends to be slower than RAM on bare hw). After applying this
patch and dropping tables in groups of 100, the gc runs in less than 4
minutes (i.e. a 15x speed-up).

This is not likely to improve usual performance, but for systems like
ours, this patch is a significant improvement.

kind regards
Tomas
В списке pgsql-hackers по дате отправления
От: Andres Freund
Дата:
От: Robert Haas
Дата:
FAQ