Re: logical decoding : exceeded maxAllocatedDescs for .spill files

Поиск
Список
Период
Сортировка
Искать
От
Kuntal Ghosh
Тема
Re: logical decoding : exceeded maxAllocatedDescs for .spill files
Дата
Msg-id
CAGz5QCKagX62Lu6_jqFc8ePUCWhcngtKBfuXRxr26uZ9vEzWbg@mail.gmail.com
Ответ на
Список
Дерево обсуждения
logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Alvaro Herrera from 2ndQuadrant <alvherre@alvh.no-ip.org>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Alvaro Herrera <alvherre@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Robert Haas <robertmhaas@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Robert Haas <robertmhaas@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Thomas Munro <thomas.munro@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Juan José Santamaría Flecha <juanjo.santamaria@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Thomas Munro <thomas.munro@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Thomas Munro <thomas.munro@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Thomas Munro <thomas.munro@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Thomas Munro <thomas.munro@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Thomas Munro <thomas.munro@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Juan José Santamaría Flecha <juanjo.santamaria@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Alvaro Herrera <alvherre@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Juan José Santamaría Flecha <juanjo.santamaria@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Juan José Santamaría Flecha <juanjo.santamaria@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Noah Misch <noah@leadboat.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Noah Misch <noah@leadboat.com>
TestLib condition for deleting temporary directories Noah Misch <noah@leadboat.com>
Re: TestLib condition for deleting temporary directories Daniel Gustafsson <daniel@yesql.se>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Noah Misch <noah@leadboat.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Alvaro Herrera <alvherre@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Alvaro Herrera <alvherre@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Kuntal Ghosh <kuntalghosh.2007@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Kuntal Ghosh <kuntalghosh.2007@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Kuntal Ghosh <kuntalghosh.2007@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Andres Freund <andres@anarazel.de>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Kuntal Ghosh <kuntalghosh.2007@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Tom Lane <tgl@sss.pgh.pa.us>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Kapila <amit.kapila16@gmail.com>
Re: logical decoding : exceeded maxAllocatedDescs for .spill files Amit Khandekar <amitdkhan.pg@gmail.com>
On Tue, Feb 4, 2020 at 2:40 PM Amit Kapila  wrote:
>
> I don't think we can just back-patch that part of code as it is linked
> to the way we are maintaining a cache (~8MB) for frequently allocated
> objects.  See the comments around the definition of
> max_cached_tuplebufs.  But probably, we can do something once we reach
> such a limit, basically, once we know that we have already allocated
> max_cached_tuplebufs number of tuples of size MaxHeapTupleSize, we
> don't need to allocate more of that size.  Does this make sense?
>

Yeah, this makes sense. I've attached a patch that implements the
same. It solves the problem reported earlier. This solution will at
least slow down the process of going OOM even for very small sized
tuples.



-- 
Thanks & Regards,
Kuntal Ghosh
EnterpriseDB: http://www.enterprisedb.com
В списке pgsql-hackers по дате отправления
От: Masahiko Sawada
Дата:
От: Etsuro Fujita
Дата:
FAQ