Re: O(n) tasks cause lengthy startups and checkpoints

Поиск
Список
Период
Сортировка
Искать
От
Nathan Bossart
Тема
Re: O(n) tasks cause lengthy startups and checkpoints
Дата
Msg-id
20220811230921.GA1707962@nathanxps13
Ответ на
Список
Дерево обсуждения
O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Euler Taveira" <euler@eulerto.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints SATYANARAYANA NARLAPURAM <satyanarlapuram@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bruce Momjian <bruce@momjian.us>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Amul Sul <sulamul@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Maxim Orlov <orlovmg@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Tom Lane <tgl@sss.pgh.pa.us>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Tom Lane <tgl@sss.pgh.pa.us>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Daniel Gustafsson <daniel@yesql.se>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Tom Lane <tgl@sss.pgh.pa.us>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
On Wed, Jul 06, 2022 at 09:51:10AM -0700, Nathan Bossart wrote:
> Here's a new revision where I've attempted to address all the feedback I've
> received thus far.  Notably, the custodian now uses a queue for registering
> tasks and determining which tasks to execute.  Other changes include
> splitting the temporary file functions apart to avoid consecutive boolean
> flags, using a timestamp instead of an integer for the staging name for
> temporary directories, moving temporary directories to a dedicated
> directory so that the custodian doesn't need to scan relation files,
> ERROR-ing when something goes wrong when cleaning up temporary files,
> executing requested tasks immediately in single-user mode, and more.

Here is a rebased patch set for cfbot.  There are no other differences
between v7 and v8.

-- 
Nathan Bossart
Amazon Web Services: https://aws.amazon.com
В списке pgsql-hackers по дате отправления
От: Nathan Bossart
Дата:
От: Melanie Plageman
Дата:
FAQ