Re: O(n) tasks cause lengthy startups and checkpoints
От
Nathan Bossart
Тема
Re: O(n) tasks cause lengthy startups and checkpoints
Дата
Msg-id
20220811230921.GA1707962@nathanxps13
Ответ на
Re: O(n) tasks cause lengthy startups and checkpoints (Nathan Bossart)
Список
Дерево обсуждения
O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Euler Taveira" <euler@eulerto.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints SATYANARAYANA NARLAPURAM <satyanarlapuram@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bruce Momjian <bruce@momjian.us>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Amul Sul <sulamul@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Maxim Orlov <orlovmg@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints "Bossart, Nathan" <bossartn@amazon.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Robert Haas <robertmhaas@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Bharath Rupireddy <bharath.rupireddyforpostgres@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Tom Lane <tgl@sss.pgh.pa.us>
Re: O(n) tasks cause lengthy startups and checkpoints Andres Freund <andres@anarazel.de>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Tom Lane <tgl@sss.pgh.pa.us>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Daniel Gustafsson <daniel@yesql.se>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Tom Lane <tgl@sss.pgh.pa.us>
Re: O(n) tasks cause lengthy startups and checkpoints Nathan Bossart <nathandbossart@gmail.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
Re: O(n) tasks cause lengthy startups and checkpoints Simon Riggs <simon.riggs@enterprisedb.com>
On Wed, Jul 06, 2022 at 09:51:10AM -0700, Nathan Bossart wrote: > Here's a new revision where I've attempted to address all the feedback I've > received thus far. Notably, the custodian now uses a queue for registering > tasks and determining which tasks to execute. Other changes include > splitting the temporary file functions apart to avoid consecutive boolean > flags, using a timestamp instead of an integer for the staging name for > temporary directories, moving temporary directories to a dedicated > directory so that the custodian doesn't need to scan relation files, > ERROR-ing when something goes wrong when cleaning up temporary files, > executing requested tasks immediately in single-user mode, and more. Here is a rebased patch set for cfbot. There are no other differences between v7 and v8. -- Nathan Bossart Amazon Web Services: https://aws.amazon.com
В списке pgsql-hackers по дате отправления
От: Nathan Bossart
Дата:
От: Melanie Plageman
Дата: