Re: slow commits with heavy temp table usage in 8.4.0

Поиск
Список
Период
Сортировка
От Todd A. Cook
Тема Re: slow commits with heavy temp table usage in 8.4.0
Дата
Msg-id 4A7B13BC.6020606@blackducksoftware.com
обсуждение исходный текст
Ответ на Re: slow commits with heavy temp table usage in 8.4.0  (Tom Lane <tgl@sss.pgh.pa.us>)
Ответы Re: slow commits with heavy temp table usage in 8.4.0  (Alex Hunsaker <badalex@gmail.com>)
Список pgsql-hackers
Tom Lane wrote:
>
> I took a look through the CVS history and verified that there were
> no post-8.4 commits that looked like they'd affect performance in
> this area.  So I think it's got to be a platform difference not a
> PG version difference.  In particular I think we are probably looking
> at a filesystem issue: how fast can you delete [...] 30000 files.

I'm still on Fedora 7, so maybe this will be motivation to upgrade.

FYI, on my 8.2.13 system, the test created 30001 files which were all
deleted during the commit.  On my 8.4.0 system, the test created 60001
files, of which 30000 were deleted at commit and 30001 disappeared
later (presumably during a checkpoint?).


> But I'm not sure
> if the use-case is popular enough to deserve such a hack.

FWIW, the full app was looping over a set of datasets.  On each iteration,
it computed some intermediate results into a temp table, generated several
reports from those intermediate results, and finally truncated the table
for the next iteration.

-- todd


В списке pgsql-hackers по дате отправления:

Предыдущее
От: "Kevin Grittner"
Дата:
Сообщение: Re: the case for machine-readable error fields
Следующее
От: "Todd A. Cook"
Дата:
Сообщение: Re: slow commits with heavy temp table usage in 8.4.0