Re: FYI: Load times for a largish DB in 8.2 vs. 8.3 vs. 8.4

Поиск
Список
Период
Сортировка
От Todd A. Cook
Тема Re: FYI: Load times for a largish DB in 8.2 vs. 8.3 vs. 8.4
Дата
Msg-id 4A3BFBFF.1050908@blackducksoftware.com
обсуждение исходный текст
Ответ на Re: FYI: Load times for a largish DB in 8.2 vs. 8.3 vs. 8.4  (Tom Lane <tgl@sss.pgh.pa.us>)
Ответы Re: FYI: Load times for a largish DB in 8.2 vs. 8.3 vs. 8.4  ("Todd A. Cook" <tcook@blackducksoftware.com>)
Список pgsql-general
Tom Lane wrote:
> "Todd A. Cook" <tcook@blackducksoftware.com> writes:
>> First, the numbers:
>
>>   PG Version    Load time     pg_database_size     autovac
>> ----------------------------------------------------------
>>    8.2.13        179 min       92,807,992,820        on
>>    8.3.7         180 min       84,048,744,044        on (defaults)
>>    8.4b2         206 min       84,028,995,344        on (defaults)
>>    8.4b2         183 min       84,028,839,696        off
>
>> The bulk of the data is in 16 tables, each having about 55 million rows of
>> the form (int, int, smallint, smallint, int, int, int).  Each table has a
>> single partial index on one of the integer columns.
>
> Given that it's multiple tables, it'd be possible for autovacuum to
> kick in and ANALYZE the data inserted into earlier tables while the
> later ones were still being loaded.  If so, the discrepancy might be
> explained by 8.4's more-aggressive statistics target, which means that
> a background ANALYZE will take about 10x more work than before.
>
> If you have time to repeat the experiments, it would be interesting to
> see what happens with consistent default_statistics_target across 8.3
> and 8.4.

That would seem to be it:

      8.4b2          183 min      84,028,897,040         on (defaults, default_statistics_target=10)

I'll run the test on 8.3.7 with default_statistics_target=100 over the weekend.

-- todd


>
>             regards, tom lane
> .
>


В списке pgsql-general по дате отправления:

Предыдущее
От: Miguel Miranda
Дата:
Сообщение: Disaster recovery (server died)
Следующее
От: Alan Hodgson
Дата:
Сообщение: Re: Disaster recovery (server died)