Re: MultiXact\SLRU buffers configuration

Поиск
Список
Период
Сортировка
От Andrey Borodin
Тема Re: MultiXact\SLRU buffers configuration
Дата
Msg-id 494C5E7F-E410-48FA-A93E-F7723D859561@yandex-team.ru
обсуждение исходный текст
Ответ на Re: MultiXact\SLRU buffers configuration  (Thomas Munro <thomas.munro@gmail.com>)
Ответы Re: MultiXact\SLRU buffers configuration
Re: MultiXact\SLRU buffers configuration
Список pgsql-hackers

> 8 апр. 2021 г., в 15:22, Thomas Munro <thomas.munro@gmail.com> написал(а):
>
> On Thu, Apr 8, 2021 at 7:24 PM Andrey Borodin <x4mmm@yandex-team.ru> wrote:
>> I agree that this version of eviction seems much more effective and less intrusive than RR. And it's still LRU,
whichis important for subsystem that is called SLRU. 
>> shared->search_slotno is initialized implicitly with memset(). But this seems like a common practice.
>> Also comment above "max_search = Min(shared->num_slots, MAX_REPLACEMENT_SEARCH);" does not reflect changes.
>>
>> Besides this patch looks good to me.
>
> Thanks!  I chickened out of committing a buffer replacement algorithm
> patch written 11 hours before the feature freeze, but I also didn't
> really want to commit the GUC patch without that.  Ahh, if only we'd
> latched onto the real problems here just a little sooner, but there is
> always PostgreSQL 15, I heard it's going to be amazing.  Moved to next
> CF.

I have one more idea inspired by CPU caches.
Let's make SLRU n-associative, where n ~ 8.
We can divide buffers into "banks", number of banks must be power of 2.
All banks are of equal size. We choose bank size to approximately satisfy user's configured buffer size.
Each page can live only within one bank. We use same search and eviction algorithms as we used in SLRU, but we only
needto search\evict over 8 elements. 
All SLRU data of a single bank will be colocated within at most 2 cache line.

I did not come up with idea how to avoid multiplication of bank_number * bank_size in case when user configured 31337
buffers(any number that is radically not a power of 2). 

PFA patch implementing this idea.

Best regards, Andrey Borodin.



Вложения

В списке pgsql-hackers по дате отправления:

Предыдущее
От: Peter Geoghegan
Дата:
Сообщение: Re: PANIC: wrong buffer passed to visibilitymap_clear
Следующее
От: Ranier Vilela
Дата:
Сообщение: Uninitialized scalar variable (UNINIT) (src/backend/statistics/extended_stats.c)