Small computeRegionDelta optimization.

Поиск
Список
Период
Сортировка
От Konstantin Knizhnik
Тема Small computeRegionDelta optimization.
Дата
Msg-id 400939f2-e021-b6a6-ca66-ac0a06ad4284@postgrespro.ru
обсуждение исходный текст
Список pgsql-hackers
Hi hackers,

Playing with my undo-log storage, I found out that its performance is 
mostly limited by generic WAL record mechanism,
and particularly by computeRegionDelta function which  computes page 
delta for each logged operation.

I noticed that computeRegionDelta also becomes bottleneck in other cases 
where generic WAL records are used, for example in RUM extension.
This is profile of inserting records in table with RUM index:

32.99%  postgres  postgres            [.] computeRegionDelta
    6.13%  postgres  rum.so              [.] updateItemIndexes
    4.61%  postgres  postgres            [.] hash_search_with_hash_value
    4.53%  postgres  postgres            [.] GenericXLogRegisterBuffer
    3.74%  postgres  rum.so              [.] rumTraverseLock
    3.33%  postgres  rum.so              [.] rumtuple_get_attrnum
    3.24%  postgres  rum.so              [.] dataPlaceToPage
    3.14%  postgres  postgres            [.] writeFragment
    2.99%  postgres  libc-2.23.so        [.] __memcpy_avx_unaligned
    2.81%  postgres  postgres            [.] nocache_index_getattr
    2.72%  postgres  rum.so              [.] rumPlaceToDataPageLeaf
    1.93%  postgres  postgres            [.] pg_comp_crc32c_sse42
    1.87%  postgres  rum.so              [.] findInLeafPage
    1.77%  postgres  postgres            [.] PinBuffer
    1.52%  postgres  rum.so              [.] compareRumItem
    1.49%  postgres  postgres            [.] FunctionCall2Coll
    1.34%  postgres  rum.so              [.] entryLocateEntry
    1.22%  postgres  libc-2.23.so        [.] __memcmp_sse4_1
    0.97%  postgres  postgres            [.] LWLockAttemptLock


I noticed that computeRegionDelta performs byte-by-byte comparison of page.
The obvious optimization is to compare words instead of bytes.
Small patch with such optimization is attached.
Definitely it may lead to small increase of produced deltas.
It is possible to calculate deltas more precisely: using work comparison 
for raw  location of region and then locate precise boundaries using bye 
comparisons.
But it complicates algorithm and so makes it slower/
In practice, taken in account that header of record in Postgres is 24 
bytes long and fields are usually aligned on 4/8 bytes boundary,
I think that calculating deltas in words is preferable.

Results of such optimization:
Performance of my UNDAM storage is increased from 6500 TPS to 7000 TPS 
(vs. 8500 for unlogged table),
and computeRegionDelta completely disappears from  RUM profile:

    9.37%  postgres  rum.so              [.] updateItemIndexes ▒
    6.57%  postgres  postgres            [.] GenericXLogRegisterBuffer ▒
    5.85%  postgres  postgres            [.] hash_search_with_hash_value ▒
    5.54%  postgres  rum.so              [.] rumTraverseLock ▒
    5.09%  postgres  rum.so              [.] dataPlaceToPage ▒
    4.85%  postgres  postgres            [.] computeRegionDelta ▒
    4.78%  postgres  rum.so              [.] rumtuple_get_attrnum ▒
    4.28%  postgres  postgres            [.] nocache_index_getattr ▒
    4.23%  postgres  rum.so              [.] rumPlaceToDataPageLeaf ▒
    3.39%  postgres  postgres            [.] pg_comp_crc32c_sse42 ▒
    3.16%  postgres  libc-2.23.so        [.] __memcpy_avx_unaligned ▒
    2.72%  postgres  rum.so              [.] findInLeafPage ▒
    2.64%  postgres  postgres            [.] PinBuffer ▒
    2.22%  postgres  postgres            [.] FunctionCall2Coll ▒
    2.22%  postgres  rum.so              [.] compareRumItem ▒
    1.91%  postgres  rum.so              [.] entryLocateEntry ▒

But... time of RUN insertion almost not changed: 1770 seconds vs. 1881 
seconds.
Looks like it was mostly limited by time of writing data to the disk.

-- 
Konstantin Knizhnik
Postgres Professional: http://www.postgrespro.com
The Russian Postgres Company


Вложения

В списке pgsql-hackers по дате отправления:

Предыдущее
От: Michael Paquier
Дата:
Сообщение: Re: Autovacuum vs vac_update_datfrozenxid() vs ?
Следующее
От: Dmitry Dolgov
Дата:
Сообщение: Re: Index Skip Scan