Re: Zedstore - compressed in-core columnar storage

Поиск
Список
Период
Сортировка
От Ashwin Agrawal
Тема Re: Zedstore - compressed in-core columnar storage
Дата
Msg-id CALfoeitpQ-yuZgdW=tzN7OpfzVS4uJEY6rszg9T71wS60Y07GA@mail.gmail.com
обсуждение исходный текст
Ответ на Re: Zedstore - compressed in-core columnar storage  (Tomas Vondra <tomas.vondra@2ndquadrant.com>)
Ответы Re: Zedstore - compressed in-core columnar storage  (Tomas Vondra <tomas.vondra@2ndquadrant.com>)
Список pgsql-hackers

On Mon, Apr 15, 2019 at 11:18 AM Tomas Vondra <tomas.vondra@2ndquadrant.com> wrote:

Maybe. I'm not going to pretend I fully understand the internals. Does
that mean the container contains ZSUncompressedBtreeItem as elements? Or
just the plain Datum values?

First, your reading of code and all the comments/questions so far have been highly encouraging. Thanks a lot for the same.

Container contains ZSUncompressedBtreeItem as elements. As for Item will have to store meta-data like size, undo and such info. We don't wish to restrict compressing only items from same insertion sessions only. Hence, yes doens't just store Datum values. Wish to consider it more tuple level operations and have meta-data for it and able to work with tuple level granularity than block level.

Definitely many more tricks can be and need to be applied to optimize storage format, like for fixed width columns no need to store the size in every item. Keep it simple is theme have been trying to maintain. Compression ideally should compress duplicate data pretty easily and efficiently as well, but we will try to optimize as much we can without the same.

В списке pgsql-hackers по дате отправления:

Предыдущее
От: Robert Haas
Дата:
Сообщение: Re: block-level incremental backup
Следующее
От: Peter Geoghegan
Дата:
Сообщение: Re: Zedstore - compressed in-core columnar storage