Re: Add LZ4 compression in pg_dump

Поиск
Список
Период
Сортировка
Искать
От
Tomas Vondra
Тема
Re: Add LZ4 compression in pg_dump
Дата
в 12:54:31
Msg-id
26a8ba33-f0eb-9b62-be42-c8b91e9999a5@enterprisedb.com
Ответ на
Список
Дерево обсуждения
Add LZ4 compression in pg_dump Georgios <gkokolatos@protonmail.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Greg Stark <stark@mit.edu>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Rachel Heaton <rachelmheaton@gmail.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tom Lane <tgl@sss.pgh.pa.us>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Jacob Champion <jchampion@timescale.com>
Re: Add LZ4 compression in pg_dump Georgios Kokolatos <gkokolatos@protonmail.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
RE: Add LZ4 compression in pg_dump "shiy.fnst@fujitsu.com" <shiy.fnst@fujitsu.com>
RE: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Alexander Lakhin <exclusion@gmail.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Alexander Lakhin <exclusion@gmail.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Andrew Dunstan <andrew@dunslane.net>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tom Lane <tgl@sss.pgh.pa.us>
Re: Add LZ4 compression in pg_dump Tom Lane <tgl@sss.pgh.pa.us>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Alexander Lakhin <exclusion@gmail.com>
Re: Add LZ4 compression in pg_dump Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump vignesh C <vignesh21@gmail.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Daniel Gustafsson <daniel@yesql.se>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Daniel Gustafsson <daniel@yesql.se>
Re: Add LZ4 compression in pg_dump Robert Haas <robertmhaas@gmail.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Robert Haas <robertmhaas@gmail.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Robert Haas <robertmhaas@gmail.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
On 5/9/23 00:10, Michael Paquier wrote:
> On Mon, May 08, 2023 at 08:00:39PM +0200, Tomas Vondra wrote:
>> The LZ4Stream_write() forgot to move the pointer to the next chunk, so
>> it was happily decompressing the initial chunk over and over. A bit
>> embarrassing oversight :-(
>>
>> The custom format calls WriteDataToArchiveLZ4(), which was correct.
>>
>> The attached patch fixes this for me.
> 
> Ouch.  So this was corrupting the dumps and the compression when
> trying to write more than two chunks at once, not the decompression
> steps.  That addresses the issue here as well, thanks!

Yeah. Thanks for the report, should have been found during review.


regards

-- 
Tomas Vondra
EnterpriseDB: http://www.enterprisedb.com
The Enterprise PostgreSQL Company


В списке pgsql-hackers по дате отправления
От: Denis Laxalde
Дата:
От: torikoshia
Дата:
FAQ