Re: Add LZ4 compression in pg_dump
От
Tomas Vondra
Тема
Re: Add LZ4 compression in pg_dump
Дата
Msg-id
26a8ba33-f0eb-9b62-be42-c8b91e9999a5@enterprisedb.com
Ответ на
Re: Add LZ4 compression in pg_dump (Michael Paquier)
Список
Дерево обсуждения
Add LZ4 compression in pg_dump Georgios <gkokolatos@protonmail.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Greg Stark <stark@mit.edu>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Rachel Heaton <rachelmheaton@gmail.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tom Lane <tgl@sss.pgh.pa.us>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Jacob Champion <jchampion@timescale.com>
Re: Add LZ4 compression in pg_dump Georgios Kokolatos <gkokolatos@protonmail.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
RE: Add LZ4 compression in pg_dump "shiy.fnst@fujitsu.com" <shiy.fnst@fujitsu.com>
RE: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Alexander Lakhin <exclusion@gmail.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Alexander Lakhin <exclusion@gmail.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Andrew Dunstan <andrew@dunslane.net>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tom Lane <tgl@sss.pgh.pa.us>
Re: Add LZ4 compression in pg_dump Tom Lane <tgl@sss.pgh.pa.us>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Alexander Lakhin <exclusion@gmail.com>
Re: Add LZ4 compression in pg_dump Peter Eisentraut <peter.eisentraut@enterprisedb.com>
Re: Add LZ4 compression in pg_dump Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump vignesh C <vignesh21@gmail.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump gkokolatos@pm.me
Re: Add LZ4 compression in pg_dump Daniel Gustafsson <daniel@yesql.se>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Daniel Gustafsson <daniel@yesql.se>
Re: Add LZ4 compression in pg_dump Robert Haas <robertmhaas@gmail.com>
Re: Add LZ4 compression in pg_dump Justin Pryzby <pryzby@telsasoft.com>
Re: Add LZ4 compression in pg_dump Robert Haas <robertmhaas@gmail.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Robert Haas <robertmhaas@gmail.com>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
Re: Add LZ4 compression in pg_dump Michael Paquier <michael@paquier.xyz>
On 5/9/23 00:10, Michael Paquier wrote: > On Mon, May 08, 2023 at 08:00:39PM +0200, Tomas Vondra wrote: >> The LZ4Stream_write() forgot to move the pointer to the next chunk, so >> it was happily decompressing the initial chunk over and over. A bit >> embarrassing oversight :-( >> >> The custom format calls WriteDataToArchiveLZ4(), which was correct. >> >> The attached patch fixes this for me. > > Ouch. So this was corrupting the dumps and the compression when > trying to write more than two chunks at once, not the decompression > steps. That addresses the issue here as well, thanks! Yeah. Thanks for the report, should have been found during review. regards -- Tomas Vondra EnterpriseDB: http://www.enterprisedb.com The Enterprise PostgreSQL Company
В списке pgsql-hackers по дате отправления
От: Denis Laxalde
Дата: