pgsql: Fix several weaknesses in slot and logical replication on-disk s

Поиск
Список
Период
Сортировка
От Andres Freund
Тема pgsql: Fix several weaknesses in slot and logical replication on-disk s
Дата
Msg-id E1XoeVR-0001eb-84@gemulon.postgresql.org
обсуждение исходный текст
Список pgsql-committers
Fix several weaknesses in slot and logical replication on-disk serialization.

Heikki noticed in 544E23C0.8090605@vmware.com that slot.c and
snapbuild.c were missing the FIN_CRC32 call when computing/checking
checksums of on disk files. That doesn't lower the the error detection
capabilities of the checksum, but is inconsistent with other usages.

In a followup mail Heikki also noticed that, contrary to a comment,
the 'version' and 'length' struct fields of replication slot's on disk
data where not covered by the checksum. That's not likely to lead to
actually missed corruption as those fields are cross checked with the
expected version and the actual file length. But it's wrong
nonetheless.

As fixing these issues makes existing on disk files unreadable, bump
the expected versions of on disk files for both slots and logical
decoding historic catalog snapshots.  This means that loading old
files will fail with
ERROR: "replication slot file ... has unsupported version 1"
and
ERROR: "snapbuild state file ... has unsupported version 1 instead of
2" respectively. Given the low likelihood of anybody already using
these new features in a production setup that seems acceptable.

Fixing these issues made me notice that there's no regression test
covering the loading of historic snapshot from disk - so add one.

Backpatch to 9.4 where these features were introduced.

Branch
------
REL9_4_STABLE

Details
-------
http://git.postgresql.org/pg/commitdiff/5005469cb2f2bf8a57344b43f97969292ebebb76

Modified Files
--------------
contrib/test_decoding/Makefile                    |    2 +-
contrib/test_decoding/expected/ondisk_startup.out |   43 +++++++++++++++++++++
contrib/test_decoding/specs/ondisk_startup.spec   |   43 +++++++++++++++++++++
src/backend/replication/logical/snapbuild.c       |    6 ++-
src/backend/replication/slot.c                    |   37 ++++++++++++------
5 files changed, 117 insertions(+), 14 deletions(-)


В списке pgsql-committers по дате отправления:

Предыдущее
От: Andres Freund
Дата:
Сообщение: pgsql: Add interrupt checks to contrib/pg_prewarm.
Следующее
От: Tom Lane
Дата:
Сообщение: pgsql: Explicitly support the case that a plancache's raw_parse_tree is