Transaction size and Wal2Json
Transaction size and Wal2Json
От:
Mai Peng <maily.peng@webedia-group.com>
Дата:
Hello, We use the plugin Wal2Json in order to catch every modification on database. We’ve got an issue : WAL were growing very fast, the state of pg_stat_replication still on ‘catchup’ , an error:pg_recvlogical: unexpected termination of replication stream: ERROR: out of memory DETAIL: Cannot enlarge string buffer. It seems Wal2Json can not handle very big transactions ( more than 1 Gb). How could we measure the size of a transaction ? Could we increase this limitation ? Thank you Mai
Re: Transaction size and Wal2Json
От:
Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Дата:
On 07/02/2019 11:38, Mai Peng wrote: > We use the plugin Wal2Json in order to catch every modification on database. We’ve got an issue : WAL were growing very fast, the state of pg_stat_replication still on ‘catchup’ , an error:pg_recvlogical: unexpected termination of replication stream: ERROR: out of memory DETAIL: Cannot enlarge string buffer. It seems Wal2Json can not handle very big transactions ( more than 1 Gb). > How could we measure the size of a transaction ? > Could we increase this limitation ? You should send a bug report to wal2json. It's plausible that some naive coding would run into the limitation that you describe, but a bit of effort can probably solve it. -- Peter Eisentraut http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Remote DBA, Training & Services
