Hi all.
PostgeewSQL 11.4 on Centos 7.
I created a test bed on VirtualBox and test HA cluster by random failures in loop. Sometime, in case of longest
switchingfrom failure, I get strange behaviour. The walreceiver is stopped by timeout, but don't restarted for 2 hours.
Maybe I agree with stopping by timeout, but why postgresql wait for 2 hour to start it again?
2019-08-12 16:34:31.118 MSK [1455] FATAL: terminating walreceiver due to timeout
2019-08-12 16:34:31.119 MSK [1451] LOG: record with incorrect prev-link DC7A2D84/100 at 0/D078A38
2019-08-12 18:34:50.222 MSK [14634] FATAL: could not connect to the primary server: server closed the connection
unexpectedly
This probably means the server terminated abnormally
before or while processing the request.
2019-08-12 18:34:50.234 MSK [8462] LOG: fetching timeline history file for timeline 4 from primary server
2019-08-12 18:34:50.235 MSK [8462] LOG: started streaming WAL from primary at 0/D000000 on timeline 3
2019-08-12 18:34:50.237 MSK [8462] LOG: replication terminated by primary server
2019-08-12 18:34:50.237 MSK [8462] DETAIL: End of WAL reached on timeline 3 at 0/D078A38.
2019-08-12 18:34:50.238 MSK [1451] LOG: new target timeline is 4
2019-08-12 18:34:50.239 MSK [8462] LOG: restarted WAL streaming at 0/D000000 on timeline 4
May be reason is in restart_after_crash=off option (recommended fo HA clusters).
The postgresql config is default, except:
ident_file = '/var/lib/pgsql/pg_ident.conf'
hba_file = '/var/lib/pgsql/pg_hba.conf'
listen_addresses = '*'
log_filename = 'postgresql.%F.log' # log file name pattern,
wal_keep_segments = 1
restart_after_crash = off
shared_buffers = 256MB
# may be this is a good compromise
synchronous_commit = remote_write
# other DC is the first, our is the last (this is different for each node)
synchronous_standby_names = 'FIRST 1 (tuchanka2a,tuchanka2c,tuchanka2b)'
And for slaves additionally:
primary_conninfo = 'host=krogan2 user=replicant application_name=tuchanka2d sslmode=disable'
recovery_target_timeline = 'latest'
standby_mode = 'on'