> > What if you move the recovery.conf file out? > > > Will try. > > > > The below looks like missing/corrupted/incorrect files. Hard to tell > without knowing what Patroni did? > > > Storage disappeared from underneath these clusters. The OS was of > course still in memory making futile attempts to write to disk, which > would never complete. > > My best guess is that Patroni or postgress was in the middle of some > writes across the clusters when the failure occurred.
So to be clear all three clusters where writing to the same storage medium and there was no WAL archiving to some other storage?
Yep, cheap LAB hardware with no power redundancy ( yet ) .