Hi.
Upon rebooting one of our main production database servers, we were
greeted with this:
(@)<2006-03-18 23:30:32.687 MST>[3791]LOG: database system was
interrupted while in recovery at 2006-03-18 23:30:26 MST
(@)<2006-03-18 23:30:32.687 MST>[3791]HINT: This probably means that
some data is corrupted and you will have to use the last backup for
recovery.
(@)<2006-03-18 23:30:32.688 MST>[3791]LOG: checkpoint record is at D/1919D5F0
(@)<2006-03-18 23:30:32.688 MST>[3791]LOG: redo record is at
D/191722C8; undo record is at 0/0; shutdown FALSE
(@)<2006-03-18 23:30:32.688 MST>[3791]LOG: next transaction ID:
81148900; next OID: 16566476
(@)<2006-03-18 23:30:32.688 MST>[3791]LOG: next MultiXactId: 1; next
MultiXactOffset: 0
(@)<2006-03-18 23:30:32.689 MST>[3791]LOG: database system was not
properly shut down; automatic recovery in progress
(@)<2006-03-18 23:30:33.032 MST>[3791]LOG: redo starts at D/191722C8
(@)<2006-03-18 23:30:33.035 MST>[3791]PANIC: heap_update_redo: no block
(@)<2006-03-18 23:30:33.036 MST>[3790]LOG: startup process (PID 3791)
was terminated by signal 6
(@)<2006-03-18 23:30:33.036 MST>[3790]LOG: aborting startup due to
startup process failure
As far as i know the postgresql was shutdown properly before the
reboot (pg_ctl stop -m fast). Though im not positive, I was just
brought in when they couldn't figure out why postgresql would not
start. Any ideas as to how this happened or how to fix it?
Right now im copying over the database, and then going to try
pg_resetxlog. Just to make sure, the only possible lost data are
things that are/would be in the xlog right? So i dont need to go
looking at all the tables, just ones I know were modified then.
Are there any other solutions that dont involve possibly loosing data?
(Yes I know backups, unfortunately the last back up was about 2 hours
ago and is not as up to date as i would like)
Just curious, ive also been investigating pitr for instead of doing
backups every 2 hours. If this problem were to surface when i was
using pitr as a backup solution, would all my data then be hosed (or
at least what pg_resetlog can not restore)?