Re: [GENERAL] pg_rewind copy so much data

Поиск
Список
Период
Сортировка
От Hung Phan
Тема Re: [GENERAL] pg_rewind copy so much data
Дата
Msg-id CANHVDh1XQops==6Zie2rfobyaqhnfagOV=RhotWzbrjt3WuhyA@mail.gmail.com
обсуждение исходный текст
Ответ на Re: [GENERAL] pg_rewind copy so much data  (Michael Paquier <michael.paquier@gmail.com>)
Список pgsql-general
I use ver 9.5.3. I have just run again and get the debug log. It seems to be that I cannot send such big file to postgresql mail so I copy some parts here:

fetched file "global/pg_control", length 8192
fetched file "pg_xlog/0000000D.history", length 475
servers diverged at WAL position 2/D69820C8 on timeline 12
rewinding from last common checkpoint at 2/D6982058 on timeline 12
backup_label.old (COPY)
base/1/1247_fsm (COPY)
base/1/1247_vm (COPY)
base/1/1249_fsm (COPY)
base/1/1249_vm (COPY)
base/1/1255_fsm (COPY)
base/1/1255_vm (COPY)
base/1/1259_fsm (COPY)
base/1/1259_vm (COPY)
base/1/13125_fsm (COPY)
base/1/13125_vm (COPY)
base/1/13130_fsm (COPY)
base/1/13130_vm (COPY)
base/1/13135_fsm (COPY)
base/1/13135_vm (COPY)
base/1/13140_fsm (COPY)
base/1/13140_vm (COPY)
base/1/13145_fsm (COPY)
base/1/13145_vm (COPY)
base/1/13150_fsm (COPY)
base/1/13150_vm (COPY)
base/1/1417_vm (COPY)
base/1/1418_vm (COPY)
base/1/2328_vm (COPY)
base/1/2336_vm (COPY)
base/1/2600_fsm (COPY)


global/3592_vm (COPY)
global/4060_vm (COPY)
global/6000_vm (COPY)
global/pg_control (COPY)
global/pg_filenode.map (COPY)
global/pg_internal.init (COPY)
pg_clog/0000 (COPY)
pg_clog/0001 (COPY)
pg_clog/0002 (COPY)
pg_hba.conf (COPY)
pg_ident.conf (COPY)
pg_multixact/members/0000 (COPY)
pg_multixact/offsets/0000 (COPY)
pg_notify/0000 (COPY)
pg_stat_tmp/db_0.stat (COPY)
pg_stat_tmp/db_13294.stat (COPY)
pg_stat_tmp/global.stat (COPY)
pg_subtrans/0025 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/112 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/113 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1247 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1247_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1247_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1249 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1249_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1249_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1255 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1255_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1255_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1259 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1259_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1259_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13125 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13125_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13125_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13127 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13129 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13130 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13130_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13130_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13132 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13134 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13135 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13135_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13135_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13137 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13139 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13140 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13140_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13140_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13142 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13144 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13145 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13145_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13145_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13147 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13149 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13150 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13150_fsm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13150_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13152 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13154 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13155 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13157 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/13159 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1417 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1417_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1418 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/1418_vm (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/16401 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/16422 (COPY)
pg_tblspc/16386/PG_9.5_201510051/16387/16440 (COPY)



received chunk for file "base/1/2603_fsm", offset 0, size 24576
received chunk for file "base/1/2603_vm", offset 0, size 8192
received chunk for file "base/1/2605_fsm", offset 0, size 24576
received chunk for file "base/1/2605_vm", offset 0, size 8192
received chunk for file "base/1/2606_fsm", offset 0, size 24576
received chunk for file "base/1/2606_vm", offset 0, size 8192
received chunk for file "base/1/2607_fsm", offset 0, size 24576
received chunk for file "base/1/2607_vm", offset 0, size 8192
received chunk for file "base/1/2608_fsm", offset 0, size 24576
received chunk for file "base/1/2608_vm", offset 0, size 8192
received chunk for file "base/1/2609_fsm", offset 0, size 24576
received chunk for file "base/1/2609_vm", offset 0, size 8192
received chunk for file "base/1/2610_fsm", offset 0, size 24576
received chunk for file "base/1/2610_vm", offset 0, size 8192
received chunk for file "base/1/2612_fsm", offset 0, size 24576
received chunk for file "base/1/2612_vm", offset 0, size 8192
received chunk for file "base/1/2615_fsm", offset 0, size 24576
received chunk for file "base/1/2615_vm", offset 0, size 8192
received chunk for file "base/1/2616_fsm", offset 0, size 24576
received chunk for file "base/1/2616_vm", offset 0, size 8192



received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16651", offset 0, size 188416
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16653", offset 0, size 188416
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16655", offset 0, size 8192
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16661", offset 0, size 8192
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16663", offset 0, size 8192
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 0, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 1000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 2000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 3000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 4000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 5000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 6000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 7000000, size 1000000
received chunk for file "pg_tblspc/16386/PG_9.5_201510051/16387/16665", offset 8000000



On Wed, Sep 13, 2017 at 5:57 PM, Michael Paquier <michael.paquier@gmail.com> wrote:
On Wed, Sep 13, 2017 at 2:21 PM, Hung Phan <hungphan227@gmail.com> wrote:
> If I run pg_rewind with debug option, it just show additional bunch of files
> copied in directories like base or pg_tblspc. I claim that there is no data
> inserted of modified from the first step. The only difference between two
> server is caused by restarting old master.

That's exactly this kind of data that would allow to conclude where
the data comes from, and you are not showing it, so it is not possible
to make a clear conclusion. Are known the file paths, the offset
position in the file where a chunk of data is taken, and the chunk
size. If you see for example a bunch of 8kB blocks being copied, this
means that some extra load ran on the master before it was stopped,
and before running the rewind. Are you sure that you don't have large
log files for example?

I would be curious to know what is the version of Postgres 9.5 you are
using as well.
--
Michael

В списке pgsql-general по дате отправления:

Предыдущее
От: Hung Phan
Дата:
Сообщение: Re: [GENERAL] pg_rewind copy so much data
Следующее
От: Michael Paquier
Дата:
Сообщение: Re: [GENERAL] pg_rewind copy so much data