RE: pg_basebackup inconsistent performance

Поиск
Список
Период
Сортировка
От Jasen Lentz
Тема RE: pg_basebackup inconsistent performance
Дата
Msg-id MN2PR13MB403962F8B2DAB161098093C7BCA50@MN2PR13MB4039.namprd13.prod.outlook.com
обсуждение исходный текст
Ответ на Re: pg_basebackup inconsistent performance  (Stephen Frost <sfrost@snowman.net>)
Список pgsql-general
Is the backup server shared among other systems..?
No,  physical system

And there's no increased activity on the backup server either?
No

Have you looked at network traffic for the duration?  And/or disk i/o on each system?  If you ran a backup once and
thenimmediately after and that's the 'fast' case then you may be seeing performance be better due to a lot of data
beingin the filesystem cache.  pg_basebackup being single-threaded probably doesn't help here either, you might want to
considerone of the parallel-backup options. 

Yes, looked at all the system stats, nothing changed, just the backups running extremely long.

Was looking into pgbackrest, just haven't gotten it configured yet


-----Original Message-----
From: Stephen Frost <sfrost@snowman.net>
Sent: Wednesday, May 6, 2020 12:30 PM
To: Jasen Lentz <jlentz@sescollc.com>
Cc: Adrian Klaver <adrian.klaver@aklaver.com>; pgsql-general@lists.postgresql.org
Subject: Re: pg_basebackup inconsistent performance

Greetings,

* Jasen Lentz (jlentz@sescollc.com) wrote:
> Where are the machines you are backing up from/to relative to each on the network?
> Direct ethernet connection between 10G network interfaces

Is the backup server shared among other systems..?

> Is there increased activity on the database servers e.g. inserts, updates, etc during the extended backups?
> Not according to sar reports

And there's no increased activity on the backup server either?

Have you looked at network traffic for the duration?  And/or disk i/o on each system?  If you ran a backup once and
thenimmediately after and that's the 'fast' case then you may be seeing performance be better due to a lot of data
beingin the filesystem cache.  pg_basebackup being single-threaded probably doesn't help here either, you might want to
considerone of the parallel-backup options. 

Thanks,

Stephen



В списке pgsql-general по дате отправления:

Предыдущее
От: Lisandro Rostagno
Дата:
Сообщение: Could not launch new process for connection: Could not allocate memory
Следующее
От: "Ashish Chugh"
Дата:
Сообщение: RE: Abnormal Growth of Index Size - Index Size 3x large than tablesize.