Re: [(catch-ext)] Re: Setting up streaming replication on large database (20+ TB) for the first time

Поиск
Список
Период
Сортировка
От Ivan N. Ivanov
Тема Re: [(catch-ext)] Re: Setting up streaming replication on large database (20+ TB) for the first time
Дата
Msg-id CAC+=vAw99nbust7BCwwU=c=uuL8pNrC5NnOiJmJx5mt9ypbtiw@mail.gmail.com
обсуждение исходный текст
Ответ на Re: [(catch-ext)] Re: Setting up streaming replication on large database (20+ TB) for the first time  ("Ivan N. Ivanov" <ivan.ni@telebid-pro.com>)
Ответы Re: [(catch-ext)] Re: Setting up streaming replication on large database (20+ TB) for the first time  (Vijaykumar Jain <vijaykumarjain.github@gmail.com>)
Список pgsql-general
Дерево обсуждения
Thank you, people. The big problem in my case, which I have not mentioned, is that I think the network is a bottleneck, because I am running pg_basebackup through internet from local country to Amazon instance in Germany and the speed in copying is around 50 MB/sec max, that is why it takes 2 days for copying.

I will try using high compression for the basebackup to reduce the time.

pgbackrest is an alternative, too

Thank you again!



On Wed, Aug 17, 2022 at 11:13 PM Ivan N. Ivanov <ivan.ni@telebid-pro.com> wrote:
Thank you for your answer! I have found this tool and I will try it tomorrow to see if this "read-ahead" feature will speed up the process.

On Wed, Aug 17, 2022 at 11:09 PM Christophe Pettus <xof@thebuild.com> wrote:


> On Aug 17, 2022, at 13:06, Ivan N. Ivanov <ivan.ni@telebid-pro.com> wrote:
>
> How to speed up recovering of WAL files?

Since you are running on your own hardware, you might take a look at:

        https://github.com/TritonDataCenter/pg_prefaulter

В списке pgsql-general по дате отправления:

Предыдущее
От: Vijaykumar Jain
Дата:
Сообщение: Re: Setting up streaming replication on large database (20+ TB) for the first time
Следующее
От: hubert depesz lubaczewski
Дата:
Сообщение: Re: Is it possible to keep indexes on different disk location?