Обсуждение: Skype presents: SkyTools 2.1 - queueing, replication and more...

Поиск
Список
Период
Сортировка

Skype presents: SkyTools 2.1 - queueing, replication and more...

От
"Marko Kreen"
Дата:
This is a package of tools used in Skype for replication and
failover.  Also it includes a generic queuing mechanism PgQ and
utility library for Python scripts.

        https://developer.skype.com/SkypeGarage/DbProjects/SkyTools

Main components are:

PgQ
---

This is the queue machanism we use.  Consists of PL/pgsql, PL/python
and C code in database, with Python framework on top of it.  It is
based on snapshot based event handling ideas from Slony-I,
written for general usage.

Londiste
--------

Replication tool written in Python, using PgQ as event transport.

Goals:
- Survive high load, long transactions - implemented in PgQ.
- Easy to administer - eg. tables can be added one-by-one to set.
- Initial COPY does not block event replay for other tables.

Compared to Slony-I it is not that featureful, no support for
chained replication, even support for sequences got added
only recently.


walmgr
------
This script will setup WAL archiving, does initial backup and
runtime WAL archive and restore.