Обсуждение: Replication in main PostgreSQL codebase

Поиск
Список
Период
Сортировка

Replication in main PostgreSQL codebase

От
"Matt Browne"
Дата:
Hello all!

I apologise in advance if any of my questions are in a FAQ somewhere - I
haven't seen them...

Does anyone know when (if ever) replication support will be added to the
main PostgreSQL codebase? Is there any chance it'll be included in the
upcoming 7.5 release?

I've taken a look at the replication solutions already available, including
the sterling effort made on Slony-I, but we're really looking for
integrated, base-level support rather than an add-in.

Cheers!


Re: Replication in main PostgreSQL codebase

От
Christopher Browne
Дата:
After a long battle with technology, list.pgsql-admin@picton.net ("Matt Browne"), an earthling, wrote:
> I apologise in advance if any of my questions are in a FAQ somewhere - I
> haven't seen them...
>
> Does anyone know when (if ever) replication support will be added to the
> main PostgreSQL codebase? Is there any chance it'll be included in the
> upcoming 7.5 release?

Not much of a chance.

> I've taken a look at the replication solutions already available,
> including the sterling effort made on Slony-I, but we're really
> looking for integrated, base-level support rather than an add-in.

The problem is that "replication" doesn't tend to mean one thing, but
people rather have different ideas of what it means.

Jan Wieck puts it fairly nicely:

  "The number of different replication solutions available supports
   the theory that ``one size fits all'' is not true when it comes to
   database replication."
--
let name="cbbrowne" and tld="acm.org" in name ^ "@" ^ tld;;
http://www.ntlug.org/~cbbrowne/emacs.html
You shouldn't anthropomorphize computers; they don't like it.

Re: Replication in main PostgreSQL codebase

От
"Matt Browne"
Дата:
On 06 July 2004 16:41, Christopher Browne wrote:
> > I've taken a look at the replication solutions already available,
> > including the sterling effort made on Slony-I, but we're really
> > looking for integrated, base-level support rather than an add-in.
>
> The problem is that "replication" doesn't tend to mean one
> thing, but people rather have different ideas of what it means.

I don't necessarily agree with that. It's true that one size hardly ever
fits all, especially when it comes to implementation, but I think people
have a certain replication feature set in mind when they come across a DBMS
that purports to be enterprise-class...

... Just like what's been listed in the 'Urgent' section of the TODO list
since (I think) 7.2, in fact. (Except perhaps the more complex features like
multi-master replication.)

I didn't post my original message to the pgsql-hackers list because I wanted
to respect the ominous warning about trying other lists first.

Not to discount your comments, Christopher, but is there anyone on this list
who could give me an official and authoritative line on the inclusion of
in-built replication functionality?

Thanks again!


Re: Replication in main PostgreSQL codebase

От
"Marc G. Fournier"
Дата:
On Tue, 6 Jul 2004, Matt Browne wrote:

> On 06 July 2004 16:41, Christopher Browne wrote:
>>> I've taken a look at the replication solutions already available,
>>> including the sterling effort made on Slony-I, but we're really
>>> looking for integrated, base-level support rather than an add-in.
>>
>> The problem is that "replication" doesn't tend to mean one
>> thing, but people rather have different ideas of what it means.
>
> I don't necessarily agree with that. It's true that one size hardly ever
> fits all, especially when it comes to implementation, but I think people
> have a certain replication feature set in mind when they come across a DBMS
> that purports to be enterprise-class...
>
> ... Just like what's been listed in the 'Urgent' section of the TODO list
> since (I think) 7.2, in fact. (Except perhaps the more complex features like
> multi-master replication.)
>
> I didn't post my original message to the pgsql-hackers list because I wanted
> to respect the ominous warning about trying other lists first.
>
> Not to discount your comments, Christopher, but is there anyone on this list
> who could give me an official and authoritative line on the inclusion of
> in-built replication functionality?

Christopher is correct ... if there was such a thing as an 'end all, be
all' replication solution, there wouldn't be a half a dozen different ones
out there ...

It would be unwise for *anyone* to state "never" as far as inclusion of
built-in replication, but since the general consensus is that there is no
such thing as the 'all-encompassing solution' for this, the chances of one
ever coming about that would be of a scope that would be acceptable to be
built-in is next to zero ...

----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664

Re: Replication in main PostgreSQL codebase

От
Bruce Momjian
Дата:
Marc G. Fournier wrote:
> Christopher is correct ... if there was such a thing as an 'end all, be
> all' replication solution, there wouldn't be a half a dozen different ones
> out there ...
>
> It would be unwise for *anyone* to state "never" as far as inclusion of
> built-in replication, but since the general consensus is that there is no
> such thing as the 'all-encompassing solution' for this, the chances of one
> ever coming about that would be of a scope that would be acceptable to be
> built-in is next to zero ...

OK, I reworded the replication TODO section and moved it under
Administration:

* Improve replication solutions
        o Automatic failover
        o Load balancing
        o Master/slave replication
        o Multi-master replication
        o Partition data across servers
        o Queries across databases or servers (two-phase commit)
        o Allow replication over unreliable or non-persistent links

--
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073

Re: Replication in main PostgreSQL codebase

От
Christopher Petrilli
Дата:
On Tue, 6 Jul 2004 17:07:33 -0300 (ADT), Marc G. Fournier
<scrappy@postgresql.org> wrote:

> It would be unwise for *anyone* to state "never" as far as inclusion of
> built-in replication, but since the general consensus is that there is no
> such thing as the 'all-encompassing solution' for this, the chances of one
> ever coming about that would be of a scope that would be acceptable to be
> built-in is next to zero ...

I think what I run into is that while most of us would agree that the
"one size fits all" argument is useless from a technical perspective,
it's not the technical people that are usually the ones involved here.
From a "marketing" perspective, it would be useful if PostgreSQL
included at least a single master, single slave replication model that
was easily enabled and set up. There is a subclass of the problem that
is common to most situations, which is the ability to have a "live"
backup.  Perhaps the 'dbmirror' component in the 'contrib' directory
is enough, and it simply needs to be highlighted.  It does meet some
subset of the needs out there.

Sadly, a lot of problems are simply marketing perceptions :/

Chris
--
| Christopher Petrilli
| petrilli@gmail.com

Re: Replication in main PostgreSQL codebase

От
Peter Eisentraut
Дата:
Marc G. Fournier wrote:
> Christopher is correct ... if there was such a thing as an 'end all,
> be all' replication solution, there wouldn't be a half a dozen
> different ones out there ...

Which ones are you thinking of in your count?  I don't get anywhere near
half a dozen.


Re: Replication in main PostgreSQL codebase

От
Peter Eisentraut
Дата:
Christopher Browne wrote:
> Jan Wieck puts it fairly nicely:
>
>   "The number of different replication solutions available supports
>    the theory that ``one size fits all'' is not true when it comes to
>    database replication."

The fact that all but one or two replication solutions out there are
pretty much dead supports the theory that "one size fits most" is true.

Re: Replication in main PostgreSQL codebase

От
"Marc G. Fournier"
Дата:
On Tue, 6 Jul 2004, Peter Eisentraut wrote:

> Marc G. Fournier wrote:
>> Christopher is correct ... if there was such a thing as an 'end all,
>> be all' replication solution, there wouldn't be a half a dozen
>> different ones out there ...
>
> Which ones are you thinking of in your count?  I don't get anywhere near
> half a dozen.

erserver, slony, dbmirror are off the top of my head for OSS ones ... then
Command Prompt has their replication solution, so that's four ... wasn't
there one out of russia?  I can't recall the name of it though :(
apparently someone is still working on pgreplication ...


----
Marc G. Fournier           Hub.Org Networking Services (http://www.hub.org)
Email: scrappy@hub.org           Yahoo!: yscrappy              ICQ: 7615664

Re: Replication in main PostgreSQL codebase

От
Bruce Momjian
Дата:
Marc G. Fournier wrote:
> On Tue, 6 Jul 2004, Peter Eisentraut wrote:
>
> > Marc G. Fournier wrote:
> >> Christopher is correct ... if there was such a thing as an 'end all,
> >> be all' replication solution, there wouldn't be a half a dozen
> >> different ones out there ...
> >
> > Which ones are you thinking of in your count?  I don't get anywhere near
> > half a dozen.
>
> erserver, slony, dbmirror are off the top of my head for OSS ones ... then
> Command Prompt has their replication solution, so that's four ... wasn't
> there one out of russia?  I can't recall the name of it though :(
> apparently someone is still working on pgreplication ...

And pgcluster, which does multi-master.

--
  Bruce Momjian                        |  http://candle.pha.pa.us
  pgman@candle.pha.pa.us               |  (610) 359-1001
  +  If your life is a hard drive,     |  13 Roberts Road
  +  Christ can be your backup.        |  Newtown Square, Pennsylvania 19073

Re: Replication in main PostgreSQL codebase

От
Gaetano Mendola
Дата:
Bruce Momjian wrote:

> OK, I reworded the replication TODO section and moved it under
> Administration:
>
> * Improve replication solutions
>         o Automatic failover

The Automatic failover is already available, we use the RH cluster
solution and it works really well, we never had a failure till now
but all the our simulations ( power off, hardware failure ) are
working well. We have almost 3 year of 24/24 7/7 without macro
interruption, only fews minutes during the 7.0 -> 7.1 -> ... -> 7.4
upgrades. With the RH solution we are also able to perform the
minor upgrades ( 7.4.1 -> 7.4.2 for example ) without one single
minute of interruption:
1) Upgrade on passive node2) Relocation service     3) Upgrade on the active node4) Relocation service

it would be great from this point of view if the pg_upgrade could handle
also the major version upgrade without need to dump, init, reload the db.


Regards
Gaetano Mendola







Re: Replication in main PostgreSQL codebase

От
Gaetano Mendola
Дата:
Christopher Browne wrote:

> After a long battle with technology, list.pgsql-admin@picton.net ("Matt Browne"), an earthling, wrote:
>
>>I apologise in advance if any of my questions are in a FAQ somewhere - I
>>haven't seen them...
>>
>>Does anyone know when (if ever) replication support will be added to the
>>main PostgreSQL codebase? Is there any chance it'll be included in the
>>upcoming 7.5 release?
>
>
> Not much of a chance.
>
>
>>I've taken a look at the replication solutions already available,
>>including the sterling effort made on Slony-I, but we're really
>>looking for integrated, base-level support rather than an add-in.
>
>
> The problem is that "replication" doesn't tend to mean one thing, but
> people rather have different ideas of what it means.
>
> Jan Wieck puts it fairly nicely:
>
>   "The number of different replication solutions available supports
>    the theory that ``one size fits all'' is not true when it comes to
>    database replication."

We all agree on that, postgres is hiding behind this concept as well
MySQL did till now with stored procedure, referencial integrity, transaction
bla bla bla

Most of the time the first question that I receive is: it's possible replicate
my data in an other database in order to perform heavy queries on it without
affect the master performances? You have to see the faces when the answer is:
with an add-in.

I believe that with the PITR + NT an or more integrated solutions in postgres
are not too far away to be developed


Regards
Gaetano Mendola