Обсуждение: postgresql and replication

Поиск
Список
Период
Сортировка

postgresql and replication

От
Chris Miles
Дата:
Hi, we really want to get a reliable PostgreSQL replication
setup going, with a Master Write server and many Slave Read-Only
servers replicating off the master.  This is to allow us to
scale up our low-write/high-read application over many customers.

We've done some research (ie, web searching) and we are not
convinced that PostgreSQL replication projects are production
ready (with one commercial exception).  Hopefully we are wrong
however, as the MySQL built-in replication does seem very mature
and makes me look across with envy.  But considering all the effort
we've put into our PG installation, we'd rather stick to PG if
possible.

I will briefly list the PG Replication projects I have come across
below.  I am looking for more experienced people, who have hopefully
already implemented any of these, or the authors themselves, to
provide more details and guide us in the right direction as to
which project is the "best" to go with.  I am happy to summarize
the info we put together for others looking to do the same.

eRServer
  http://www.erserver.com/
  Commercial, looks professional.  Not free.
  However, No trial or evaluation ?

PGReplication
  http://gborg.postgresql.org/project/pgreplication/projdisplay.php
  Software is: Postgres-R with Spread.  Free.
  Looks to be still very much in development, can only consider beta ?

RServ
  http://gborg.postgresql.org/project/rservimp/projdisplay.php
  Looks far too beta....
  Free

PostgreSQL Replicator
  http://pgreplicator.sourceforge.net/
  “Store and forward” asynchronous data replication.
  Free
  Tested up to PG 7.1
  Peer-to-peer (single master/slave pair) not multi-slave.

Usogres
  http://usogres.good-day.net/
  Very simple and not real-time replication.  Free.
  Just duplication and only one master/slave pair.

Regards,
Chris.

--
Chris Miles
http://chrismiles.info/



Re: postgresql and replication

От
Andrew Sullivan
Дата:
On Tue, Aug 26, 2003 at 06:19:12PM +0100, Chris Miles wrote:
> eRServer
>  http://www.erserver.com/
>  Commercial, looks professional.  Not free.
>  However, No trial or evaluation ?

There's (about to be?) a free version available now.  If you start
grovelling around on gborg some time late this afternoon (uh, EDT), I
think you'll stumble on it.

A

--
----
Andrew Sullivan                         204-4141 Yonge Street
Liberty RMS                           Toronto, Ontario Canada
<andrew@libertyrms.info>                              M2P 2A8
                                         +1 416 646 3304 x110


Re: postgresql and replication

От
Thierry Missimilly
Дата:
Hi,

This is a good status.
But i think you have forgotten DBMirror which is in the contrib directory.
I have tried to run it on the same machine but on to 2 differents Postgres
instances. The master on Port 5432 and the Slave on Port 5434. These does
not work as the Perl script in charge of synchronized the Master DB and the
Slave DB, work only on the default port 5432.

I'm waiting for an other machine to create the Slave DB on a different
machine.

Thierry Missimilly


Chris Miles wrote:

> Hi, we really want to get a reliable PostgreSQL replication
> setup going, with a Master Write server and many Slave Read-Only
> servers replicating off the master.  This is to allow us to
> scale up our low-write/high-read application over many customers.
>
> We've done some research (ie, web searching) and we are not
> convinced that PostgreSQL replication projects are production
> ready (with one commercial exception).  Hopefully we are wrong
> however, as the MySQL built-in replication does seem very mature
> and makes me look across with envy.  But considering all the effort
> we've put into our PG installation, we'd rather stick to PG if
> possible.
>
> I will briefly list the PG Replication projects I have come across
> below.  I am looking for more experienced people, who have hopefully
> already implemented any of these, or the authors themselves, to
> provide more details and guide us in the right direction as to
> which project is the "best" to go with.  I am happy to summarize
> the info we put together for others looking to do the same.
>
> eRServer
>   http://www.erserver.com/
>   Commercial, looks professional.  Not free.
>   However, No trial or evaluation ?
>
> PGReplication
>   http://gborg.postgresql.org/project/pgreplication/projdisplay.php
>   Software is: Postgres-R with Spread.  Free.
>   Looks to be still very much in development, can only consider beta ?
>
> RServ
>   http://gborg.postgresql.org/project/rservimp/projdisplay.php
>   Looks far too beta....
>   Free
>
> PostgreSQL Replicator
>   http://pgreplicator.sourceforge.net/
>   “Store and forward” asynchronous data replication.
>   Free
>   Tested up to PG 7.1
>   Peer-to-peer (single master/slave pair) not multi-slave.
>
> Usogres
>   http://usogres.good-day.net/
>   Very simple and not real-time replication.  Free.
>   Just duplication and only one master/slave pair.
>
> Regards,
> Chris.
>
> --
> Chris Miles
> http://chrismiles.info/
>
> ---------------------------(end of broadcast)---------------------------
> TIP 2: you can get off all lists at once with the unregister command
>     (send "unregister YourEmailAddressHere" to majordomo@postgresql.org)

Вложения

Re: postgresql and replication

От
"scott.marlowe"
Дата:
Look at User Mode Linux:

http://user-mode-linux.sourceforge.net/

It'll let you run multiple linux instances on the same box.

On Wed, 27 Aug 2003, Thierry Missimilly wrote:

> Hi,
>
> This is a good status.
> But i think you have forgotten DBMirror which is in the contrib directory.
> I have tried to run it on the same machine but on to 2 differents Postgres
> instances. The master on Port 5432 and the Slave on Port 5434. These does
> not work as the Perl script in charge of synchronized the Master DB and the
> Slave DB, work only on the default port 5432.
>
> I'm waiting for an other machine to create the Slave DB on a different
> machine.
>
> Thierry Missimilly
>
>
> Chris Miles wrote:
>
> > Hi, we really want to get a reliable PostgreSQL replication
> > setup going, with a Master Write server and many Slave Read-Only
> > servers replicating off the master.  This is to allow us to
> > scale up our low-write/high-read application over many customers.
> >
> > We've done some research (ie, web searching) and we are not
> > convinced that PostgreSQL replication projects are production
> > ready (with one commercial exception).  Hopefully we are wrong
> > however, as the MySQL built-in replication does seem very mature
> > and makes me look across with envy.  But considering all the effort
> > we've put into our PG installation, we'd rather stick to PG if
> > possible.
> >
> > I will briefly list the PG Replication projects I have come across
> > below.  I am looking for more experienced people, who have hopefully
> > already implemented any of these, or the authors themselves, to
> > provide more details and guide us in the right direction as to
> > which project is the "best" to go with.  I am happy to summarize
> > the info we put together for others looking to do the same.
> >
> > eRServer
> >   http://www.erserver.com/
> >   Commercial, looks professional.  Not free.
> >   However, No trial or evaluation ?
> >
> > PGReplication
> >   http://gborg.postgresql.org/project/pgreplication/projdisplay.php
> >   Software is: Postgres-R with Spread.  Free.
> >   Looks to be still very much in development, can only consider beta ?
> >
> > RServ
> >   http://gborg.postgresql.org/project/rservimp/projdisplay.php
> >   Looks far too beta....
> >   Free
> >
> > PostgreSQL Replicator
> >   http://pgreplicator.sourceforge.net/
> >   “Store and forward” asynchronous data replication.
> >   Free
> >   Tested up to PG 7.1
> >   Peer-to-peer (single master/slave pair) not multi-slave.
> >
> > Usogres
> >   http://usogres.good-day.net/
> >   Very simple and not real-time replication.  Free.
> >   Just duplication and only one master/slave pair.
> >
> > Regards,
> > Chris.
> >
> > --
> > Chris Miles
> > http://chrismiles.info/
> >
> > ---------------------------(end of broadcast)---------------------------
> > TIP 2: you can get off all lists at once with the unregister command
> >     (send "unregister YourEmailAddressHere" to majordomo@postgresql.org)
>


Re: postgresql and replication

От
Andrew Sullivan
Дата:
On Tue, Aug 26, 2003 at 06:05:45PM -0400, Stephen Frost wrote:
> It appears to be up there now and you can puruse it using ViewCVS.  The
> LICENSE file in erserver/docs certainly doesn't look like BSD (which is
> claimed on the main page) to me though.

Oops, looks like something didn't get changed.  We can fix that.

A


--
----
Andrew Sullivan                         204-4141 Yonge Street
Liberty RMS                           Toronto, Ontario Canada
<andrew@libertyrms.info>                              M2P 2A8
                                         +1 416 646 3304 x110


Re: postgresql and replication

От
Chris Miles
Дата:
Indeed, a free release of eRServer was released last night and is
available at
http://gborg.postgresql.org/project/erserver/download/download.php
There was an announcement sent to pgsql-announce also.

We will now be evaluating this to see if it is suitable for our
needs.

I spoke to PostgreSQL Inc last night and was informed that they will
be releasing their previous versions of eRServer to the open source
community 6-12 months after it has been replaced by the next
commercial version.  The commercial version is still sold, supported
and developed, and is currently at version 1.3.  The open source
version just released is a modified version of 1.2 basically.

Cheers,
Chris.

Andrew Sullivan wrote:
> On Tue, Aug 26, 2003 at 06:19:12PM +0100, Chris Miles wrote:
>>eRServer
>> http://www.erserver.com/
>> Commercial, looks professional.  Not free.
>> However, No trial or evaluation ?
>
> There's (about to be?) a free version available now.  If you start
> grovelling around on gborg some time late this afternoon (uh, EDT), I
> think you'll stumble on it.

--
Chris Miles
http://chrismiles.info/



Re: postgresql and replication

От
Stephen Frost
Дата:
* Andrew Sullivan (andrew@libertyrms.info) wrote:
> On Tue, Aug 26, 2003 at 06:19:12PM +0100, Chris Miles wrote:
> > eRServer
> >  http://www.erserver.com/
> >  Commercial, looks professional.  Not free.
> >  However, No trial or evaluation ?
>
> There's (about to be?) a free version available now.  If you start
> grovelling around on gborg some time late this afternoon (uh, EDT), I
> think you'll stumble on it.

It appears to be up there now and you can puruse it using ViewCVS.  The
LICENSE file in erserver/docs certainly doesn't look like BSD (which is
claimed on the main page) to me though.

    Stephen

Вложения

Re: postgresql and replication

От
"Marc G. Fournier"
Дата:

On Wed, 27 Aug 2003, Andrew Sullivan wrote:

> On Tue, Aug 26, 2003 at 06:05:45PM -0400, Stephen Frost wrote:
> > It appears to be up there now and you can puruse it using ViewCVS.  The
> > LICENSE file in erserver/docs certainly doesn't look like BSD (which is
> > claimed on the main page) to me though.
>
> Oops, looks like something didn't get changed.  We can fix that.

Yup, error in commit ... will get that one fixed up in the morning, it
*is* being released under BSDL ... sorry for teh confusion folks ...

Re: postgresql and replication

От
"Somasekhar Bangalore"
Дата:
Hi,

I tried installing the erserver software . After running the make command. i am getting this error


 [javac] An exception has occurred in the compiler (1.4.1_02). Please file a bug at the Java Developer Connection
(http://java.sun.com/cgi-bin/bugreport.cgi) after checking the Bug Parade for duplicates. Include your program and the
followingdiagnostic in your report.  Thank you. 

[javac] java.lang.InternalError: jzentry == 0,
[javac]  jzfile = 136119320,
[javac]  total = 556,
[javac]  name = /home/postgres/erserver/erserver_v1.2/java/lib/xerces.jar,
[javac]  i = 1,
[javac]  message = invalid LOC header (bad signature)


BUILD FAILED

/home/postgres/erserver/erserver_v1.2/java/build.xml:146: Compile failed, messages should have been provided.



I appreciate if some one can help me how to install & configure erserver.


Regards,
Somasekhar Bangalore
Principal Software Engineer
ZenSutra Software Technologies Pvt. Ltd.
Suite 601, HM Geneva House
#14, Cunningham Road
Bangalore 560-052, India

Ph:+91-80-235-0481
Fax:+91-80-235-0486
Email: sbangalore@zensutra.com

Weaving the knowledge tapestry'


-----Original Message-----
From: Chris Miles [mailto:chris_pg002@psychofx.com]
Sent: Wednesday, August 27, 2003 3:21 PM
To: Andrew Sullivan
Cc: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] postgresql and replication


Indeed, a free release of eRServer was released last night and is
available at
http://gborg.postgresql.org/project/erserver/download/download.php
There was an announcement sent to pgsql-announce also.

We will now be evaluating this to see if it is suitable for our
needs.

I spoke to PostgreSQL Inc last night and was informed that they will
be releasing their previous versions of eRServer to the open source
community 6-12 months after it has been replaced by the next
commercial version.  The commercial version is still sold, supported
and developed, and is currently at version 1.3.  The open source
version just released is a modified version of 1.2 basically.

Cheers,
Chris.

Andrew Sullivan wrote:
> On Tue, Aug 26, 2003 at 06:19:12PM +0100, Chris Miles wrote:
>>eRServer
>> http://www.erserver.com/
>> Commercial, looks professional.  Not free.
>> However, No trial or evaluation ?
>
> There's (about to be?) a free version available now.  If you start
> grovelling around on gborg some time late this afternoon (uh, EDT), I
> think you'll stumble on it.

--
Chris Miles
http://chrismiles.info/



---------------------------(end of broadcast)---------------------------
TIP 9: the planner will ignore your desire to choose an index scan if your
      joining column's datatypes do not match


Re: postgresql and replication

От
Andrew Sullivan
Дата:
On Tue, Sep 02, 2003 at 04:09:15PM +0530, Somasekhar Bangalore wrote:
> [javac]  total = 556,
> [javac]  name = /home/postgres/erserver/erserver_v1.2/java/lib/xerces.jar,
> [javac]  i = 1,
> [javac]  message = invalid LOC header (bad signature)

The xerces file is corrupt.  Justin Clift told me why -- I just need
to fix it.

You can get the xerces jar file independently for the time being if
need be.

A

--
----
Andrew Sullivan                         204-4141 Yonge Street
Liberty RMS                           Toronto, Ontario Canada
<andrew@libertyrms.info>                              M2P 2A8
                                         +1 416 646 3304 x110


Re: postgresql and replication

От
"Somasekhar Bangalore"
Дата:
Hi,

My installation went through fine but while setting up the ers_setup

 ers_setup --masterserver=servername --masterdb=accounts \
 --masteruser=someuser --masterpass=apasswd \
 --slaveserver=otherserver --slavedb=erp \
 --slaveuser=anotheruser --slavepass=foo

I am getting below error

Can't locate object method "connect" via package "DBI" (perhaps you forgot to load "DBI"?) at ./ers_setup line 73.

I would be very thankful if any one can give the solution.


Regards,
Somasekhar Bangalore
Principal Software Engineer
ZenSutra Software Technologies Pvt. Ltd.
Suite 601, HM Geneva House
#14, Cunningham Road
Bangalore 560-052, India

Ph:+91-80-235-0481
Fax:+91-80-235-0486
Email: sbangalore@zensutra.com

Weaving the knowledge tapestry'


-----Original Message-----
From: Andrew Sullivan [mailto:andrew@libertyrms.info]
Sent: Tuesday, September 02, 2003 4:53 PM
To: pgsql-admin@postgresql.org
Subject: Re: [ADMIN] postgresql and replication


On Tue, Sep 02, 2003 at 04:09:15PM +0530, Somasekhar Bangalore wrote:
> [javac]  total = 556,
> [javac]  name = /home/postgres/erserver/erserver_v1.2/java/lib/xerces.jar,
> [javac]  i = 1,
> [javac]  message = invalid LOC header (bad signature)

The xerces file is corrupt.  Justin Clift told me why -- I just need
to fix it.

You can get the xerces jar file independently for the time being if
need be.

A

--
----
Andrew Sullivan                         204-4141 Yonge Street
Liberty RMS                           Toronto, Ontario Canada
<andrew@libertyrms.info>                              M2P 2A8
                                         +1 416 646 3304 x110


---------------------------(end of broadcast)---------------------------
TIP 5: Have you checked our extensive FAQ?

               http://www.postgresql.org/docs/faqs/FAQ.html


Re: postgresql and replication

От
"Marc G. Fournier"
Дата:

On Tue, 2 Sep 2003, Somasekhar Bangalore wrote:

> Hi,
>
> My installation went through fine but while setting up the ers_setup
>
>  ers_setup --masterserver=servername --masterdb=accounts \
>  --masteruser=someuser --masterpass=apasswd \
>  --slaveserver=otherserver --slavedb=erp \
>  --slaveuser=anotheruser --slavepass=foo
>
> I am getting below error
>
> Can't locate object method "connect" via package "DBI" (perhaps you
> forgot to load "DBI"?) at ./ers_setup line 73.
>
> I would be very thankful if any one can give the solution.

do you have DBI installed?  and DBD::Pg?  Taking a look at the code, 'use
DBI' is right at the top, so there should be no reason to get that error
...


Re: postgresql and replication

От
hugo_rousse@club-internet.fr
Дата:
I am unable to find the adress to unsuscribe, could you please help me and give me that adress...
thanks for advance!!



----Message d'origine----
>Date: Tue, 2 Sep 2003 17:21:05 -0300 (ADT)
>De: "Marc G. Fournier" <scrappy@hub.org>
>A: Somasekhar Bangalore <sbangalore@zensutra.com>
>Copie à: Andrew Sullivan <andrew@libertyrms.info>,
>Sujet: Re: [ADMIN] postgresql and replication
>
>
>
>On Tue, 2 Sep 2003, Somasekhar Bangalore wrote:
>
>> Hi,
>>
>> My installation went through fine but while setting up the ers_setup
>>
>>  ers_setup --masterserver=servername --masterdb=accounts \
>>  --masteruser=someuser --masterpass=apasswd \
>>  --slaveserver=otherserver --slavedb=erp \
>>  --slaveuser=anotheruser --slavepass=foo
>>
>> I am getting below error
>>
>> Can't locate object method "connect" via package "DBI" (perhaps you
>> forgot to load "DBI"?) at ./ers_setup line 73.
>>
>> I would be very thankful if any one can give the solution.
>
>do you have DBI installed?  and DBD::Pg?  Taking a look at the code, 'use
>DBI' is right at the top, so there should be no reason to get that error
>....
>
>
>---------------------------(end of broadcast)---------------------------
>TIP 4: Don't 'kill -9' the postmaster
>
>


Re: postgresql and replication

От
Andrew Sullivan
Дата:
On Wed, Sep 03, 2003 at 12:25:09PM +0200, hugo_rousse@club-internet.fr wrote:
> I am unable to find the adress to unsuscribe, could you please help
> me and give me that adress... thanks for advance!!


http://gborg.postgresql.org/mailman/listinfo/erserver-general

(Sorry, I've been buried lately and I'm behind on my list responses.)

A

--
----
Andrew Sullivan                         204-4141 Yonge Street
Liberty RMS                           Toronto, Ontario Canada
<andrew@libertyrms.info>                              M2P 2A8
                                         +1 416 646 3304 x110