Обсуждение: [PERFORM] synchronization between PostgreSQL and Oracle

Поиск
Список
Период
Сортировка

[PERFORM] synchronization between PostgreSQL and Oracle

От
ROS Didier
Дата:

Hi

               I would like your advice  and recommendation about the following infrastructure problem :

What is the best way to optimize synchronization between an instance PostgreSQL on Windows 7 workstation and an Oracle 11gR2 database on linux RHEL  ?

Here are more detailed explanations

In our company we have people who collect data in a 9.6 postgresql instance on their workstation that is disconnected from the internet.

In the evening, they connect to the Internet and synchronize the collected data to a remote 11gr2 Oracle database.

What is the best performant way to do this ( Oracle_FDW ?, flat files ?, …)

 

Thanks in advance

 

Best Regards


Didier ROS
DSP/CSP IT-DMA/Solutions Groupe EDF/Expertise Applicative

Expertise SGBD
Mail : didier.ros@edf.fr

 


Ce message et toutes les pièces jointes (ci-après le 'Message') sont établis à l'intention exclusive des destinataires et les informations qui y figurent sont strictement confidentielles. Toute utilisation de ce Message non conforme à sa destination, toute diffusion ou toute publication totale ou partielle, est interdite sauf autorisation expresse.

Si vous n'êtes pas le destinataire de ce Message, il vous est interdit de le copier, de le faire suivre, de le divulguer ou d'en utiliser tout ou partie. Si vous avez reçu ce Message par erreur, merci de le supprimer de votre système, ainsi que toutes ses copies, et de n'en garder aucune trace sur quelque support que ce soit. Nous vous remercions également d'en avertir immédiatement l'expéditeur par retour du message.

Il est impossible de garantir que les communications par messagerie électronique arrivent en temps utile, sont sécurisées ou dénuées de toute erreur ou virus.
____________________________________________________

This message and any attachments (the 'Message') are intended solely for the addressees. The information contained in this Message is confidential. Any use of information contained in this Message not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval.

If you are not the addressee, you may not copy, forward, disclose or use any part of it. If you have received this message in error, please delete it and all copies from your system and notify the sender immediately by return message.

E-mail communication cannot be guaranteed to be timely secure, error or virus-free.

Вложения

Re: [PERFORM] synchronization between PostgreSQL and Oracle

От
Rick Otten
Дата:


On Thu, Oct 12, 2017 at 5:13 AM, ROS Didier <didier.ros@edf.fr> wrote:

Hi

               I would like your advice  and recommendation about the following infrastructure problem :

What is the best way to optimize synchronization between an instance PostgreSQL on Windows 7 workstation and an Oracle 11gR2 database on linux RHEL  ?

Here are more detailed explanations

In our company we have people who collect data in a 9.6 postgresql instance on their workstation that is disconnected from the internet.

In the evening, they connect to the Internet and synchronize the collected data to a remote 11gr2 Oracle database.

What is the best performant way to do this ( Oracle_FDW ?, flat files ?, …)



There are several ways to go about this, but for your use case I'd recommend SymmetricDS -- http://symmetricds.org   (or for the commercial version:  http://jumpmind.com)

SymmetricDS was originally designed to collect data from cash registers in a vastly distributed set of small databases and aggregate those results back into both regional and national data warehouses.  It also pushed data the other way - when pricing was updated at corporate headquarters, the data was pushed back into the cash registers.  It works with a wide variety of database technologies, scales well, and has many synchronization options.  It is also being used by some organizations these days to synchronize small databases on IOS and Android devices with their parent databases back at HQ.

I first used it to implement an Oracle to PostgreSQL data migration that had to be done without down time.   I've used it successfully for real time data pushes from MySQL and PG OLTP systems into an Oracle DataMart.   I also used to use it for PostgreSQL bidirectional replication before other tools became easier to use.  Because of its great flexibility, SymmetricDS has a ton of knobs to turn and buttons and configuration options and may take a bit to get it working optimally.   If you are short on time to implement a solution, I'd suggest going with the commercial version.



Re: [PERFORM] synchronization between PostgreSQL and Oracle

От
Laurenz Albe
Дата:
ROS Didier wrote:
>                I would like your advice  and recommendation about the following infrastructure problem :
> What is the best way to optimize synchronization between an instance PostgreSQL on Windows 7 workstation and an
Oracle11gR2 database on linux RHEL  ?
 
> Here are more detailed explanations
> In our company we have people who collect data in a 9.6 postgresql instance on their workstation that is disconnected
fromthe internet.
 
> In the evening, they connect to the Internet and synchronize the collected data to a remote 11gr2 Oracle database.
> What is the best performant way to do this ( Oracle_FDW ?, flat files ?, …)

If the synchronization is triggered from the workstation with
PostgreSQL on it, you can either use oracle_fdw or pg_dump/sql*loader
to transfer the data.

Using oracle_fdw is probably simpler, but it is not very performant
for bulk update operations.

If performance is the main objective, use export/import.

Yours,
Laurenz Albe



-- 
Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-performance