We are attempting to extract one of our database from Amazon RDS Aurora/Postgres to another PostgreSQL cluster that is running directly on EC2 instances.
This particular database is currently about 3.5TB.
We are sensitive to this database being down for an extended period of time as it will adversely impact some subsystems within our application. We're hoping to find a means to migrate within a 4 hour window. We've tried multiple approaches:
- Using Amazon DMS to copy the data
- despite doing parallelization, the total time would be around 89 hours
- Using FiveTran (great tool!) to copy data
- using this tool was that it would take about 86 hours to complete.
- Using a database dump and restore
- Doing a backup from RDS's replica fails, due to holding a database lock for too long.
The ideal situation would be to have a streaming replica from Amazon RDS, but you can only create a replica that is hosted by AWS, and have no access to the WAL logs...
Wondering if any of the other members of this LISTSERV have tried migrating their data off of Amazon RDS Aurora Postgres with success.
Thanks in advance for any pointers,
Bill