Re: Adding pipe support to pg_dump and pg_restore

Hi,

On 2018-09-29 14:51:33 +0200, David Hedberg wrote:
> I recently wanted a way to encrypt/decrypt backups while still
> utilizing the parallel dump/restore functionality. I couldn't see a
> way to do this so I experimented a bit with the directory backup
> format. If there's in fact already a way to do this, please tell me
> now :-)
> 
> The idea is to add a --pipe option to pg_dump / pg_restore where you
> can specify a custom shell command that is used to write / read each
> .dat-file. Usage examples include encryption with pgp and/or custom
> compression pipelines. %p in the command is expanded to the path to
> write to / read from. The pipe command is not applied to the toc.
> 
> The current version is attached. Could something like this be
> acceptable for inclusion?

Isn't that a bit unsatisfying because information about the tables and
their sizes leaks?

My suspicion is, and was, that we're probably at some point are going to
want a format that supports the features the directory format does,
without requiring to write to multiple files...

- Andres