Re: Multiple COPY on the same table

Поиск
Список
Период
Сортировка
Искать
От
Adrian Klaver
Тема
Re: Multiple COPY on the same table
Дата
Msg-id
c51bbe16-8cb5-6e8b-4ba8-f00ee44b1c63@aklaver.com
Ответ на
Список
Дерево обсуждения
Multiple COPY on the same table Ravi Krishna <sravikrishna@aol.com>
Re: Multiple COPY on the same table Nicolas Paris <nicolas.paris@riseup.net>
Re: Multiple COPY on the same table Adrian Klaver <adrian.klaver@aklaver.com>
Re: Multiple COPY on the same table Christopher Browne <cbbrowne@gmail.com>
Re: [External] Multiple COPY on the same table Vijaykumar Jain <vjain@opentable.com>
Re: [External] Multiple COPY on the same table Ron <ronljohnsonjr@gmail.com>
On 08/20/2018 08:56 AM, Nicolas Paris wrote:
>> Can I split a large file into multiple files and then run copy using
>> each file.
> 
> AFAIK, copy command locks the table[1] while there is no mention of this
> in the documentation[2].

[1] Is from Postgres 7.1(17 years ago). I suspect the conditions have 
changed at least a little:).

> 
>>   Will the performance boost by close to 4x??
> 
> You might be interested in the pbBulkInsert tool[3] that allows parallel
> copy with some succes accordingly to benchmarks. However, that tool does
> not handle multiline csv. Because of that limitation I have been using
> the standard copy command with binary format with some succes.
> 
> 
> [1] https://grokbase.com/t/postgresql/pgsql-general/01597pv3qs/copy-locking
> [2] https://www.postgresql.org/docs/current/static/sql-copy.html
> [3] https://github.com/bytefish/PgBulkInsert
> 
> 


-- 
Adrian Klaver
adrian.klaver@aklaver.com

В списке pgsql-general по дате отправления
От: Stephen Frost
Дата:
От: Zhiquan Simon Sui
Дата:
Сообщение: Question about replication
FAQ