One long transaction or multiple short transactions?

Поиск
Список
Период
Сортировка
Искать
От
Carlo
Тема
One long transaction or multiple short transactions?
Дата
Msg-id
003d01d0ffe4$9ae8f890$d0bae9b0$@stonebanks.ca
Список
Дерево обсуждения
One long transaction or multiple short transactions? "Carlo" <reg01@stonebanks.ca>
Re: One long transaction or multiple short transactions? Igor Neyman <ineyman@perceptron.com>
Re: One long transaction or multiple short transactions? "Carlo" <reg01@stonebanks.ca>
Re: One long transaction or multiple short transactions? Laurent Martelli <laurent.martelli@enercoop.org>
Re: One long transaction or multiple short transactions? "Graeme B. Bell" <graeme.bell@nibio.no>
Re: One long transaction or multiple short transactions? Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: One long transaction or multiple short transactions? Andres Freund <andres@anarazel.de>
Re: One long transaction or multiple short transactions? Jim Nasby <Jim.Nasby@BlueTreble.com>
Re: One long transaction or multiple short transactions? "Graeme B. Bell" <graeme.bell@nibio.no>
Re: One long transaction or multiple short transactions? "Carlo" <reg01@stonebanks.ca>
Re: One long transaction or multiple short transactions? "ktm@rice.edu" <ktm@rice.edu>
Re: One long transaction or multiple short transactions? "Carlo" <reg01@stonebanks.ca>
Re: One long transaction or multiple short transactions? "ktm@rice.edu" <ktm@rice.edu>

We have a system which is constantly importing flat file data feeds into normalized tables in a DB warehouse over 10-20 connections. Each data feed row results in a single transaction of multiple single row writes to multiple normalized tables.

 

The more columns in the feed row, the more write operations, longer the transaction.

 

Operators are noticing that splitting a single feed of say – 100 columns – into two consecutive feeds of 50 columns improves performance dramatically. I am wondering whether the multi-threaded and very busy import environment causes non-linear performance degradation for longer transactions. Would the operators be advised to rewrite the feeds to result in more smaller transactions rather than fewer, longer ones?

 

Carlo

В списке pgsql-performance по дате отправления
От: Igor Neyman
Дата:
От: FattahRozzaq
Дата:
FAQ