Re: Inserting 8MB bytea: just 25% of disk perf used?

Поиск
Список
Период
Сортировка
Искать
От
Florian Weimer
Тема
Re: Inserting 8MB bytea: just 25% of disk perf used?
Дата
Msg-id
82hbqnkd7a.fsf@mid.bfk.de
Ответ на
Список
Дерево обсуждения
Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Aidan Van Dyk <aidan@highrise.ca>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "Fernando Hevia" <fhevia@ip-tel.com.ar>
Re: Inserting 8MB bytea: just 25% of disk perf used? Matthew Wakeling <matthew@flymine.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Ivan Voras <ivoras@freebsd.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Ivan Voras <ivoras@freebsd.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? Scott Carey <scott@richrelevance.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "Kevin Grittner" <Kevin.Grittner@wicourts.gov>
Re: Inserting 8MB bytea: just 25% of disk perf used? Richard Huxton <dev@archonet.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Scott Carey <scott@richrelevance.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Florian Weimer <fweimer@bfk.de>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Florian Weimer <fweimer@bfk.de>
Re: Inserting 8MB bytea: just 25% of disk perf used? Matthew Wakeling <matthew@flymine.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Matthew Wakeling <matthew@flymine.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Florian Weimer <fweimer@bfk.de>
Re: Inserting 8MB bytea: just 25% of disk perf used? Merlin Moncure <mmoncure@gmail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Dave Crooke <dcrooke@gmail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Ivan Voras <ivoras@freebsd.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Magnus Hagander <magnus@hagander.net>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
> Florian Weimer:
>
>> > Do you have any further idea why 16MB/s seems to be the limit here?
>> 
>> BYTEA deserialization is very slow, and this could be a factor here.
>> Have you checked that you are in fact I/O bound?
>
> Could you elaborate that a bit? It sounds interesting but I
> do not get what you mean by:
>
> "bytea deserialization": Do you mean from an escaped string
> back to real binary data?

Yes, that is what I meant.

> Does that apply to my case (I use PGexecParam and have the Format
> arg set to 1, binary) ?

Yes, this was my suggestion.  There is probably some other issue,
then.

> "I/O bound": What do you mean by that?

You should check (presumably using the Windows performance monitoring
tools, but I'm not familiar with Windows) if the PostgreSQL process is
indeed waiting on disk I/O.

-- 
Florian Weimer                
BFK edv-consulting GmbH       http://www.bfk.de/
Kriegsstraße 100              tel: +49-721-96201-1
D-76133 Karlsruhe             fax: +49-721-96201-99
В списке pgsql-performance по дате отправления
От: Carlo Stonebanks
Дата:
От: Pierre Frédéric Caillaud
Дата:
FAQ