Re: Inserting 8MB bytea: just 25% of disk perf used?

Поиск
Список
Период
Сортировка
Искать
От
fkater@googlemail.com
Тема
Re: Inserting 8MB bytea: just 25% of disk perf used?
Дата
Msg-id
20100118160420.GF2913@comppasch2
Список
Дерево обсуждения
Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Aidan Van Dyk <aidan@highrise.ca>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "Fernando Hevia" <fhevia@ip-tel.com.ar>
Re: Inserting 8MB bytea: just 25% of disk perf used? Matthew Wakeling <matthew@flymine.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Ivan Voras <ivoras@freebsd.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Ivan Voras <ivoras@freebsd.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? Scott Carey <scott@richrelevance.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "Kevin Grittner" <Kevin.Grittner@wicourts.gov>
Re: Inserting 8MB bytea: just 25% of disk perf used? Richard Huxton <dev@archonet.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Scott Carey <scott@richrelevance.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Florian Weimer <fweimer@bfk.de>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Florian Weimer <fweimer@bfk.de>
Re: Inserting 8MB bytea: just 25% of disk perf used? Matthew Wakeling <matthew@flymine.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Matthew Wakeling <matthew@flymine.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Florian Weimer <fweimer@bfk.de>
Re: Inserting 8MB bytea: just 25% of disk perf used? Merlin Moncure <mmoncure@gmail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Dave Crooke <dcrooke@gmail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Ivan Voras <ivoras@freebsd.org>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? "fkater@googlemail.com" <fkater@googlemail.com>
Re: Inserting 8MB bytea: just 25% of disk perf used? Magnus Hagander <magnus@hagander.net>
Re: Inserting 8MB bytea: just 25% of disk perf used? Pierre Frédéric Caillaud<lists@peufeu.com>
Hannu Krosing:

> did you also test this with fsync=off ?

Yes. No significant difference.


> I suspect that what you are seeing is the effect of randomly writing to
> the index files. While sequential write performance can be up to
> 80MB/sec on modern drives, sequential writes are an order of magnitude
> slower. And at your data sizes you are very likely to hit a 
> CHECKPOINT, which needs to do some random writes.

Yes, from the server log I noticed that I hit checkpoints
too early and too often. I tried the astronomical value of
1000 for checkpoint_segments to not hit a single one for the
whole test run (copying 800 MB) -- even though that is no
good idea in practice of course.

It took even longer then. Probably because the server
created a lot of 16 MB log files (about 300 in my case)
which is presumly more costy (at least for the first run?)
than overwriting existing files. I am not too much into
that, though, since this is not a solution anyway on the
long run IMHO.

Thanks again.

 Felix
 

В списке pgsql-performance по дате отправления
От: fkater@googlemail.com
Дата:
От: fkater@googlemail.com
Дата:
FAQ