"Bort, Paul" <pbort@tmwsystems.com> writes:
> Andrew said I should solicit opinions as to what parameters to use. A
> cursory search through the archives led me to pick a scaling factor of
> 10, 5 users, and 100 transactions.
100 transactions seems barely enough to get through startup transients.
Maybe 1000 would be good.
I think the hard part of this is the reporting process. How do we
track how performance varies over time? It doesn't seem very useful
to compare different buildfarm members, but a longitudinal display of
performance on a single buildfarm machine over time would be cool.
(I'm still missing Mark Wong's daily OSDL performance reports :-()
Actually the $64 question here is whether we trust pgbench as the
standard performance test ...
regards, tom lane