Re: pg_autovacuum w/ dbt2

The overall throughput is better for a run like this:http://www.osdl.org/projects/dbt2dev/results/dev4-010/207/

A drop from 3865 to 2679 (31%) by just adding pg_autovacuum.  That's
what I meant by "not good". :)

I'll start with the additional debug messages, with 8.0rc2, before
I start changing the other settings, if that sounds good.

Mark

On Tue, Dec 21, 2004 at 02:33:57PM -0500, Matthew T. O'Connor wrote:
> Mark Wong wrote:
> 
> >After all this time I finally got around to vacuuming the database
> >with dbt2 with pg_autovacuum. :)
> >    http://www.osdl.org/projects/dbt2dev/results/dev4-010/215/
> >  
> >
> Thanks!
> 
> >Doesn't look so good though, probably because I'm not using optimal
> >settings with pg_autovacuum.  So far I have only tried the default
> >settings (running without any arguments, except -D).
> >  
> >
> I don't know what you mean by "Not Good" since I don't have graphs from 
> a similar test without pg_autovacuum handy.  Do you have a link to such 
> a test?
>
> As for better pg_autovacuum settings, It appears that the little 
> performance dips are happening about once every 5 minutes, which if I 
> remember correctly is the default sleep time.  You might try playing 
> with the lazy vacuum settings to see if that smooths out the curve.  
> Beyond that all you can do is play with the thresholds to see if there 
> is a better sweet spot than the defaults (which by the way I have no 
> confidence in, they were just conservative guesses)
> 
> >The only thing that's peculiar is a number of unexpected rollbacks
> >across all of the transactions.  I suspect it was something to do with
> >these messages coming from pg_autovacuum:
> >
> >[2004-12-20 15:48:18 PST] ERROR:   Can not refresh statistics information from the database dbt2.
> >[2004-12-20 15:48:18 PST]          The error is [ERROR:  failed to re-find parent key in "pk_district"
> >]
> >  
> >
> Not sure what this is all about, but if you turn up the debug level to 4 
> or greater (pg_autovacuum -d4), pg_autovacuum will log the query that is 
> causing the problems, that would be helpful output to have.
> 
> >This is with 8.0rc1.  I can get rc2 installed since it just came out.
> >So let me know what I can try and what not.
> >  
> >
> I don't think anything has changed for pg_autovacuum between rc1 and rc2.
> 
> 
> thanks again for the good work!!!