Re: Upgrade to dual processor machine?

hi,

thanks for this information...

we are allready using squid as a transpartent www-accelerator,
this works very well and squid handles about 70 % out of all hits.

However, sometimes some search engines use to start
indexing more than 25 DIFFERENT documents per second, this is when things
start getting more difficult .... we have played around a little
with an ip-based bandwidth-regulation tool at squid-level, which
works quite well - though you'll have to add new search-engines
on demand.

But anyway - we still have to look at the facts: we have had a 200 %
increase of visitors and pageviews during the last 6 months.

Upgrading to DBI:pg is something I have been thinking about allready,
but as far as I know, I am allready using persistent connections with
mod_perl and Pg.pm, am I not???!

--

Mit freundlichem Gruß

Henrik Steffen
Geschäftsführer

top concepts Internetmarketing GmbH
Am Steinkamp 7 - D-21684 Stade - Germany
--------------------------------------------------------
http://www.topconcepts.com          Tel. +49 4141 991230
mail: steffen@topconcepts.com       Fax. +49 4141 991233
--------------------------------------------------------
24h-Support Hotline:  +49 1908 34697 (EUR 1.86/Min,topc)
--------------------------------------------------------
Ihr SMS-Gateway: JETZT NEU unter: http://sms.city-map.de
System-Partner gesucht: http://www.franchise.city-map.de
--------------------------------------------------------
Handelsregister: AG Stade HRB 5811 - UstId: DE 213645563
--------------------------------------------------------

----- Original Message -----
From: "Shaun Thomas" <sthomas@townnews.com>
To: "Henrik Steffen" <steffen@city-map.de>
Cc: "Justin Clift" <justin@postgresql.org>; <pgsql-general@postgresql.org>
Sent: Monday, November 11, 2002 7:08 PM
Subject: Re: [GENERAL] Upgrade to dual processor machine?


> On Mon, 11 Nov 2002, Henrik Steffen wrote:
>
> > > - How many clients simultaneously connecting to it?
> > one webserver with max. 50 instances, approximately 10.000 users a day,
> > about 150.000 Pageviews daily. All pages are created on the fly using
> > mod_perl connecting to the db-server.
>
> Aha.  What kind of web-side data caching are you doing?  That alone can
> drop your load down to < 1.  Even something like a 1-hour cache, or
> something you can manually expire can work amazing wonders for database
> usage.  So far, the only thing we've found that doesn't really fit this
> model are full text searches.
>
> Here, the biggest difference to our DB server was caused by *not* having
> all of our 9 webservers doing 50+ connections per second, which we
> achieved mainly through caching.  Adding another CPU will work as well,
> but as far as a long-term, not just throwing hardware at the problem
> kind of solution goes, see if you can get caching worked in there
> somehow.
>
> Since you know you're using Pg.pm (switch to DBI::pg, trust me on this
> one), you should have little problem either caching your result set or
> even the whole resulting page with select non-cachable parts.  Not only
> will that reduce page-load time, but the strain on your database as
> well.
>
> --
> Shaun M. Thomas                INN Database Administrator
> Phone: (309) 743-0812          Fax  : (309) 743-0830
> Email: sthomas@townnews.com    Web  : www.townnews.com
>