Creating a correct and real benchmark

От:

Marcos <mjs_ops@gmx.net>

Дата:

20 февраля 2006 г. в 08:57:36

Hi, 

I'm developing a search engine using the postgresql's databas. I've
already doing some tunnings looking increase the perform. 

Now, I'd like of do a realistic test of perfom with number X of queries
for know the performance with many queries. 

What the corret way to do this? 

Thanks.

Re: Creating a correct and real benchmark

От:

Marcos <mjs_ops@gmx.net>

Дата:

24 февраля 2006 г. в 16:06:32

Thanks for advises :-D.

Marcos

Re: Creating a correct and real benchmark

От:

Chris <dmagick@gmail.com>

Дата:

20 февраля 2006 г. в 20:21:51

PFC wrote:
> 
>> I'm developing a search engine using the postgresql's databas. I've
>> already doing some tunnings looking increase the perform.
>>
>> Now, I'd like of do a realistic test of perfom with number X of queries
>> for know the performance with many queries.
>>
>> What the corret way to do this?
> 
> 
> 
>     I guess the only way to know how it will perform with your own  
> application is to benchmark it with queries coming from your own  
> application. You can create a test suite with a number of typical 
> queries  and use your favourite scripting language to spawn a number of 
> threads and  hammer the database. I find it interesting to measure the 
> responsiveness  of the server while torturing it, simply by measuring 
> the time it takes to  respond to a simple query and graphing it. Also 
> you should not have N  threads issue the exact same queries, because 
> then you will hit a too  small dataset. Introduce some randomness in the 
> testing, for instance.  Benchmarking from another machine makes sure the 
> test client's CPU usage  is not a part of the problem.

The other advice on top of this is don't just import a small amount of data.

If your application is going to end up with 200,000 rows - then test 
with 200,000 rows or more so you know exactly how it will handle under 
"production" conditions.

Re: Creating a correct and real benchmark

От:

PFC <lists@peufeu.com>

Дата:

20 февраля 2006 г. в 20:13:50


> I'm developing a search engine using the postgresql's databas. I've
> already doing some tunnings looking increase the perform.
>
> Now, I'd like of do a realistic test of perfom with number X of queries
> for know the performance with many queries.
>
> What the corret way to do this?


	I guess the only way to know how it will perform with your own  
application is to benchmark it with queries coming from your own  
application. You can create a test suite with a number of typical queries  
and use your favourite scripting language to spawn a number of threads and  
hammer the database. I find it interesting to measure the responsiveness  
of the server while torturing it, simply by measuring the time it takes to  
respond to a simple query and graphing it. Also you should not have N  
threads issue the exact same queries, because then you will hit a too  
small dataset. Introduce some randomness in the testing, for instance.  
Benchmarking from another machine makes sure the test client's CPU usage  
is not a part of the problem.