От: Mark Kirkwood
Тема: Re: Raid 10 chunksize
Дата: ,
Msg-id: 49D321C1.1000405@paradise.net.nz
(см: обсуждение, исходный текст)
Ответ на: Re: Raid 10 chunksize  (Scott Carey)
Ответы: Re: Raid 10 chunksize  (Mark Kirkwood)
Список: pgsql-performance

Скрыть дерево обсуждения

Raid 10 chunksize  (Mark Kirkwood, )
 Re: Raid 10 chunksize  (Scott Carey, )
  Re: Raid 10 chunksize  (David Rees, )
   Re: Raid 10 chunksize  (Greg Smith, )
 Re: Raid 10 chunksize  (Scott Marlowe, )
  Re: Raid 10 chunksize  (Mark Kirkwood, )
   Re: Raid 10 chunksize  (Jerry Champlin, )
   Re: Raid 10 chunksize  (Mark Kirkwood, )
    Re: Raid 10 chunksize  (Scott Carey, )
     Re: Raid 10 chunksize  (Mark Kirkwood, )
      Re: Raid 10 chunksize  (Mark Kirkwood, )
 Re: Raid 10 chunksize  (Greg Smith, )
  Re: Raid 10 chunksize  (Scott Carey, )
   Re: Raid 10 chunksize  (Merlin Moncure, )
    Re: Raid 10 chunksize  (Scott Carey, )
     Re: Raid 10 chunksize  (Merlin Moncure, )
     Re: Raid 10 chunksize  (Scott Carey, )
  Re: Raid 10 chunksize  (Mark Kirkwood, )
   Re: Raid 10 chunksize  (Greg Smith, )
    Re: Raid 10 chunksize  (Mark Kirkwood, )
 Re: Raid 10 chunksize  (Stef Telford, )
  Re: Raid 10 chunksize  (Mark Kirkwood, )
   Re: Raid 10 chunksize  (Scott Carey, )
    Re: Raid 10 chunksize  (Scott Carey, )
     Re: Raid 10 chunksize  (Mark Kirkwood, )
      Re: Raid 10 chunksize  (Stef Telford, )
       Re: Raid 10 chunksize  (Greg Smith, )
        Re: Raid 10 chunksize  (Stef Telford, )
         Re: Raid 10 chunksize  (Scott Marlowe, )
          Re: Raid 10 chunksize  (Stef Telford, )
           Re: Raid 10 chunksize  (Scott Marlowe, )
            Re: Raid 10 chunksize  (Greg Smith, )
             Re: Raid 10 chunksize  (Matthew Wakeling, )
              Re: Raid 10 chunksize  (Scott Marlowe, )
            Re: Raid 10 chunksize  (Scott Carey, )
             Re: Raid 10 chunksize  (, )
             Re: Raid 10 chunksize  (Scott Marlowe, )
           Re: Raid 10 chunksize  (Matthew Wakeling, )
            Re: Raid 10 chunksize  (Scott Marlowe, )
            Re: Raid 10 chunksize  (Stef Telford, )
            Re: Raid 10 chunksize  (Scott Carey, )
          Re: Raid 10 chunksize  (Matthew Wakeling, )
         Re: Raid 10 chunksize  (Scott Carey, )
          Re: Raid 10 chunksize  (Greg Smith, )
           Re: Raid 10 chunksize  (James Mansion, )
            Re: Raid 10 chunksize  (Greg Smith, )
           Re: Raid 10 chunksize  (Scott Carey, )
            Re: Raid 10 chunksize  (Greg Smith, )
           Re: Raid 10 chunksize  (Ron Mayer, )
            Re: Raid 10 chunksize  (Hannes Dorbath, )
       Re: Raid 10 chunksize  (Stef Telford, )
        Re: Raid 10 chunksize  (Stef Telford, )
         Re: Raid 10 chunksize  (Scott Carey, )
       Re: Raid 10 chunksize  (Mark Kirkwood, )
      Re: Raid 10 chunksize  (, )
       Re: Raid 10 chunksize  (, )
 Re: Raid 10 chunksize  (Greg Smith, )
  Re: Raid 10 chunksize  (, )
   Re: Raid 10 chunksize  (Greg Smith, )
   Re: Raid 10 chunksize  (Scott Carey, )

Scott Carey wrote:
> On 3/25/09 9:28 PM, "Mark Kirkwood" <> wrote:
>
>
>>
>> Rebuilt with 64K chunksize:
>>
>> transaction type: TPC-B (sort of)
>> scaling factor: 100
>> number of clients: 24
>> number of transactions per client: 12000
>> number of transactions actually processed: 288000/288000
>> tps = 866.512162 (including connections establishing)
>> tps = 866.651320 (excluding connections establishing)
>>
>>
>> So 64K looks quite a bit better. I'll endeavor to try out 256K next week
>> too.
>>
>
> Just go all the way to 1MB, md _really_ likes 1MB chunk sizes for some
> reason.  Benchmarks right and left on google show this to be optimal.  My
> tests with md raid 0 over hardware raid 10's ended up with that being
> optimal as well.
>
> Greg's notes on aligning partitions to the chunk are key as well.
>
>
Rebuilt with 256K chunksize:

transaction type: TPC-B (sort of)
scaling factor: 100
number of clients: 24
number of transactions per client: 12000
number of transactions actually processed: 288000/288000
tps = 942.852104 (including connections establishing)
tps = 943.019223 (excluding connections establishing)


A noticeable improvement again. I'm not sure that we will have time (or
patience from the system guys that I keep bugging to redo the raid
setup!) to try 1M, but 256K gets us 40% or so improvement over the
original 4K setup  - which is quite nice!

Looking on the net for md raid benchmarks, it is not 100% clear to me
that 1M is the overall best - several I found had tested sizes like 64K,
128K, 512K, 1M and concluded that 1M was best - but without testing
256K! whereas others had included ranges <=512K and decided that that
256K was the best. I'd be very interested in seeing your data! (several
years ago I had carried out this type of testing - on a different type
of machine, and for a different database vendor, but found that 256K
seemed to give the overall best result).

The next step is to align the raid 10 partitions, as you and Greg
suggest and see what effect that has!

Thanks again

Mark


В списке pgsql-performance по дате сообщения:

От: Robert Haas
Дата:
Сообщение: Re: PostgreSQL
От: Stef Telford
Дата:
Сообщение: Re: Raid 10 chunksize