Re: Performance Enhancement/Fix for Array Utility Functions

Поиск
Список
Период
Сортировка
От Mike Lewis
Тема Re: Performance Enhancement/Fix for Array Utility Functions
Дата
Msg-id l2t948ce0b71003310208p10a87732h33f196687b1473f@mail.gmail.com
обсуждение исходный текст
Ответ на Performance Enhancement/Fix for Array Utility Functions  (Mike Lewis <mikelikespie@gmail.com>)
Ответы Re: Performance Enhancement/Fix for Array Utility Functions  (Robert Haas <robertmhaas@gmail.com>)
Список pgsql-hackers
Woops. I sent the wrong patch. My apologies.  Attached is the real
patch.  Sorry, also forgot this is made against 9.0 alpha 4 tag.

Thanks,
Mike

--
Michael Lewis
lolrus.org
mikelikespie@gmail.com



On Wed, Mar 31, 2010 at 12:39 AM, Mike Lewis <mikelikespie@gmail.com> wrote:
> I noticed while doing work with very large arrays that several
> functions such as array_length detoast the entire array instead of
> only what is required.
>
> I found the solution to be just unpacking the header portion of the
> array and ignoring the rest.  Since the header (including the
> dimensions) is variable length, I just unpack the size of what the
> header would be if it had MAXDIM dimensions. (Patch is attached)
>
> I made a test case to demonstrate performance gains (watch out, it
> creates a big table):
>
> create temporary table foo as
>        select array_agg(i) as a
>        from (
>                select generate_series(1,10000000) as i) as bar;
> \timing
> select array_length(a, 1) from foo; -- Run a few times.  First time will be cold
>
> Results (after warming up)
>
> Before patch:
> Time: 6.251 ms
> Time: 6.078 ms
> Time: 5.983 ms
>
> After patch:
> Time: 0.401 ms
> Time: 0.397 ms
> Time: 0.441 ms
> ...
>
> --
> Michael Lewis
> lolrus.org
> mikelikespie@gmail.com
>

Вложения

В списке pgsql-hackers по дате отправления:

Предыдущее
От: Simon Riggs
Дата:
Сообщение: Re: pending patch: Re: HS/SR and smart shutdown
Следующее
От: Fujii Masao
Дата:
Сообщение: Re: pending patch: Re: HS/SR and smart shutdown