Re: Exposing the stats snapshot timestamp to SQL

Поиск
Список
Период
Сортировка
От Matt Kelly
Тема Re: Exposing the stats snapshot timestamp to SQL
Дата
Msg-id CA+KcUkgWTO454zbfDn4PgwDVhbfCFXcXgw1kZO9z2nHTdsVt7Q@mail.gmail.com
обсуждение исходный текст
Ответ на Re: Exposing the stats snapshot timestamp to SQL  (Tom Lane <tgl@sss.pgh.pa.us>)
Ответы Re: Exposing the stats snapshot timestamp to SQL  (Tom Lane <tgl@sss.pgh.pa.us>)
Список pgsql-hackers
Yeah.  The only use-case that's been suggested is detecting an
unresponsive stats collector, and the main timestamp should be plenty for
that.
Lately, I've spent most of my time doing investigation into increasing qps.  Turned out we've been able to triple our throughput by monitoring experiments at highly granular time steps (1 to 2 seconds).  Effects that were invisible with 30 second polls of the stats were obvious with 2 second polls.

The problem with doing highly granular snapshots is that the postgres counters are monotonically increasing, but only when stats are published.  Currently you have no option except to divide by the delta of now() between the polling intervals. If you poll every 2 seconds the max error is about .5/2 or 25%.  It makes reading those numbers a bit noisy.  Using (snapshot_timestamp_new - snapshot_timestamp_old) as the denominator in that calculation should help to smooth out that noise and show a clearer picture.

However, I'm happy with the committed version. Thanks Tom.

- Matt K.


On Thu, Feb 19, 2015 at 9:40 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
Matt Kelly <mkellycs@gmail.com> writes:
> Attached is the fixed version. (hopefully with the right mime-type and
> wrong extension.  Alas, gmail doesn't let you set mime-types; time to find
> a new email client...)

Committed with a couple of changes:

* I changed the function name from pg_stat_snapshot_timestamp to
pg_stat_get_snapshot_timestamp, which seemed to me to be the style
in general use in the stats stuff for inquiry functions.

* The function should be marked stable not volatile, since its value
doesn't change any faster than all the other stats inquiry functions.

                        regards, tom lane

В списке pgsql-hackers по дате отправления:

Предыдущее
От: Tom Lane
Дата:
Сообщение: Re: Exposing the stats snapshot timestamp to SQL
Следующее
От: David Steele
Дата:
Сообщение: Re: Allow "snapshot too old" error, to prevent bloat