Re: User concurrency thresholding: where do I look?

От: Alvaro Herrera
Тема: Re: User concurrency thresholding: where do I look?
Дата: ,
Msg-id: 20070719173704.GA12084@alvh.no-ip.org
(см: обсуждение, исходный текст)
Ответ на: Re: User concurrency thresholding: where do I look?  (Tom Lane)
Ответы: Re: User concurrency thresholding: where do I look?  (Tom Lane)
Re: User concurrency thresholding: where do I look?  ("Joshua D. Drake")
Список: pgsql-performance

Скрыть дерево обсуждения

User concurrency thresholding: where do I look?  (Josh Berkus, )
 Re: User concurrency thresholding: where do I look?  ("Joshua D. Drake", )
 Re: User concurrency thresholding: where do I look?  (Alvaro Herrera, )
  Re: User concurrency thresholding: where do I look?  (Josh Berkus, )
   Re: User concurrency thresholding: where do I look?  (Tom Lane, )
    Re: User concurrency thresholding: where do I look?  (Alvaro Herrera, )
     Re: User concurrency thresholding: where do I look?  (Tom Lane, )
      Re: User concurrency thresholding: where do I look?  (Josh Berkus, )
       Re: User concurrency thresholding: where do I look?  (Tom Lane, )
        Re: User concurrency thresholding: where do I look?  (Josh Berkus, )
         Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
          Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
          Re: User concurrency thresholding: where do I look?  (Tom Lane, )
           Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
            Re: User concurrency thresholding: where do I look?  (Tom Lane, )
             Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
              Re: User concurrency thresholding: where do I look?  (Tom Lane, )
               Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                 Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                 Re: User concurrency thresholding: where do I look?  (David Boreham, )
                  Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                 Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                  Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                   Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                    Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                     Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                      Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                       Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                      Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                       Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                        Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                        Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                         Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                          Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                           Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                            Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                             Re: User concurrency thresholding: where do I look?  (Tom Lane, )
                              Re: User concurrency thresholding: where do I look?  (Robert Lor, )
                             Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                              Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                               Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                                Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                                 Re: User concurrency thresholding: where do I look?  (Alvaro Herrera, )
                                  Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                                 Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
                                  Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                                  Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                                   Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                                    Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                                  Re: User concurrency thresholding: where do I look?  (Josh Berkus, )
                                   Re: User concurrency thresholding: where do I look?  ("Jignesh K. Shah", )
                              CLOG Patch  ("Jignesh K. Shah", )
                               Re: CLOG Patch  ("Simon Riggs", )
                                Re: CLOG Patch  ("Jignesh K. Shah", )
                                 Re: CLOG Patch  ("Simon Riggs", )
                           Re: User concurrency thresholding: where do I look?  ("Simon Riggs", )
       Re: User concurrency thresholding: where do I look?  (Greg Smith, )
        Re: User concurrency thresholding: where do I look?  (Josh Berkus, )
     Re: User concurrency thresholding: where do I look?  ("Joshua D. Drake", )
    Re: User concurrency thresholding: where do I look?  (Gregory Stark, )
 Re: User concurrency thresholding: where do I look?  (Greg Smith, )

Tom Lane wrote:
> Josh Berkus <> writes:
> > Alvaro,
> >> Have you messed with max_connections and/or max_locks_per_transaction
> >> while testing this?  The lock table is sized to max_locks_per_xact times
> >> max_connections, and shared memory hash tables get slower when they are
> >> full.  Of course, the saturation point would depend on the avg number of
> >> locks acquired per user, which would explain why you are seeing a lower
> >> number for some users and higher for others (simpler/more complex
> >> queries).
>
> > That's an interesting thought.  Let me check lock counts and see if this is
> > possibly the case.
>
> AFAIK you'd get hard failures, not slowdowns, if you ran out of lock
> space entirely;

Well, if there still is shared memory available, the lock hash can
continue to grow, but it would slow down according to this comment in
ShmemInitHash:

 * max_size is the estimated maximum number of hashtable entries.  This is
 * not a hard limit, but the access efficiency will degrade if it is
 * exceeded substantially (since it's used to compute directory size and
 * the hash table buckets will get overfull).

For the lock hash tables this max_size is
(MaxBackends+max_prepared_xacts) * max_locks_per_xact.

So maybe this does not make much sense in normal operation, thus not
applicable to what Josh Berkus is reporting.

However I was talking to Josh Drake yesterday and he told me that
pg_dump was spending some significant amount of time in LOCK TABLE when
there are lots of tables (say 300k).

--
Alvaro Herrera                                http://www.CommandPrompt.com/
The PostgreSQL Company - Command Prompt, Inc.


В списке pgsql-performance по дате сообщения:

От: Greg Smith
Дата:
Сообщение: Re: User concurrency thresholding: where do I look?
От: "Carlos H. Reimer"
Дата:
Сообщение: Improving select peformance