Re: Pooling in Core WAS: Need help in performance tuning.

От: Andres Freund
Тема: Re: Pooling in Core WAS: Need help in performance tuning.
Дата: ,
Msg-id: 20100724051350.GA22197@anarazel.de
(см: обсуждение, исходный текст)
Ответ на: Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas)
Список: pgsql-performance

Скрыть дерево обсуждения

Need help in performance tuning.  (Harpreet singh Wadhwa, )
 Re: Need help in performance tuning.  ("Kevin Grittner", )
 Re: Need help in performance tuning.  (Craig Ringer, )
  Re: Need help in performance tuning.  (Samuel Gendler, )
   Re: Need help in performance tuning.  (Tom Lane, )
    Re: Need help in performance tuning.  (Craig Ringer, )
     Re: Need help in performance tuning.  (Harpreet singh Wadhwa, )
     Re: Need help in performance tuning.  (Craig Ringer, )
     Re: Need help in performance tuning.  (Harpreet singh Wadhwa, )
      Re: Need help in performance tuning.  ("Jorge Montero", )
     Re: Need help in performance tuning.  (Bruce Momjian, )
    Re: Need help in performance tuning.  (Brad Nicholson, )
     Re: Need help in performance tuning.  ("Kevin Grittner", )
      Re: Need help in performance tuning.  (Matthew Wakeling, )
       Re: Need help in performance tuning.  ("Kevin Grittner", )
        Re: Need help in performance tuning.  (Matthew Wakeling, )
         Re: Need help in performance tuning.  ("Kevin Grittner", )
          Re: Need help in performance tuning.  ("Jorge Montero", )
           Re: Need help in performance tuning.  ("Kevin Grittner", )
         Re: Need help in performance tuning.  (Greg Smith, )
          Re: Need help in performance tuning.  ("Kevin Grittner", )
           Re: Pooling in Core WAS: Need help in performance tuning.  (Josh Berkus, )
            Re: Pooling in Core WAS: Need help in performance tuning.  (Craig Ringer, )
             Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
              Re: Pooling in Core WAS: Need help in performance tuning.  (Josh Berkus, )
               Re: Pooling in Core WAS: Need help in performance tuning.  (Tom Lane, )
                Re: Pooling in Core WAS: Need help in performance tuning.  (Matthew Wakeling, )
                 Re: Pooling in Core WAS: Need help in performance tuning.  (Craig Ringer, )
                  Re: Pooling in Core WAS: Need help in performance tuning.  ("Kevin Grittner", )
                   Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Greg Smith, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )
                       Re: Pooling in Core WAS: Need help in performance tuning.  (Tatsuo Ishii, )
                        Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )
                         Re: Pooling in Core WAS: Need help in performance tuning.  (Tatsuo Ishii, )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                  Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                  Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                   Re: Pooling in Core WAS: Need help in performance tuning.  (Andres Freund, )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  (Tom Lane, )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                       Re: Pooling in Core WAS: Need help in performance tuning.  (Tom Lane, )
                        Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                         Re: Pooling in Core WAS: Need help in performance tuning.  (Tom Lane, )
                        Re: Pooling in Core WAS: Need help in performance tuning.  (Vitalii Tymchyshyn, )
                        Re: Pooling in Core WAS: Need help in performance tuning.  (Josh Berkus, )
                         Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                          Re: Pooling in Core WAS: Need help in performance tuning.  (Tom Lane, )
                           Re: Pooling in Core WAS: Need help in performance tuning.  (Andres Freund, )
                           Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                            Re: Pooling in Core WAS: Need help in performance tuning.  (Josh Berkus, )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Craig Ringer, )
                  Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                   Re: Pooling in Core WAS: Need help in performance tuning.  ("Joshua D. Drake", )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  ("Joshua D. Drake", )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  ("Joshua D. Drake", )
                   Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                       Re: Pooling in Core WAS: Need help in performance tuning.  (Andres Freund, )
                       Re: Pooling in Core WAS: Need help in performance tuning.  (Craig Ringer, )
                        Re: Pooling in Core WAS: Need help in performance tuning.  (Robert Haas, )
                   Re: Pooling in Core WAS: Need help in performance tuning.  (Scott Carey, )
                    Re: Pooling in Core WAS: Need help in performance tuning.  (Joshua Tolley, )
                     Re: Pooling in Core WAS: Need help in performance tuning.  (Greg Smith, )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Andres Freund, )
                      Re: Pooling in Core WAS: Need help in performance tuning.  (Craig Ringer, )
                       Re: Pooling in Core WAS: Need help in performance tuning.  (Dimitri Fontaine, )
                       Re: Pooling in Core WAS: Need help in performance tuning.  (Hannu Krosing, )
                   Re: Pooling in Core WAS: Need help in performance tuning.  ("Joshua D. Drake", )
                Re: Pooling in Core WAS: Need help in performance tuning.  (Dimitri Fontaine, )
                 Re: Pooling in Core WAS: Need help in performance tuning.  (Magnus Hagander, )
             Re: Pooling in Core WAS: Need help in performance tuning.  (Scott Carey, )
            Re: Pooling in Core WAS: Need help in performance tuning.  (Samuel Gendler, )
          Re: Need help in performance tuning.  (Jesper Krogh, )
           Re: Need help in performance tuning.  (Greg Smith, )
            Re: Need help in performance tuning.  ("Pierre C", )
     Re: Need help in performance tuning.  (Mark Kirkwood, )
    Re: Need help in performance tuning.  (Robert Haas, )
    Re: Need help in performance tuning.  (Hannu Krosing, )
     Re: Need help in performance tuning.  (Scott Marlowe, )
      Re: Need help in performance tuning.  ("Kevin Grittner", )
       Re: Need help in performance tuning.  (Hannu Krosing, )
 Re: Pooling in Core WAS: Need help in performance tuning.  (Rajesh Kumar Mallah, )

On Fri, Jul 23, 2010 at 01:28:53PM -0400, Robert Haas wrote:
> On Fri, Jul 23, 2010 at 11:58 AM, Hannu Krosing <> wrote:
> > On Thu, 2010-07-22 at 20:57 -0400, Robert Haas wrote:
> >> On Thu, Jul 22, 2010 at 3:15 PM, Hannu Krosing <> wrote:
> >> > On Thu, 2010-07-22 at 14:36 -0400, Robert Haas wrote:
> >> >> On Mon, Jul 12, 2010 at 6:58 AM, Craig Ringer
> >> >> <> wrote:
> >> >> > So rather than asking "should core have a connection pool" perhaps
> >> >> > what's needed is to ask "what can an in-core pool do that an external
> >> >> > pool cannot do?"
> >> >>
> >> >> Avoid sending every connection through an extra hop.
> >> >
> >> > not really. in-core != magically-in-right-backend-process
> >>
> >> Well, how about if we arrange it so it IS in the right backend
> >> process?  I don't believe magic is required.
> >
> > Do you have any design in mind, how you can make it so ?
>
> Well, if we could change the backends so that they could fully
> reinitialize themselves (disconnect from a database to which they are
> bound, etc.), I don't see why we couldn't use the Apache approach.
> There's a danger of memory leaks but that's why Apache has
> MaxRequestsPerChild, and it works pretty darn well.  Of course,
> passing file descriptors would be even nicer (you could pass the
> connection off to a child that was already bound to the correct
> database, perhaps) but has pointed out more than once, that's not
> portable.
Its not *that bad* though. To my knowledge its 2 or 3 implementations that
one would need to implement to support most if not all platforms.

- sendmsg/cmsg/SCM_RIGHTS based implementation (most if not all *nixes
  including solaris, linux, (free|open|net)bsd, OSX, AIX, HPUX, others)
- WSADuplicateSocket (windows)
- if needed: STREAMS based stuff (I_SENDFD) (at least solaris,  hpux, aix, tru64,
  irix, unixware allow this)


Note that I am still not convinced that its a good idea...

Andres


В списке pgsql-performance по дате сообщения:

От: david@lang.hm
Дата:
Сообщение: Re: Testing Sandforce SSD
От: Torsten Zühlsdorff
Дата:
Сообщение: Re: Using more tha one index per table