Re: WIP: Faster Expression Processing v4

Поиск
Список
Период
Сортировка
Искать
От
Tom Lane
Тема
Re: WIP: Faster Expression Processing v4
Дата
Msg-id
7806.1490382448@sss.pgh.pa.us
Ответ на
Список
Дерево обсуждения
WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
[HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Alvaro Herrera <alvherre@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Konstantin Knizhnik <k.knizhnik@postgrespro.ru>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Alvaro Herrera <alvherre@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Heikki Linnakangas <hlinnaka@iki.fi>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Heikki Linnakangas <hlinnaka@iki.fi>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Douglas Doole <dougdoole@gmail.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Douglas Doole <dougdoole@gmail.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Ants Aasma <ants.aasma@eesti.ee>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andreas Karlsson <andreas@proxel.se>
Re: [HACKERS] WIP: Faster Expression Processing v4 Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Bruce Momjian <bruce@momjian.us>
Re: [HACKERS] WIP: Faster Expression Processing v4 Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing v4 Peter Eisentraut <peter.eisentraut@2ndquadrant.com>
Re: [HACKERS] WIP: Faster Expression Processing v4 Robert Haas <robertmhaas@gmail.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) Bruce Momjian <bruce@momjian.us>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Nico Williams <nico@cryptonector.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Robert Haas <robertmhaas@gmail.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Craig Ringer <craig@2ndquadrant.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Craig Ringer <craig@2ndquadrant.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Nico Williams <nico@cryptonector.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Nico Williams <nico@cryptonector.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) Markus Nullmeier <dq124@uni-heidelberg.de>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) Andres Freund <andres@anarazel.de>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Robert Haas <robertmhaas@gmail.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) Dilip Kumar <dilipbalaut@gmail.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Peter Geoghegan <pg@heroku.com>
Re: WIP: Faster Expression Processing and Tuple Deforming (including JIT) Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) CK Tan <cktan@vitessedata.com>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) Andres Freund <andres@anarazel.de>
Re: [HACKERS] WIP: Faster Expression Processing and Tuple Deforming(including JIT) CK Tan <cktan@vitessedata.com>
Andres Freund  writes:
> On 2017-03-24 11:26:27 -0400, Tom Lane wrote:
>> Another modest proposal:
>> 
>> I'm not really sold on the approach of using EEOP_FETCHSOME opcodes to
>> trigger initial tupleslot de-forming.  Certainly we want to have a single
>> slot_getsomeattrs call per source slot, but as-is, we need a separate
>> traversal over the expression tree just to precompute the max attribute
>> number needed.  That can't be good for expression compile speed, and
>> it introduces nontrivial bug risks because the code that does that
>> is completely decoupled from the code that emits the EEOP_VAR opcodes
>> (which are what's really relying on the de-forming to have happened).

> Hm.  We had the separate traversal for projections for a long while, and
> I don't think there've been a a lot of changes to the extraction of the
> last attribute number.

That's easily disproven just by looking at the code:
   /*    * Don't examine the arguments or filters of Aggrefs or WindowFuncs,    * because those do not represent expressions to be evaluated within the    * calling expression's econtext.  GroupingFunc arguments are never    * evaluated at all.    */   if (IsA(node, Aggref))       return false;   if (IsA(node, WindowFunc))       return false;   if (IsA(node, GroupingFunc))       return false;   return expression_tree_walker(node, get_last_attnums_walker,                                 (void *) info);

The WindowFunc exception hasn't been there so long, and the GroupingFunc
one is very new.  And who's to say whether e.g. the recent XMLTABLE patch
got this right at all?  We could easily be extracting columns we don't
need to.

I'm willing to leave this as-is for the moment, but I really think we
should look into changing it (after the main patch is in).
		regards, tom lane


В списке pgsql-hackers по дате отправления
От: Alvaro Herrera
Дата:
От: Tom Lane
Дата:
FAQ