Re: [HACKERS] Pluggable storage
От
Alexander Korotkov
Тема
Re: [HACKERS] Pluggable storage
Дата
Msg-id
CAPpHfdtzwn178LYz=KAG4f3i3zop8UP+MY8ekfmHEquZjQjaTQ@mail.gmail.com
Ответ на
Re: [HACKERS] Pluggable storage (Alexander Korotkov)
Список
Дерево обсуждения
Pluggable storage Alvaro Herrera <alvherre@2ndQuadrant.com>
Re: Pluggable storage Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Pluggable storage Alvaro Herrera <alvherre@2ndquadrant.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Andres Freund <andres@anarazel.de>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Michael Paquier <michael.paquier@gmail.com>
Re: [HACKERS] Pluggable storage Teodor Sigaev <teodor@sigaev.ru>
Re: [HACKERS] Pluggable storage Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [HACKERS] Pluggable storage Julien Rouhaud <julien.rouhaud@dalibo.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Michael Paquier <michael.paquier@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: [HACKERS] Pluggable storage Amit Langote <Langote_Amit_f8@lab.ntt.co.jp>
Re: [HACKERS] Pluggable storage Michael Paquier <michael.paquier@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Thomas Munro <thomas.munro@enterprisedb.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Tom Lane <tgl@sss.pgh.pa.us>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Peter Geoghegan <pg@bowt.ie>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Alvaro Herrera <alvherre@alvh.no-ip.org>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Michael Paquier <michael.paquier@gmail.com>
Re: [HACKERS] Pluggable storage Michael Paquier <michael.paquier@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage David Steele <david@pgmasters.net>
Re: [HACKERS] Pluggable storage Michael Paquier <michael@paquier.xyz>
Re: [HACKERS] Pluggable storage David Steele <david@pgmasters.net>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: Pluggable storage AJG <ayden@gera.co.nz>
Re: Pluggable storage Andres Freund <andres@anarazel.de>
Re: Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Kuntal Ghosh <kuntalghosh.2007@gmail.com>
Re: [HACKERS] Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: [HACKERS] Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: [HACKERS] Pluggable storage Haribabu Kommi <kommi.haribabu@gmail.com>
Re: [HACKERS] Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: Pluggable storage Anastasia Lubennikova <a.lubennikova@postgrespro.ru>
Re: Pluggable storage Anastasia Lubennikova <a.lubennikova@postgrespro.ru>
Re: Pluggable storage Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Pluggable storage Amit Kapila <amit.kapila16@gmail.com>
Re: Pluggable storage Robert Haas <robertmhaas@gmail.com>
Re: Pluggable storage Andres Freund <andres@anarazel.de>
Re: Pluggable storage Simon Riggs <simon@2ndquadrant.com>
Re: Pluggable storage Andres Freund <andres@anarazel.de>
Re: Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
Re: Pluggable storage Alexander Korotkov <a.korotkov@postgrespro.ru>
On Wed, Sep 27, 2017 at 7:51 PM, Alexander Korotkov <a.korotkov@postgrespro.ru> wrote:
I took a look on this patch. I've following notes for now.tuple_insert_hook tuple_insert; /* heap_insert */
tuple_update_hook tuple_update; /* heap_update */
tuple_delete_hook tuple_delete; /* heap_delete */I don't think this set of functions provides good enough level of abstraction for storage AM. This functions encapsulate only low-level work of insert/update/delete tuples into heap itself. However, it still assumed that indexes are managed outside of storage AM. I don't think this is right, assuming that one of most demanded storage API usage would be different MVCC implementation (for instance, UNDO log based as discussed upthread). Different MVCC implementation is likely going to manage indexes in a different way. For example, storage AM utilizing UNDO would implement in-place update even when indexed columns are modified. Therefore this piece of code in ExecUpdate() wouldn't be relevant anymore./*
* insert index entries for tuple
*
* Note: heap_update returns the tid (location) of the new tuple in
* the t_self field.
*
* If it's a HOT update, we mustn't insert new index entries.
*/
if ((resultRelInfo->ri_NumIndices > 0) && !storage_tuple_is_heaponly(resultRelationDesc, tuple))
recheckIndexes = ExecInsertIndexTuples(slot, &(slot->tts_tid),
estate, false, NULL, NIL);I'm firmly convinced that this logic should be encapsulated into storage AM altogether with inserting new index tuples on storage insert. Also, HOT should be completely encapsulated into heapam. It's quite evident for me that storage utilizing UNDO wouldn't have anything like our current HOT. Therefore, I think there shouldn't be hot_search_buffer() API function. tuple_fetch() may cover hot_search_buffer(). That might require some signature change of tuple_fetch() (probably, extra arguments).
For me, it's crucial point that pluggable storages should be able to have different MVCC implementation, and correspondingly have full control over its interactions with indexes.
Thus, it would be good if we would get consensus on that point. I'd like other discussion participants to comment whether they agree/disagree and why.
Any comments?
The Russian Postgres Company
В списке pgsql-hackers по дате отправления
От: Aleksander Alekseev
Дата: