RE: POC: postgres_fdw insert batching
От
tsunakawa.takay@fujitsu.com
Тема
RE: POC: postgres_fdw insert batching
Дата
Msg-id
TYAPR01MB2990BDB626DB2630E6CEA78AFEA70@TYAPR01MB2990.jpnprd01.prod.outlook.com
Ответ на
Re: POC: postgres_fdw insert batching (Amit Langote)
Список
Дерево обсуждения
POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: POC: postgres_fdw insert batching "Andrey V. Lepikhov" <a.lepikhov@postgrespro.ru>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching Tim.Colles@ed.ac.uk
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching David Fetter <david@fetter.org>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
Re: POC: postgres_fdw insert batching Andres Freund <andres@anarazel.de>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Etsuro Fujita <etsuro.fujita@gmail.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Etsuro Fujita <etsuro.fujita@gmail.com>
From: Amit Langote > Okay, so maybe not moving the whole logic into the FDW's > BeginForeignModify(), but at least if we move this... > > @@ -441,6 +449,72 @@ ExecInsert(ModifyTableState *mtstate, > + /* > + * Determine if the FDW supports batch insert and determine the > batch > + * size (a FDW may support batching, but it may be disabled for the > + * server/table). Do this only once, at the beginning - we don't want > + * the batch size to change during execution. > + */ > + if (resultRelInfo->ri_FdwRoutine->GetForeignModifyBatchSize && > + resultRelInfo->ri_FdwRoutine->ExecForeignBatchInsert && > + resultRelInfo->ri_BatchSize == 0) > + resultRelInfo->ri_BatchSize = > + > resultRelInfo->ri_FdwRoutine->GetForeignModifyBatchSize(resultRelInfo); > > ...into ExecInitModifyTable(), ExecInsert() only needs the following block: Does ExecInitModifyTable() know all leaf partitions where the tuples produced by VALUES or SELECT go? ExecInsert() doesn't find the target leaf partition for the first time through the call to ExecPrepareTupleRouting()? Leaf partitions can have different batch_size settings. Regards Takayuki Tsunakawa
В списке pgsql-hackers по дате отправления