RE: POC: postgres_fdw insert batching

Поиск
Список
Период
Сортировка
Искать
От
tsunakawa.takay@fujitsu.com
Тема
RE: POC: postgres_fdw insert batching
Дата
Msg-id
TYAPR01MB2990BDB626DB2630E6CEA78AFEA70@TYAPR01MB2990.jpnprd01.prod.outlook.com
Ответ на
Список
Дерево обсуждения
POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: POC: postgres_fdw insert batching "Andrey V. Lepikhov" <a.lepikhov@postgrespro.ru>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching Tim.Colles@ed.ac.uk
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching David Fetter <david@fetter.org>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Ian Lawrence Barwick <barwick@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tom Lane <tgl@sss.pgh.pa.us>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Zhihong Yu <zyu@yugabyte.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
RE: POC: postgres_fdw insert batching "tsunakawa.takay@fujitsu.com" <tsunakawa.takay@fujitsu.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@enterprisedb.com>
Re: POC: postgres_fdw insert batching Craig Ringer <craig.ringer@enterprisedb.com>
Re: POC: postgres_fdw insert batching Andres Freund <andres@anarazel.de>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat.oss@gmail.com>
Re: POC: postgres_fdw insert batching Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Etsuro Fujita <etsuro.fujita@gmail.com>
Re: POC: postgres_fdw insert batching Ashutosh Bapat <ashutosh.bapat@2ndquadrant.com>
Re: POC: postgres_fdw insert batching Amit Langote <amitlangote09@gmail.com>
Re: POC: postgres_fdw insert batching Etsuro Fujita <etsuro.fujita@gmail.com>
From: Amit Langote 
> Okay, so maybe not moving the whole logic into the FDW's
> BeginForeignModify(), but at least if we move this...
> 
> @@ -441,6 +449,72 @@ ExecInsert(ModifyTableState *mtstate,
> +       /*
> +        * Determine if the FDW supports batch insert and determine the
> batch
> +        * size (a FDW may support batching, but it may be disabled for the
> +        * server/table). Do this only once, at the beginning - we don't want
> +        * the batch size to change during execution.
> +        */
> +       if (resultRelInfo->ri_FdwRoutine->GetForeignModifyBatchSize &&
> +           resultRelInfo->ri_FdwRoutine->ExecForeignBatchInsert &&
> +           resultRelInfo->ri_BatchSize == 0)
> +           resultRelInfo->ri_BatchSize =
> +
> resultRelInfo->ri_FdwRoutine->GetForeignModifyBatchSize(resultRelInfo);
> 
> ...into ExecInitModifyTable(), ExecInsert() only needs the following block:

Does ExecInitModifyTable() know all leaf partitions where the tuples produced by VALUES or SELECT go?  ExecInsert() doesn't find the target leaf partition for the first time through the call to ExecPrepareTupleRouting()?  Leaf partitions can have different batch_size settings.


Regards
Takayuki Tsunakawa

В списке pgsql-hackers по дате отправления
От: Álvaro Herrera
Дата:
От: Amit Langote
Дата:
FAQ