Re: BUG #15449: file_fdw using program cause exit code error when using LIMIT

Поиск
Список
Период
Сортировка
От Tom Lane
Тема Re: BUG #15449: file_fdw using program cause exit code error when using LIMIT
Дата
Msg-id 31355.1542389631@sss.pgh.pa.us
обсуждение исходный текст
Ответ на Re: BUG #15449: file_fdw using program cause exit code error when using LIMIT  (Tom Lane <tgl@sss.pgh.pa.us>)
Ответы Re: BUG #15449: file_fdw using program cause exit code error when using LIMIT  (Tom Lane <tgl@sss.pgh.pa.us>)
Список pgsql-hackers
I wrote:
> Are we sufficiently convinced that we must have the dont-allow-partial
> option to not fix this in the back branches?  I'm not.

I just had a thought about that: suppose we add a flag to CopyState
to indicate whether we reached EOF while reading.  This wouldn't be
hugely expensive, just something like

    switch (cstate->copy_dest)
    {
        case COPY_FILE:
            bytesread = fread(databuf, 1, maxread, cstate->copy_file);
            if (ferror(cstate->copy_file))
                ereport(ERROR,
                        (errcode_for_file_access(),
                         errmsg("could not read from COPY file: %m")));
+           cstate->reached_eof |= (bytesread < maxread);
            break;
        case COPY_OLD_FE:

Then the logic in ClosePipeToProgram could be "if we did not reach
EOF, then a SIGPIPE termination is unsurprising.  If we did reach
EOF, then SIGPIPE is an error."  If the called program gets SIGPIPE
for some reason other than us closing the pipe early, then we would
see EOF next time we try to read, and correctly report that there's
a problem.

There are race-ish conditions in cases like the called program
getting an unrelated SIGPIPE at about the same time that we decide
to stop reading early, but I don't think it's really possible
to disambiguate that.

            regards, tom lane


В списке pgsql-hackers по дате отправления:

Предыдущее
От: Tom Lane
Дата:
Сообщение: Re: BUG #15449: file_fdw using program cause exit code error when using LIMIT
Следующее
От: Laurenz Albe
Дата:
Сообщение: Re: Libpq support to connect to standby server as priority