Re: Conflict handling for COPY FROM
От
Karen Huddleston
Тема
Re: Conflict handling for COPY FROM
Дата
Msg-id
153456944015.1410.12495599902221553748.pgcf@coridan.postgresql.org
Ответ на
Conflict handling for COPY FROM (Surafel Temesgen)
Список
Дерево обсуждения
Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Karen Huddleston <khuddleston@pivotal.io>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Robert Haas <robertmhaas@gmail.com>
Re: Conflict handling for COPY FROM "Nasby, Jim" <nasbyj@amazon.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Andres Freund <andres@anarazel.de>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Andres Freund <andres@anarazel.de>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Andrew Dunstan <andrew.dunstan@2ndquadrant.com>
Re: Conflict handling for COPY FROM Andres Freund <andres@anarazel.de>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Conflict handling for COPY FROM Alexey Kondratov <a.kondratov@postgrespro.ru>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Alexey Kondratov <a.kondratov@postgrespro.ru>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Alexey Kondratov <a.kondratov@postgrespro.ru>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Alexey Kondratov <a.kondratov@postgrespro.ru>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
RE: Conflict handling for COPY FROM "asaba.takanori@fujitsu.com" <asaba.takanori@fujitsu.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Tatsuo Ishii <ishii@sraoss.co.jp>
Re: Conflict handling for COPY FROM Tatsuo Ishii <ishii@sraoss.co.jp>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Tatsuo Ishii <ishii@sraoss.co.jp>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
RE: Conflict handling for COPY FROM "asaba.takanori@fujitsu.com" <asaba.takanori@fujitsu.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Alexey Kondratov <a.kondratov@postgrespro.ru>
RE: Conflict handling for COPY FROM "asaba.takanori@fujitsu.com" <asaba.takanori@fujitsu.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Tom Lane <tgl@sss.pgh.pa.us>
Re: Conflict handling for COPY FROM "David G. Johnston" <david.g.johnston@gmail.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM David Steele <david@pgmasters.net>
RE: Conflict handling for COPY FROM "asaba.takanori@fujitsu.com" <asaba.takanori@fujitsu.com>
Re: Conflict handling for COPY FROM Thomas Munro <thomas.munro@gmail.com>
Re: Conflict handling for COPY FROM Anthony Nowocien <anowocien@gmail.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Anthony Nowocien <anowocien@gmail.com>
Re: Conflict handling for COPY FROM Thomas Munro <thomas.munro@gmail.com>
Re: Re: Conflict handling for COPY FROM David Steele <david@pgmasters.net>
Re: Conflict handling for COPY FROM Andres Freund <andres@anarazel.de>
Re: Conflict handling for COPY FROM Andrew Dunstan <andrew.dunstan@2ndquadrant.com>
Re: Conflict handling for COPY FROM Dmitry Dolgov <9erthalion6@gmail.com>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Re: Conflict handling for COPY FROM Michael Paquier <michael@paquier.xyz>
Re: Conflict handling for COPY FROM Surafel Temesgen <surafel3000@gmail.com>
Hi Surafel, Andrew and I began reviewing your patch. It applied cleanly and seems to mostly have the functionality you describe. We did have some comments/questions. 1. It sounded like you added the copy_max_error_limit GUC as part of this patch to allow users to specify how many errors they want to swallow with this new functionality. The GUC didn't seem to be defined and we saw no mention of it in the code. My guess is this might be good to address one of the concerns mentioned in the initial email thread of this generating too many transaction IDs so it would probably be good to have it. 2. I was curious why you only have support for skipping errors on UNIQUE and EXCLUSION constraints and not other kinds of constraints? I'm not sure how difficult it would be to add support for those, but it seems they could also be useful. 3. We think the wording "ON CONFLICT IGNORE" may not be the clearest description of what this is doing since it is writing the failed rows to a file for a user to process later, but they are not being ignored. We considered things like STASH or LOG as alternatives to IGNORE. Andrew may have some other suggestions for wording. 4. We also noticed this has no tests and thought it would be good to add some to ensure this functionality works how you intend it and continues to work. We started running some SQL to validate this, but haven't gotten the chance to put it into a clean test yet. We can send you what we have so far, or we are also willing to put a little time in to turn it into tests ourselves that we could contribute to this patch. Thanks for writing this patch! Karen
В списке pgsql-hackers по дате отправления
От: Michael Paquier
Дата: