Re: [PERFORMANCE] Error loading 37G CSV file "invalid string enlargement request size 65536"

Поиск
Список
Период
Сортировка
От Tom Lane
Тема Re: [PERFORMANCE] Error loading 37G CSV file "invalid string enlargement request size 65536"
Дата
Msg-id 27806.1208901323@sss.pgh.pa.us
обсуждение исходный текст
Ответ на [PERFORMANCE] Error loading 37G CSV file "invalid string enlargement request size 65536"  ("Adonias Malosso" <malosso@gmail.com>)
Список pgsql-performance
"Adonias Malosso" <malosso@gmail.com> writes:
> I�m running a copy for a 37G CSV and receiving the following error:
> "invalid string enlargement request size 65536"

AFAICS this would only happen if you've got an individual line of COPY
data exceeding 1GB.  (PG versions later than 8.2 give a slightly more
helpful "out of memory" error in such a case.)

Most likely, that was not your intention, and the real problem is
incorrect quoting/escaping in the CSV file, causing COPY to think
that a large number of physical lines should be read as one logical line.

            regards, tom lane

В списке pgsql-performance по дате отправления:

Предыдущее
От: "Adonias Malosso"
Дата:
Сообщение: [PERFORMANCE] Error loading 37G CSV file "invalid string enlargement request size 65536"
Следующее
От: Ivan Voras
Дата:
Сообщение: Re: Suspicious top output