Support allocating memory for large strings

Поиск
Список
Период
Сортировка
От Maxim Zibitsker
Тема Support allocating memory for large strings
Дата
Msg-id 5B146D62-35AE-4822-9B98-37E386AFB942@gmail.com
обсуждение исходный текст
Ответы Re: Support allocating memory for large strings
Re: Support allocating memory for large strings
Список pgsql-hackers
PostgreSQL's MaxAllocSize limit prevents storing individual variable-length character strings exceeding ~1GB, causing
"invalidmemory alloc request size" errors during INSERT operations on tables with large text columns. Example
reproductionincluded in artifacts.md. 

This limitation also affects pg_dump when exporting a PostgreSQL database with such data. The attached patches
demonstratesa proof of concept using palloc_extended with MCXT_ALLOC_HUGE in the write path. For the read path, there
area couple of possible approaches: extending existing functions to handle huge allocations, or implementing a chunked
storagemechanism that avoids single large allocations. 

Thoughts?

Maxim



Вложения

В списке pgsql-hackers по дате отправления: