Re: Invalid memory alloc

Поиск
Список
Период
Сортировка
От Marc-André Goderre
Тема Re: Invalid memory alloc
Дата
Msg-id D8DAC91BA6256246BA3FF835F6AAA1189943F966@SI-MB01.cegep-chicoutimi.qc.ca
обсуждение исходный текст
Ответ на Re: Invalid memory alloc  (Edson Richter <edsonrichter@hotmail.com>)
Список pgsql-general
Postgresql is running on a 30 Gb of memory server.
I should have access to the server in few minutes and I'll give you more information about the other spec.
Thanks

Marc


-----Message d'origine-----
De : pgsql-general-owner@postgresql.org [mailto:pgsql-general-owner@postgresql.org] De la part de Edson Richter
Envoyé : 23 avril 2015 16:16
À : pgsql-general@postgresql.org
Objet : Re: [GENERAL] Invalid memory alloc

On 23-04-2015 16:55, Marc-André Goderre wrote:
> Hello, I'm processing  a 100Million row table.
> I get error message about memory and I'ld like to know what can cause this issue.
>
> ...
> psql:/home/ubuntu/create_topo.sql:12: NOTICE:  104855000 edges
> processed
> psql:/home/ubuntu/create_topo.sql:12: NOTICE:  104856000 edges
> processed
> psql:/home/ubuntu/create_topo.sql:12: NOTICE:  104857000 edges
> processed
> psql:/home/ubuntu/create_topo.sql:12: NOTICE:  invalid memory alloc
> request size 1677721600
> psql:/home/ubuntu/create_topo.sql:12: NOTICE:  UPDATE public.way_noded SET source = 88374866,target = 88362922 WHERE
id=  142645362 
>   pgr_createtopology
> --------------------
>   FAIL
> (1 row)
>
> The server  has a 10Gb of shared_buffer.
> Do you thing this quantity of memory allowed should normaly be enough to process the data?
>
> Thanks
> Marc
>
>
My question would sound stupid... you have 10Gb shared buffer, but how much physical memory on this server?
How have you configured the kernel swappines, overcommit_memoryt, overcommit_ratio?
Have you set anything different in shmmax or shmall?

Edson


--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-general


В списке pgsql-general по дате отправления:

Предыдущее
От: Vick Khera
Дата:
Сообщение: Re: COALESCE woes
Следующее
От: Marc-André Goderre
Дата:
Сообщение: Re: Invalid memory alloc