Обсуждение: memory consumption of memory for postgres db container

Поиск
Список
Период
Сортировка

memory consumption of memory for postgres db container

От
M Tarkeshwar Rao
Дата:

Hi all,

 

We did a stability test for our product, where we continuously inserting data into postgres tables. We did this for three days continuously.

Memory utilization of our Postgres container continuously increasing.

 

 

Can you please provide us the clue why it is not constant and continuously increasing?

 

Regards

Tarkeshwar

Вложения

Re: memory consumption of memory for postgres db container

От
Ninad Shah
Дата:
No need to worry. This isn't really a concern.

No operating system releases memory upon using it, but caches it once the program finishes. This actually saves time as memory blocks can be allocated in less time than loading new blocks.
However, if it's required to release memory, it can be performed via a few commands.


Regards,
Ninad Shah

On Thu, 2 Sept 2021 at 20:05, M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com> wrote:

Hi all,

 

We did a stability test for our product, where we continuously inserting data into postgres tables. We did this for three days continuously.

Memory utilization of our Postgres container continuously increasing.

 

 

Can you please provide us the clue why it is not constant and continuously increasing?

 

Regards

Tarkeshwar

Вложения

RE: memory consumption of memory for postgres db container

От
M Tarkeshwar Rao
Дата:

Can you please suggest few commands?

 

Regards

Tarkeshwar

 

From: Ninad Shah <nshah.postgres@gmail.com>
Sent: Thursday, September 2, 2021 8:30 PM
To: M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com>
Cc: pgsql-general@postgresql.org
Subject: Re: memory consumption of memory for postgres db container

 

No need to worry. This isn't really a concern.

 

No operating system releases memory upon using it, but caches it once the program finishes. This actually saves time as memory blocks can be allocated in less time than loading new blocks.

However, if it's required to release memory, it can be performed via a few commands.

 

 

Regards,

Ninad Shah

 

On Thu, 2 Sept 2021 at 20:05, M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com> wrote:

Hi all,

 

We did a stability test for our product, where we continuously inserting data into postgres tables. We did this for three days continuously.

Memory utilization of our Postgres container continuously increasing.

 

 

Can you please provide us the clue why it is not constant and continuously increasing?

 

Regards

Tarkeshwar

Вложения

Re: memory consumption of memory for postgres db container

От
Ninad Shah
Дата:
You may checkout using "free -m" and may see how much memory is cache.

If you are using RHEL, you may clear cache using below commands.

sync; echo 1 > /proc/sys/vm/drop_caches; sync

Though this is going to release some memory from the cache, it may fill up the cache again.


Regards,
Ninad Shah

On Thu, 2 Sept 2021 at 20:41, M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com> wrote:

Can you please suggest few commands?

 

Regards

Tarkeshwar

 

From: Ninad Shah <nshah.postgres@gmail.com>
Sent: Thursday, September 2, 2021 8:30 PM
To: M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com>
Cc: pgsql-general@postgresql.org
Subject: Re: memory consumption of memory for postgres db container

 

No need to worry. This isn't really a concern.

 

No operating system releases memory upon using it, but caches it once the program finishes. This actually saves time as memory blocks can be allocated in less time than loading new blocks.

However, if it's required to release memory, it can be performed via a few commands.

 

 

Regards,

Ninad Shah

 

On Thu, 2 Sept 2021 at 20:05, M Tarkeshwar Rao <m.tarkeshwar.rao@ericsson.com> wrote:

Hi all,

 

We did a stability test for our product, where we continuously inserting data into postgres tables. We did this for three days continuously.

Memory utilization of our Postgres container continuously increasing.

 

 

Can you please provide us the clue why it is not constant and continuously increasing?

 

Regards

Tarkeshwar

Вложения

Re: memory consumption of memory for postgres db container

От
Stephan Knauss
Дата:
On 02.09.2021 16:35, M Tarkeshwar Rao wrote:
>
> We did a stability test for our product, where we continuously 
> inserting data into postgres tables. We did this for three days 
> continuously.
>
> Memory utilization of our Postgres container continuously increasing.
>
I am not certain whether it is related, but you might want to check. I 
had a similar issue where the anonymous memory was sort of leaking with 
a rate of 2 GiB per hour.

it was resolved by doing a "set jit=off". You can see the full thread 
including some hints on how to check where memory is allocated here:

https://www.postgresql.org/message-id/flat/9f73e655-14b8-feaf-bd66-c0f506224b9e%40stephans-server.de

Stephan