Re: Pulling data from Postgres DB table for every 5 seconds.

Поиск
Список
Период
Сортировка
От Ron
Тема Re: Pulling data from Postgres DB table for every 5 seconds.
Дата
Msg-id cdf20df7-a935-e3e4-3ca7-b71a7fc2018d@gmail.com
обсуждение исходный текст
Ответ на Re: Pulling data from Postgres DB table for every 5 seconds.  (github kran <githubkran@gmail.com>)
Список pgsql-general
On 1/9/19 11:02 AM, github kran wrote:

Hi Postgres Team,

I have an application using RDS Aurora Postgresql 9.6 version having 4 TB of DB size. In this DB we have a table PRODUCT_INFO with around  1 million rows and table size of 1 GB.
We are looking for a implementation where we want to pull the data in real time for every 5 seconds from the DB

"the data".  All 1GB every 5 seconds?

( Table mentioned above) and send it to IOT topic whenever an event occurs for a product. ( event is any new product information or change in the existing 
product information.). 

This table has few DML operations in real time either INSERT or UPDATE based on the productId. ( Update whenever there is a change in the product information and INSERT when a record doesnt exists for that product).

We have REST API's built in the backend pulling data from this backend RDS Aurora POSTGRES DB and used by clients. 

UseCase
We dont want clients to pull the data for every 5 seconds from DB but rather provide a service which can fetch the data from DB in real time and push the data to IOT topic by pulling data for every 5 seconds from DB.

Or just a tiny subset every 5 seconds?


Questions
1) How can I get information by pulling from the DB every 5 seconds without impacting the performance of the DB.
2) What are the options I have pulling the data from this table every 5 seconds. Does POSTGRES has any other options apart from TRIGGER ?.


Any ideas would be helpful.

Thanks !!
GithubKran

--
Angular momentum makes the world go 'round.

В списке pgsql-general по дате отправления:

Предыдущее
От: Rob Sargent
Дата:
Сообщение: Re: Pulling data from Postgres DB table for every 5 seconds.
Следующее
От: github kran
Дата:
Сообщение: Re: Pulling data from Postgres DB table for every 5 seconds.