Re: PostgreSQL as advanced job queuing system

Поиск
Список
Период
Сортировка
От Thiemo Kellner
Тема Re: PostgreSQL as advanced job queuing system
Дата
Msg-id 0da7da15-9155-4b53-9d6d-d289fc0986c7@gelassene-pferde.biz
обсуждение исходный текст
Ответ на Re: PostgreSQL as advanced job queuing system  (Fred Habash <fmhabash@gmail.com>)
Ответы Re: PostgreSQL as advanced job queuing system
Список pgsql-general

Am 22.03.2024 um 14:15 schrieb Fred Habash:
> We developed a home-grown queue system using Postgres, but its 
> performance was largely hindered by que tables bloating and the need to 
> continuously vacuum them. It did not scale whatsoever. With some 
> workarounds, we ended up designing three sets of queue tables, switching 
> between them based on some queue stats, vacuum the inactive set, and repeat.
> We kept this queue system for low SLA app components. For others, we 
> switched to Kafka. Investing in learning and implementing purpose built 
> queue systems pays off for the long term.

I wonder whether one should https://youtu.be/VEWXmdjzIpQ&t=543 not to 
scale either.



В списке pgsql-general по дате отправления:

Предыдущее
От: Alban Hertroys
Дата:
Сообщение: Re: could not open file "global/pg_filenode.map": Operation not permitted
Следующее
От: Fred Habash
Дата:
Сообщение: Timing out A Blocker Based on Time or Count of Waiters