Обсуждение: Can postgres run autovacuum tasks when autovacuum is disabled?
I'm confused about this:
Best regards, Andrey Zhidenkov
[postgres@srv log]$ grep autovacuum ~/data/postgresql.conf
autovacuum = off # Enable autovacuum subprocess? 'on'
log_autovacuum_min_duration = 0 # -1 disables, 0 logs all actions and
autovacuum_naptime = 10min # time between autovacuum runs
So, as you can see, autovacuum is disabled now and I could not seen any autovacuum tasks about few hours. But now
I can see this:
srv=# select backend_start, query from pg_stat_activity where query ilike '%vacuum%';
backend_start | query
-------------------------------+---------------------------------------------------------------------------------
2014-07-29 21:38:42.882383+04 | select backend_start, query from pg_stat_activity where query ilike '%vacuum%';
2014-07-30 10:21:51.5511+04 | autovacuum: VACUUM ANALYZE customer_email
2014-07-30 10:43:19.49936+04 | autovacuum: VACUUM ANALYZE cdr_tech
(3 rows)
The problem is that table cdr_tech is very large (70Gb) and I couldn't wait while autovacuum is finished, I would like to run vacuum manually at night time.
Whan I do wrong?
_
ASCII ribbon campaign ( )
against HTML e-mail X
/ \
Andrey Zhidenkov wrote > I'm confused about this: > > [postgres@srv log]$ grep autovacuum ~/data/postgresql.conf > autovacuum = off # Enable autovacuum subprocess? 'on' > log_autovacuum_min_duration = 0 # -1 disables, 0 logs all actions and > autovacuum_naptime = 10min # time between autovacuum runs > > So, as you can see, autovacuum is disabled now and I could not seen any > autovacuum tasks about few hours. But now > I can see this: > > srv=# select backend_start, query from pg_stat_activity where query ilike > '%vacuum%'; > backend_start | > query > > -------------------------------+--------------------------------------------------------------------------------- > 2014-07-29 21:38:42.882383+04 | select backend_start, query from > pg_stat_activity where query ilike '%vacuum%'; > 2014-07-30 10:21:51.5511+04 | autovacuum: VACUUM ANALYZE customer_email > 2014-07-30 10:43:19.49936+04 | autovacuum: VACUUM ANALYZE cdr_tech > (3 rows) > > The problem is that table cdr_tech is very large (70Gb) and I couldn't > wait > while autovacuum is finished, I would like to run vacuum manually at night > time. > > Whan I do wrong? > > Best regards, Andrey Zhidenkov > > _ > ASCII ribbon campaign ( ) > against HTML e-mail X > / \ The obvious question is whether you sighup/rebooted the server after making the change? It helps to show what your session sees as the current guc value. David J. -- View this message in context: http://postgresql.1045698.n5.nabble.com/Can-postgres-run-autovacuum-tasks-when-autovacuum-is-disabled-tp5813253p5813254.html Sent from the PostgreSQL - admin mailing list archive at Nabble.com.
I run pgctl after making a change and saw in the log that new value of "autovacuum" = off
On Wed, Jul 30, 2014 at 11:39 AM, David G Johnston <david.g.johnston@gmail.com> wrote:
Andrey Zhidenkov wroteThe obvious question is whether you sighup/rebooted the server after making> I'm confused about this:
>
> [postgres@srv log]$ grep autovacuum ~/data/postgresql.conf
> autovacuum = off # Enable autovacuum subprocess? 'on'
> log_autovacuum_min_duration = 0 # -1 disables, 0 logs all actions and
> autovacuum_naptime = 10min # time between autovacuum runs
>
> So, as you can see, autovacuum is disabled now and I could not seen any
> autovacuum tasks about few hours. But now
> I can see this:
>
> srv=# select backend_start, query from pg_stat_activity where query ilike
> '%vacuum%';
> backend_start |
> query
>
> -------------------------------+---------------------------------------------------------------------------------
> 2014-07-29 21:38:42.882383+04 | select backend_start, query from
> pg_stat_activity where query ilike '%vacuum%';
> 2014-07-30 10:21:51.5511+04 | autovacuum: VACUUM ANALYZE customer_email
> 2014-07-30 10:43:19.49936+04 | autovacuum: VACUUM ANALYZE cdr_tech
> (3 rows)
>
> The problem is that table cdr_tech is very large (70Gb) and I couldn't
> wait
> while autovacuum is finished, I would like to run vacuum manually at night
> time.
>
> Whan I do wrong?
>
> Best regards, Andrey Zhidenkov
>
> _
> ASCII ribbon campaign ( )
> against HTML e-mail X
> / \
the change?
It helps to show what your session sees as the current guc value.
David J.
--
View this message in context: http://postgresql.1045698.n5.nabble.com/Can-postgres-run-autovacuum-tasks-when-autovacuum-is-disabled-tp5813253p5813254.html
Sent from the PostgreSQL - admin mailing list archive at Nabble.com.
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
С уважением, Андрей Жиденков.
_
ASCII ribbon campaign ( )
against HTML e-mail X
/ \
On Wed, Jul 30, 2014 at 1:12 AM, Andrey Zhidenkov <pensnarik@gmail.com> wrote: > I'm confused about this: > > [postgres@srv log]$ grep autovacuum ~/data/postgresql.conf > autovacuum = off # Enable autovacuum subprocess? 'on' > log_autovacuum_min_duration = 0 # -1 disables, 0 logs all actions and > autovacuum_naptime = 10min # time between autovacuum runs > > So, as you can see, autovacuum is disabled now and I could not seen any > autovacuum tasks about few hours. But now > I can see this: > > srv=# select backend_start, query from pg_stat_activity where query ilike > '%vacuum%'; > backend_start | query > -------------------------------+--------------------------------------------------------------------------------- > 2014-07-29 21:38:42.882383+04 | select backend_start, query from > pg_stat_activity where query ilike '%vacuum%'; > 2014-07-30 10:21:51.5511+04 | autovacuum: VACUUM ANALYZE customer_email > 2014-07-30 10:43:19.49936+04 | autovacuum: VACUUM ANALYZE cdr_tech > (3 rows) > > The problem is that table cdr_tech is very large (70Gb) and I couldn't wait > while autovacuum is finished, I would like to run vacuum manually at night > time. > > Whan I do wrong? Are you sure these aren't to prevent wrap-around?
Please don't top post Andrey Zhidenkov wrote > I run pgctl after making a change and saw in the log that new value of > "autovacuum" = off > > > On Wed, Jul 30, 2014 at 11:39 AM, David G Johnston < > david.g.johnston@ >> wrote: > >> Andrey Zhidenkov wrote >> > I'm confused about this: >> > >> > [postgres@srv log]$ grep autovacuum ~/data/postgresql.conf >> > autovacuum = off # Enable autovacuum subprocess? 'on' >> > log_autovacuum_min_duration = 0 # -1 disables, 0 logs all actions and >> > autovacuum_naptime = 10min # time between autovacuum runs >> > >> > So, as you can see, autovacuum is disabled now and I could not seen any >> > autovacuum tasks about few hours. But now >> > I can see this: >> > >> > srv=# select backend_start, query from pg_stat_activity where query >> ilike >> > '%vacuum%'; >> > backend_start | >> > query >> > >> > >> -------------------------------+--------------------------------------------------------------------------------- >> > 2014-07-29 21:38:42.882383+04 | select backend_start, query from >> > pg_stat_activity where query ilike '%vacuum%'; >> > 2014-07-30 10:21:51.5511+04 | autovacuum: VACUUM ANALYZE >> customer_email >> > 2014-07-30 10:43:19.49936+04 | autovacuum: VACUUM ANALYZE cdr_tech >> > (3 rows) >> > >> > The problem is that table cdr_tech is very large (70Gb) and I couldn't >> > wait >> > while autovacuum is finished, I would like to run vacuum manually at >> night >> > time. >> > >> > Whan I do wrong? >> > >> > Best regards, Andrey Zhidenkov >> > >> > _ >> > ASCII ribbon campaign ( ) >> > against HTML e-mail X >> > / \ >> >> The obvious question is whether you sighup/rebooted the server after >> making >> the change? >> >> It helps to show what your session sees as the current guc value. >> >> David J. >> It would be nice to see all of the view columns. I'm also confused how you were able to see into the future...if you can manage this for a period longer than about 13 hours you might be better off getting a job on a psychic hotline. My theory is that the queries you are seeing are those that are already competed (though then why your own query doesn't show up confuses me). David J. -- View this message in context: http://postgresql.1045698.n5.nabble.com/Can-postgres-run-autovacuum-tasks-when-autovacuum-is-disabled-tp5813253p5813257.html Sent from the PostgreSQL - admin mailing list archive at Nabble.com.
Scott Marlowe-2 wrote > On Wed, Jul 30, 2014 at 1:12 AM, Andrey Zhidenkov < > pensnarik@ > > wrote: >> I'm confused about this: >> >> [postgres@srv log]$ grep autovacuum ~/data/postgresql.conf >> autovacuum = off # Enable autovacuum subprocess? 'on' >> log_autovacuum_min_duration = 0 # -1 disables, 0 logs all actions and >> autovacuum_naptime = 10min # time between autovacuum runs >> >> So, as you can see, autovacuum is disabled now and I could not seen any >> autovacuum tasks about few hours. But now >> I can see this: >> >> srv=# select backend_start, query from pg_stat_activity where query ilike >> '%vacuum%'; >> backend_start | >> query >> -------------------------------+--------------------------------------------------------------------------------- >> 2014-07-29 21:38:42.882383+04 | select backend_start, query from >> pg_stat_activity where query ilike '%vacuum%'; >> 2014-07-30 10:21:51.5511+04 | autovacuum: VACUUM ANALYZE >> customer_email >> 2014-07-30 10:43:19.49936+04 | autovacuum: VACUUM ANALYZE cdr_tech >> (3 rows) >> >> The problem is that table cdr_tech is very large (70Gb) and I couldn't >> wait >> while autovacuum is finished, I would like to run vacuum manually at >> night >> time. >> >> Whan I do wrong? > > Are you sure these aren't to prevent wrap-around? This is my other theory, and probably the correct one. Is this something that can be discovered from the logs (since nothing in the query provides this detail)? David J. -- View this message in context: http://postgresql.1045698.n5.nabble.com/Can-postgres-run-autovacuum-tasks-when-autovacuum-is-disabled-tp5813253p5813258.html Sent from the PostgreSQL - admin mailing list archive at Nabble.com.
David G Johnston <david.g.johnston@gmail.com> writes: > Scott Marlowe-2 wrote >> Are you sure these aren't to prevent wrap-around? > This is my other theory, and probably the correct one. Is this something > that can be discovered from the logs (since nothing in the query provides > this detail)? In all recent versions of Postgres, the pg_stat_activity line should include "(to prevent wraparound)" if that's what autovac thinks it's doing. However ... it looks to me like if the autovac launcher gets launched forcibly because of a possible wraparound issue, it will keep running normally after that even if autovacuum is off :-(. You need to SIGHUP it to get it to quit again. (A second bug is that it will then honor the SIGHUP and quit, even if the wraparound emergency is still present.) So I'm betting that what happened, particularly given the OP's apparent insistence on managing vacuums manually, is that a wraparound vacuum was forced on some relatively small table and then the launcher kept doing its thing after that. Since log_autovacuum_min_duration was set to 0, there should be some evidence for this theory in the logs (although it looks like the log entries *don't* say whether the vacuum was for wraparound :-(). regards, tom lane
I wrote: > However ... it looks to me like if the autovac launcher gets launched > forcibly because of a possible wraparound issue, it will keep running > normally after that even if autovacuum is off :-(. Nope, scratch that: I missed the bit before the launcher's main loop, where it fires off one child and exits if it's launched when autovacuum is already false. Still, if it does fire one child process, it looks like that child will vacuum everything that seems to need vacuuming in the target database. We should probably adjust that so that tables not in danger of wraparound get skipped. regards, tom lane
Thank you for your fix. It is really seems that this bug appears only when some autovacuum jobs are active.
Andrey Zhidenkov.
On Wed, Jul 30, 2014 at 7:09 PM, Tom Lane <tgl@sss.pgh.pa.us> wrote:
I wrote:Nope, scratch that: I missed the bit before the launcher's main loop,
> However ... it looks to me like if the autovac launcher gets launched
> forcibly because of a possible wraparound issue, it will keep running
> normally after that even if autovacuum is off :-(.
where it fires off one child and exits if it's launched when autovacuum
is already false.
Still, if it does fire one child process, it looks like that child will
vacuum everything that seems to need vacuuming in the target database.
We should probably adjust that so that tables not in danger of wraparound
get skipped.
regards, tom lane
--
Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org/mailpref/pgsql-admin
С уважением, Андрей Жиденков.
_
ASCII ribbon campaign ( )
against HTML e-mail X
/ \