Обсуждение: Newbie needs help with space issue

Поиск
Список
Период
Сортировка

Newbie needs help with space issue

От
Jesse Josserand
Дата:
I apologize in advance for bothering you, but I've not been able to get answers from the community by searches I've done, nor have I figured out how to post a question there.

I'm working for a gov't entity here in Mississippi and while I have extensive Oracle and MySQL experience, as well as Linux admin experience (which is what I was hired for), I've been given PostgreSQL DBA responsibilities since the last DBA quit abruptly (probably due to poor architecture and documentation here -- another thing I'm resolving).

I'm having serious space issues in a production environment and psql commands and queries are not helping me isolate it nor determine the root cause... possibly due to my naivete.

Would you be so kind as to give me some insight as to how to best determine what is growing to fast and why? I have a 20G disk that recently was increased to 40G and am now in less than 3 months almost out of space there again.

Yours truly,
Jesse Josserand, CTO
Direct Phone: 760-566-7866
Business Phone/Fax: 855-236-5550
Owner, Sr. Consultant, Webmaster
SalesRepsNow.Com (888-272-8885), and
All Divisions of  ITWSLLC™

Re: Newbie needs help with space issue

От
John Scalia
Дата:
It’s rather difficult to  determine what your problem might be without some details about your environment, but if you database is growing so rapidly, there’s a possibility that the former DBA might have turned off autovacuuming and your’re now experiencing db bloat. Find your postgresql.conf file and look in it for the word autovacuum and see if it is set to off. If so, turn it back on. Your database will not reclaim the disk space, but if you can spare some downtime, a “vacuum full” can do wonders. Be advised that vacuum full locks tables for it’s exclusive use, so you do not want to use it during regular hours.

But that’s about all I can suggest without more details.
—
Jay

Sent from my iPad

On Apr 21, 2020, at 7:40 PM, Jesse Josserand <jesse.josserand@gmail.com> wrote:


I apologize in advance for bothering you, but I've not been able to get answers from the community by searches I've done, nor have I figured out how to post a question there.

I'm working for a gov't entity here in Mississippi and while I have extensive Oracle and MySQL experience, as well as Linux admin experience (which is what I was hired for), I've been given PostgreSQL DBA responsibilities since the last DBA quit abruptly (probably due to poor architecture and documentation here -- another thing I'm resolving).

I'm having serious space issues in a production environment and psql commands and queries are not helping me isolate it nor determine the root cause... possibly due to my naivete.

Would you be so kind as to give me some insight as to how to best determine what is growing to fast and why? I have a 20G disk that recently was increased to 40G and am now in less than 3 months almost out of space there again.

Yours truly,
Jesse Josserand, CTO
Direct Phone: 760-566-7866
Business Phone/Fax: 855-236-5550
Owner, Sr. Consultant, Webmaster
SalesRepsNow.Com (888-272-8885), and
All Divisions of  ITWSLLC™

Re: Newbie needs help with space issue

От
raf
Дата:
Jesse Josserand wrote:

> I apologize in advance for bothering you, but I've not been able to get
> answers from the community by searches I've done, nor have I figured out
> how to post a question there.
> 
> I'm working for a gov't entity here in Mississippi and while I have
> extensive Oracle and MySQL experience, as well as Linux admin experience
> (which is what I was hired for), I've been given PostgreSQL DBA
> responsibilities since the last DBA quit abruptly (probably due to poor
> architecture and documentation here -- another thing I'm resolving).
> 
> I'm having serious space issues in a production environment and psql
> commands and queries are not helping me isolate it nor determine the root
> cause... possibly due to my naivete.
> 
> Would you be so kind as to give me some insight as to how to best determine
> what is growing to fast and why? I have a 20G disk that recently was
> increased to 40G and am now in less than 3 months almost out of space there
> again.
> 
> Yours truly,
> Jesse Josserand, CTO
> IT Web Services, LLC <https://itwebservicesllc.com/> and
> Ace Consulting Solutions, Inc. <https://aceconsultingsolutionsinc.com/>

Hi,

Here's a query to list individual table sizes:

    select
        t.tablename as "object",
        pg_size_pretty(pg_relation_size(cast(t.tablename as text))) as "data",
        pg_size_pretty(pg_total_relation_size(cast(t.tablename as text))) as "total"
    from
        pg_tables t
    where
        t.schemaname = 'public'
    order by
        pg_total_relation_size(cast(t.tablename as text)) desc

I think the last column includes index sizes.

Running this repeatedly over time should show what's growing.

cheers,
raf

Re: Newbie needs help with space issue

От
Priancka Chatz
Дата:
Hi,

Also you might want to check the logging settings and log file sizes if logging is enabled. Sometimes due to some issues in database, the number of log file entries can be a lot leading to large log files. 

Regards,
Priyanka

On Wed, 22 Apr 2020 at 9:21 AM, raf <raf@raf.org> wrote:
Jesse Josserand wrote:

> I apologize in advance for bothering you, but I've not been able to get
> answers from the community by searches I've done, nor have I figured out
> how to post a question there.
>
> I'm working for a gov't entity here in Mississippi and while I have
> extensive Oracle and MySQL experience, as well as Linux admin experience
> (which is what I was hired for), I've been given PostgreSQL DBA
> responsibilities since the last DBA quit abruptly (probably due to poor
> architecture and documentation here -- another thing I'm resolving).
>
> I'm having serious space issues in a production environment and psql
> commands and queries are not helping me isolate it nor determine the root
> cause... possibly due to my naivete.
>
> Would you be so kind as to give me some insight as to how to best determine
> what is growing to fast and why? I have a 20G disk that recently was
> increased to 40G and am now in less than 3 months almost out of space there
> again.
>
> Yours truly,
> Jesse Josserand, CTO
> IT Web Services, LLC <https://itwebservicesllc.com/> and
> Ace Consulting Solutions, Inc. <https://aceconsultingsolutionsinc.com/>

Hi,

Here's a query to list individual table sizes:

    select
        t.tablename as "object",
        pg_size_pretty(pg_relation_size(cast(t.tablename as text))) as "data",
        pg_size_pretty(pg_total_relation_size(cast(t.tablename as text))) as "total"
    from
        pg_tables t
    where
        t.schemaname = 'public'
    order by
        pg_total_relation_size(cast(t.tablename as text)) desc

I think the last column includes index sizes.

Running this repeatedly over time should show what's growing.

cheers,
raf



Re: Newbie needs help with space issue

От
"androxkentaki ."
Дата:
this sql for table size ends with error that some of relation was not found.
So this is better one:


    select
        t.schemaname ,
t.tablename as object
,pg_size_pretty(pg_relation_size(schemaname || '.' || tablename))
,pg_size_pretty(pg_total_relation_size(schemaname || '.' || tablename))

    from
        pg_tables t
    where 1=1
        --and t.schemaname = 'public'
        --and t.schemaname <> 'public'
    order by  pg_total_relation_size(schemaname || '.' || tablename) desc;

śr., 22 kwi 2020 o 06:25 Priancka Chatz <pc9926@gmail.com> napisał(a):
Hi,

Also you might want to check the logging settings and log file sizes if logging is enabled. Sometimes due to some issues in database, the number of log file entries can be a lot leading to large log files. 

Regards,
Priyanka

On Wed, 22 Apr 2020 at 9:21 AM, raf <raf@raf.org> wrote:
Jesse Josserand wrote:

> I apologize in advance for bothering you, but I've not been able to get
> answers from the community by searches I've done, nor have I figured out
> how to post a question there.
>
> I'm working for a gov't entity here in Mississippi and while I have
> extensive Oracle and MySQL experience, as well as Linux admin experience
> (which is what I was hired for), I've been given PostgreSQL DBA
> responsibilities since the last DBA quit abruptly (probably due to poor
> architecture and documentation here -- another thing I'm resolving).
>
> I'm having serious space issues in a production environment and psql
> commands and queries are not helping me isolate it nor determine the root
> cause... possibly due to my naivete.
>
> Would you be so kind as to give me some insight as to how to best determine
> what is growing to fast and why? I have a 20G disk that recently was
> increased to 40G and am now in less than 3 months almost out of space there
> again.
>
> Yours truly,
> Jesse Josserand, CTO
> IT Web Services, LLC <https://itwebservicesllc.com/> and
> Ace Consulting Solutions, Inc. <https://aceconsultingsolutionsinc.com/>

Hi,

Here's a query to list individual table sizes:

    select
        t.tablename as "object",
        pg_size_pretty(pg_relation_size(cast(t.tablename as text))) as "data",
        pg_size_pretty(pg_total_relation_size(cast(t.tablename as text))) as "total"
    from
        pg_tables t
    where
        t.schemaname = 'public'
    order by
        pg_total_relation_size(cast(t.tablename as text)) desc

I think the last column includes index sizes.

Running this repeatedly over time should show what's growing.

cheers,
raf





--
Z wyrazami szacunku
Andrzej Gerasimuk

Re: Newbie needs help with space issue

От
Priancka Chatz
Дата:
If you have the superuser login, you can get the individual table sizes by running 
\dt+ *.*

On Wed, 22 Apr 2020 at 12:53 PM, androxkentaki . <androxkentaki@gmail.com> wrote:
this sql for table size ends with error that some of relation was not found.
So this is better one:


    select
        t.schemaname ,
t.tablename as object
,pg_size_pretty(pg_relation_size(schemaname || '.' || tablename))
,pg_size_pretty(pg_total_relation_size(schemaname || '.' || tablename))

    from
        pg_tables t
    where 1=1
        --and t.schemaname = 'public'
        --and t.schemaname <> 'public'
    order by  pg_total_relation_size(schemaname || '.' || tablename) desc;

śr., 22 kwi 2020 o 06:25 Priancka Chatz <pc9926@gmail.com> napisał(a):
Hi,

Also you might want to check the logging settings and log file sizes if logging is enabled. Sometimes due to some issues in database, the number of log file entries can be a lot leading to large log files. 

Regards,
Priyanka

On Wed, 22 Apr 2020 at 9:21 AM, raf <raf@raf.org> wrote:
Jesse Josserand wrote:

> I apologize in advance for bothering you, but I've not been able to get
> answers from the community by searches I've done, nor have I figured out
> how to post a question there.
>
> I'm working for a gov't entity here in Mississippi and while I have
> extensive Oracle and MySQL experience, as well as Linux admin experience
> (which is what I was hired for), I've been given PostgreSQL DBA
> responsibilities since the last DBA quit abruptly (probably due to poor
> architecture and documentation here -- another thing I'm resolving).
>
> I'm having serious space issues in a production environment and psql
> commands and queries are not helping me isolate it nor determine the root
> cause... possibly due to my naivete.
>
> Would you be so kind as to give me some insight as to how to best determine
> what is growing to fast and why? I have a 20G disk that recently was
> increased to 40G and am now in less than 3 months almost out of space there
> again.
>
> Yours truly,
> Jesse Josserand, CTO
> IT Web Services, LLC <https://itwebservicesllc.com/> and
> Ace Consulting Solutions, Inc. <https://aceconsultingsolutionsinc.com/>

Hi,

Here's a query to list individual table sizes:

    select
        t.tablename as "object",
        pg_size_pretty(pg_relation_size(cast(t.tablename as text))) as "data",
        pg_size_pretty(pg_total_relation_size(cast(t.tablename as text))) as "total"
    from
        pg_tables t
    where
        t.schemaname = 'public'
    order by
        pg_total_relation_size(cast(t.tablename as text)) desc

I think the last column includes index sizes.

Running this repeatedly over time should show what's growing.

cheers,
raf





--
Z wyrazami szacunku
Andrzej Gerasimuk