Re: Out of Memory errors are frustrating as heck!
От
Justin Pryzby
Тема
Re: Out of Memory errors are frustrating as heck!
Дата
Msg-id
20190421101908.GC14223@telsasoft.com
Ответ на
Re: Out of Memory errors are frustrating as heck! (Justin Pryzby)
Список
Дерево обсуждения
Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Peter <pmc@citylink.dinoex.sub.org>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Jeremy Schneider <schneider@ardentperf.com>
Re: Out of Memory errors are frustrating as heck! Gaetano Mendola <mendola@gmail.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Justin Pryzby <pryzby@telsasoft.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Gaetano Mendola <mendola@gmail.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Gunther <raj@gusw.net>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Out of Memory errors are frustrating as heck! Tom Lane <tgl@sss.pgh.pa.us>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Gavin Flower <GavinFlower@archidevsys.co.nz>
Re: Out of Memory errors are frustrating as heck! Jean-David Beyer <jeandavid8@verizon.net>
Re: Out of Memory errors are frustrating as heck! Gavin Flower <GavinFlower@archidevsys.co.nz>
Re: Out of Memory errors are frustrating as heck! Merlin Moncure <mmoncure@gmail.com>
Re: Out of Memory errors are frustrating as heck! Merlin Moncure <mmoncure@gmail.com>
Re: Out of Memory errors are frustrating as heck! Jeff Janes <jeff.janes@gmail.com>
Re: Out of Memory errors are frustrating as heck! Tomas Vondra <tomas.vondra@2ndquadrant.com>
I was able to reproduce in a somewhat contrived way:
sh -c 'ulimit -v 1024000 ; /usr/local/pgsql/bin/postgres -D ./pg12dev5 -cport=1234' &
postgres=# SET work_mem='64kB';SET client_min_messages =debug1;SET log_statement_stats=on;explain(analyze) WITH v AS MATERIALIZED (SELECT * FROM generate_series(1,9999999)i WHERE i%10<10 AND i%11<11 AND i%12<12 AND i%13<13 AND i%14<14 AND i%15<15 AND i%16<16 AND i%17<17 AND i%18<18 AND i%19<19 AND i%20<20 AND i%21<21 ) SELECT * FROM generate_series(1,99)k JOIN v ON k=i;
HashTableContext: 8192 total in 1 blocks; 7696 free (7 chunks); 496 used
hash batch files: 852065104 total in 101318 blocks; 951896 free (20 chunks); 851113208 used
HashBatchContext: 73888 total in 4 blocks; 24280 free (6 chunks); 49608 used
2019-04-21 04:11:02.521 CDT [4156] ERROR: out of memory
2019-04-21 04:11:02.521 CDT [4156] DETAIL: Failed on request of size 8264 in memory context "hash batch files".
В списке pgsql-performance по дате отправления