Re: [External] Re: postgresql-11 installation errors via deb packageon ubuntu 16

uname -a
Linux <hostname> 4.4.0-116-generic #140-Ubuntu SMP Mon Feb 12 21:23:04
UTC 2018 x86_64 x86_64 x86_64 GNU/Linux

lsb_release -a
Distributor ID: Ubuntu
Description:    Ubuntu 16.04.4 LTS
Release:        16.04
Codename:       xenial

no, these fresh installations. existing installations do not have issues.
we have customization, but at the core, this is the part which is
installing the package.
https://github.com/puppetlabs/puppetlabs-postgresql/blob/master/manifests/server/install.pp
 (the puppet module version being 4.9.0 though)

now this never happens in my vagrant (I am from india) and all my runs
are clean.
this happens when we run installations on US machines, but coz this is
not reproducible, i do not know if this is package issue or something
else.

also i tried to check if there are issues with apt database etc, but
none of the other packages show errors in installation but this.



from /var/lib/dpkg/status, both package show as installed ok.


Package: postgresql-common
Status: install ok installed
Priority: optional
Section: database
Installed-Size: 627
Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
Architecture: all
Multi-Arch: foreign
Version: 199.pgdg16.04+1
Depends: adduser, debconf (>= 0.5.00) | debconf-2.0, lsb-base (>=
3.0-3), postgresql-client-common (= 199.pgdg16.04+1), procps, ssl-cert
(>= 1.0.11), ucf, init-system-helpers (>= 1.18~)
Recommends: e2fsprogs, logrotate
Suggests: libjson-perl
Breaks: postgresql-9.1 (<< 9.1.1-3~), systemd (<< 204)
Conflicts: postgresql-7.4, postgresql-8.0
Conffiles:
 /etc/apt/apt.conf.d/01autoremove-postgresql ce792928ef7a41f68842bb9380ddcc48
 /etc/init.d/postgresql 1b9da643d7a403248d70e1776fb98458
 /etc/logrotate.d/postgresql-common 101326ef5d138998692ece35109ef1a2
 /etc/sysctl.d/30-postgresql-shm.conf 9453b06c646f9033eada574154c31a9d
Description: PostgreSQL database-cluster manager
 The postgresql-common package provides a structure under which
 multiple versions of PostgreSQL may be installed and/or multiple
 clusters maintained at one time.
 .
 The commands provided are pg_conftool, pg_createcluster, pg_ctlcluster,
 pg_dropcluster, pg_lsclusters, pg_renamecluster, pg_upgradecluster,
 pg_virtualenv.
 .
 PostgreSQL is a fully featured object-relational database management
 system. It supports a large part of the SQL standard and is designed
 to be extensible by users in many aspects. Its features include ACID
 transactions, foreign keys, views, sequences, subqueries, triggers,
 outer joins, multiversion concurrency control, and user-defined types
 and functions.



Package: postgresql-11
Status: install ok installed
Priority: optional
Section: database
Installed-Size: 43901
Maintainer: Debian PostgreSQL Maintainers <team+postgresql@tracker.debian.org>
Architecture: amd64
Version: 11.2-1.pgdg16.04+1
Provides: postgresql-contrib-11
Depends: locales | locales-all, postgresql-client-11,
postgresql-common (>= 194~), ssl-cert, tzdata, debconf (>= 0.5) |
debconf-2.0, libc6 (>= 2.17), libgcc1 (>= 1:3.0), libgssapi-krb5-2 (>=
1.8+dfsg), libicu55 (>= 55.1-1~), libldap-2.4-2 (>= 2.4.7), libllvm6.0
(>= 1:6.0~svn298832-1~), libpam0g (>= 0.99.7.1), libpq5 (>= 9.3~),
libselinux1 (>= 2.1.12), libssl1.0.0 (>= 1.0.2~beta3), libstdc++6 (>=
5.2), libsystemd0, libuuid1 (>= 2.16), libxml2 (>= 2.7.4), libxslt1.1
(>= 1.1.25), zlib1g (>= 1:1.1.4)
Recommends: sysstat
Breaks: postgresql-11-citus (<< 8.0.0.PGDG-2~), postgresql-11-cron (<<
1.1.3-2~), postgresql-11-pgextwlist (<< 1.8-2~),
postgresql-11-pglogical (<< 2.2.1-4~), postgresql-11-plsh (<<
1.20171014-3~), postgresql-11-rum (<< 1.3.2-4~),
postgresql-11-wal2json (<< 1.0-5~)
Description: object-relational SQL database, version 11 server
 PostgreSQL is a powerful, open source object-relational database
 system. It is fully ACID compliant, has full support for foreign
 keys, joins, views, triggers, and stored procedures (in multiple
 languages). It includes most SQL:2008 data types, including INTEGER,
 NUMERIC, BOOLEAN, CHAR, VARCHAR, DATE, INTERVAL, and TIMESTAMP. It
 also supports storage of binary large objects, including pictures,
 sounds, or video. It has native programming interfaces for C/C++,
 Java, .Net, Perl, Python, Ruby, Tcl, ODBC, among others, and
 exceptional documentation.
 .
 This package provides the database server for PostgreSQL 11.
Homepage: http://www.postgresql.org/
Postgresql-Catversion: 201809051




let me know if you need more info.

Regards,
Vijay

On Mon, Mar 18, 2019 at 8:06 PM Adrian Klaver <adrian.klaver@aklaver.com> wrote:
>
> On 3/18/19 7:24 AM, Vijaykumar Jain wrote:
> > Hey Guys,
> >
> > I do not know if this list is also for asking ubuntu package related queries.
> >
> > We have been recently getting a lot of below errors, as a result of
> > which the entire postgresql installation gets broken.
> > the config folder /etc/postgresql/* is empty, initdb fails to
> > initialize the db and we cannot move forward.
> >
> > the problem is this is happening only on a certain set of servers, but not all.
> > so i do not know if this is an issue with the package or anything else?
> > maybe bad mirror?
>
> Per the package below the servers are all Xenial, correct?
> More below.
>
>
> >
> > i came across a similar issue but this is ages back.
> > https://stackoverflow.com/questions/2748607/how-to-thoroughly-purge-and-reinstall-postgresql-on-ubuntu
> > and it was marked close for some reasons.
> > i get the part that removing everything and reinstalling the package
> > resolves the issue,
> >
> >
> >     24  service postgresql stop
> >     25  rm -rf /etc/postgresql*
> >     26  rm -rf /var/lib/postgresql*
> >     27  rm -rf /var/run/postgresql*
> >     28  rm /var/cache/apt/archives/postgresql-*
> >     29  apt-get purge postgresql-11
> >     30  apt-get purge postgresql-client-common
> >     31  rm -rf /var/log/postgresql*
> >     32  puppet agent -t --debug --verbose  (this takes care of installation)
>
> So what is Puppet actually doing?
>
> Do you have Postgres clusters that exist before you try the initial install?
>
> >
> > and then things are fine from here on.
> >
> >
> >
> > error messages from /var/log/apt/term.log
> >
> >
> > Preparing to unpack .../postgresql-11_11.2-1.pgdg16.04+1_amd64.deb ...
> > Unpacking postgresql-11 (11.2-1.pgdg16.04+1) ...
> > Processing triggers for postgresql-common (199.pgdg16.04+1) ...
> > Building PostgreSQL dictionaries from installed myspell/hunspell packages...
> > Removing obsolete dictionary files:
> > Setting up postgresql-11 (11.2-1.pgdg16.04+1) ...
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Unescaped left brace in regex is deprecated, passed through in regex;
> > marked by <-- HERE in m/(?<!\\)\${ <-- HERE ([^}]+)}/ at
> > /usr/sbin/pam_getenv line 78.
> > Configuring already existing cluster (configuration:
> > /etc/postgresql/11/main, data: /var/lib/postgresql/11/main, owner:
> > 112:118)
> > Error: move_conffile: required configuration file
> > /var/lib/postgresql/11/main/postgresql.conf does not exist
> > Error: could not create default cluster. Please create it manually with
> >
> >    pg_createcluster 11 main --start
> >
> > ----
> > all installation happen via
> > deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main 11
> >
> > this has been really painful to debug, coz i do not know how randomly
> > we get these errors and sometimes not.
> >
> >
> >
> > Regards,
> > Vijay
> >
> >
>
>
> --
> Adrian Klaver
> adrian.klaver@aklaver.com