Обсуждение: Duplicate oid and primary key values

Поиск
Список
Период
Сортировка

Duplicate oid and primary key values

От
Jeff Bohmer
Дата:
I have a table in a PG 7.4.1 database with 380 duplicate rows,
including duplicate oid and primary key values.  Looking through our
backups, the duplicates did not exist before Friday, 02/06/2004.  I'm
assuming neither pg_dumpall nor restoring from a pg_dumpall file will
eliminate such duplicates.  We upgraded from 7.3.4 to 7.4.1 on
02/02/2004.

What can cause these duplicates?

The server has had several system crashes over the past few days and weeks.

Below is my session with the DB showing an example of the duplicates,
the table structure, and trigger functions.

cos=> select oid, recordnumber from client where recordnumber = 10970;
    oid   | recordnumber
---------+--------------
  2427408 |        10970
(1 row)

cos=> select oid, recordnumber from client where recordnumber < 10971
and recordnumber > 10969;
    oid   | recordnumber
---------+--------------
  2427408 |        10970
  2427408 |        10970
(2 rows)

cos=> \d client
                                                Table "public.client"
         Column        |          Type           |
Modifiers
----------------------+-------------------------+------------------------------------------------------------------
  recordnumber         | integer                 | not null default
nextval('public.client_recordnumber_seq'::text)
  recordnumber_display | integer                 | not null
  access               | text                    |
  add1                 | character varying(255)  |
  add2                 | character varying(255)  |
  add_id               | integer                 |
  age                  | character varying(255)  |
  akas                 | character varying(255)  |
  besttime             | character varying(255)  |
  birthdate            | character varying(255)  |
  city                 | character varying(255)  |
  country              | character varying(255)  |
  creation_date        | date                    | not null default now()
  creation_time        | time without time zone  | not null default now()
  custom1              | character varying(255)  |
  custom10             | character varying(255)  |
  custom2              | character varying(255)  |
  custom3              | character varying(255)  |
  custom4              | character varying(255)  |
  custom5              | character varying(255)  |
  custom6              | character varying(255)  |
  custom7              | character varying(255)  |
  custom8              | character varying(255)  |
  custom9              | character varying(255)  |
  disability           | character varying(255)  |
  edit_date            | date                    | not null default now()
  edit_time            | time without time zone  | not null default now()
  edit_id              | integer                 |
  education            | character varying(255)  |
  email                | character varying(255)  |
  employer             | character varying(255)  |
  ethnicity            | character varying(1)    |
  extra1               | character varying(255)  |
  extra8               | character varying(255)  |
  first                | character varying(255)  |
  gender               | character varying(255)  |
  incomelevel          | character varying(255)  |
  incomenotes          | character varying(255)  |
  insurance            | character varying(255)  |
  last                 | character varying(255)  |
  location             | character varying(255)  |
  maritalstatus        | character varying(255)  |
  nochildren           | character varying(255)  |
  otherphone           | character varying(255)  |
  own_id               | integer                 |
  phhome               | character varying(255)  |
  phwork               | character varying(255)  |
  prefcontact          | character varying(255)  |
  primarylang          | character varying(255)  |
  referredby           | character varying(255)  |
  restrictorg_id       | integer                 |
  serverid             | character(5)            | not null
  ssno                 | character varying(255)  |
  state                | character varying(255)  |
  status               | integer                 |
  title                | character varying(255)  |
  transportation       | character varying(255)  |
  zip                  | character varying(255)  |
  extra2               | character varying(255)  |
  temp_extra8          | character varying(255)  |
  extra10              | character varying(255)  |
  authorize            | character varying(1000) |
Indexes:
     "client_pkey" primary key, btree (recordnumber)
     "idx_client_recordnum_display" unique, btree
(upper_concat(serverid, recordnumber_display))
     "idx_client_first" btree ("first")
     "idx_client_last" btree ("last")
     "idx_client_restrictorg_id" btree (restrictorg_id)
     "idx_client_serverid" btree (serverid)
     "idx_client_status" btree (status)
Foreign-key constraints:
     "$1" FOREIGN KEY (restrictorg_id) REFERENCES
agency_dbs(record_id) ON UPDATE CASCADE ON DELETE SET NULL
Triggers:
     tgr_client_edit_date BEFORE UPDATE ON client FOR EACH ROW EXECUTE
PROCEDURE fnc_edit_date()
     tgr_client_edit_time BEFORE UPDATE ON client FOR EACH ROW EXECUTE
PROCEDURE fnc_edit_time()
     tgr_client_recordnumber_display BEFORE INSERT ON client FOR EACH
ROW EXECUTE PROCEDURE fnc_recordnumber_display()

cos=> \connect - postgres
You are now connected as new user "postgres".
cos=# select prosrc from pg_proc where proname = 'fnc_recordnumber_display';
                                         prosrc
---------------------------------------------------------------------------------------
  DECLARE
         BEGIN
                 new.recordnumber_display = new.recordnumber;
                 RETURN new;
         END;
(1 row)

cos=# select prosrc from pg_proc where proname = 'fnc_edit_date';
                        prosrc
----------------------------------------------------
  BEGIN
                 new.edit_date := 'now';
         RETURN new;
         END;
(1 row)

cos=# select prosrc from pg_proc where proname = 'fnc_edit_time';
                        prosrc
----------------------------------------------------
  BEGIN
                 new.edit_time := 'now';
         RETURN new;
         END;
(1 row)


--

Jeff Bohmer
VisionLink, Inc.
_________________________________
303.402.0170
www.visionlink.org
_________________________________
People. Tools. Change. Community.

Re: Duplicate oid and primary key values

От
Richard Huxton
Дата:
On Tuesday 10 February 2004 17:10, Jeff Bohmer wrote:
> I have a table in a PG 7.4.1 database with 380 duplicate rows,
> including duplicate oid and primary key values.  Looking through our
> backups, the duplicates did not exist before Friday, 02/06/2004.  I'm
> assuming neither pg_dumpall nor restoring from a pg_dumpall file will
> eliminate such duplicates.  We upgraded from 7.3.4 to 7.4.1 on
> 02/02/2004.
>
> What can cause these duplicates?
>
> The server has had several system crashes over the past few days and weeks.

Hardware related? Or is it not clear yet?

> Below is my session with the DB showing an example of the duplicates,
> the table structure, and trigger functions.
>
> cos=> select oid, recordnumber from client where recordnumber = 10970;
>     oid   | recordnumber
> ---------+--------------
>   2427408 |        10970
> (1 row)
>
> cos=> select oid, recordnumber from client where recordnumber < 10971
> and recordnumber > 10969;
>     oid   | recordnumber
> ---------+--------------
>   2427408 |        10970
>   2427408 |        10970
> (2 rows)

In the absence of Tom or some other more knowledgable source, try these out.

SELECT xmin,cmin,xmax,cmax,tid,oid,* FROM ... to see if these are two versions
of the same row
Perhaps stick an EXPLAIN ANALYSE on the front of those and see if one is using
an index and the other not.

It might be a corrupted INDEX, in which case REINDEX should fix it.


PS - you probably want now() or CURRENT_DATE etc. in the trigger functions
rather than 'now'.
--
  Richard Huxton
  Archonet Ltd

Re: Duplicate oid and primary key values

От
"scott.marlowe"
Дата:
On Tue, 10 Feb 2004, Jeff Bohmer wrote:

>
> I have a table in a PG 7.4.1 database with 380 duplicate rows,
> including duplicate oid and primary key values.  Looking through our
> backups, the duplicates did not exist before Friday, 02/06/2004.  I'm
> assuming neither pg_dumpall nor restoring from a pg_dumpall file will
> eliminate such duplicates.  We upgraded from 7.3.4 to 7.4.1 on
> 02/02/2004.
>
> What can cause these duplicates?
>
> The server has had several system crashes over the past few days and weeks.

Check your hardware.  bad memory, bad cpu, or bad hard drives can cause
these problems.  Postgresql, like most databases, expects the hardware to
operate without errors.