Обсуждение: encoding error

Hello,

I try to insert some japanese text in my database. But it fails with
duplicate value error, although I use two different values. My database
is set up with UNICODE, I even tried a SQL_ASCII set up where I do all
conversion manual, but nothing worked, the error persists. Please find
the smallest possible example attached below.

I verified it in 7.4.7 and 8.1.

Any ideas welcome!

TIA

Ulrich


createdb test -E unicode

in psql:

create table kw(keyword varchar(256) primary key);

insert into kw (keyword) values
('ã\202­ã\203£ã\203©ã\203¡ã\203«ã\202\222è³¼å\205¥ã\201\231ã\202\213');
insert into kw (keyword) values
('ã\202¬ã\203\212ã\203\203ã\202·ã\203¥ã\202\222è³¼å\205¥ã\201\231ã\202\213');
ERROR:  duplicate key violates unique constraint "kw_pkey"

Ulrich Wisser <liste@publisher.de> writes:
> I try to insert some japanese text in my database. But it fails with
> duplicate value error, although I use two different values. My database
> is set up with UNICODE,

and what locale? On what platform?

There are a lot of locale definitions out there that fail badly on data
that is not encoded per the encoding they expect.

            regards, tom lane