Re: UTF8 with BOM support in psql

Поиск
Список
Период
Сортировка
Искать
От
Itagaki Takahiro
Тема
Re: UTF8 with BOM support in psql
Дата
Msg-id
20091117093151.14F2.52131E4D@oss.ntt.co.jp
Ответ на
Список
Дерево обсуждения
UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Bruce Momjian <bruce@momjian.us>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql David Christensen <david@endpoint.com>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Chuck McDevitt <cmcdevitt@greenplum.com>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Chuck McDevitt <cmcdevitt@greenplum.com>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Chuck McDevitt <cmcdevitt@greenplum.com>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Andrew Dunstan <andrew@dunslane.net>
Re: UTF8 with BOM support in psql Peter Eisentraut <peter_e@gmx.net>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Itagaki Takahiro <itagaki.takahiro@oss.ntt.co.jp>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Tom Lane <tgl@sss.pgh.pa.us>
Re: UTF8 with BOM support in psql Magnus Hagander <magnus@hagander.net>
Re: UTF8 with BOM support in psql "Kevin Grittner" <Kevin.Grittner@wicourts.gov>

Peter Eisentraut  wrote:

> OK, I think the consensus here is:
> - Eat BOM at beginning of file (as you implemented)
> - Only when client encoding is UTF-8 --> please fix that

Are they AND condition? If so, this patch will be useless.
Please remember \encoding or SET client_encoding appear
*after* BOM at beginning of file. I'll agree if the condition is 
"Eat BOM at beginning of file and <>",
like:
Defining Python Source Code Encodings:   http://www.python.org/dev/peps/pep-0263/

> I'm not sure if replacing a BOM by three spaces is a good way to
> implement "eating", because it might throw off a column indicator
> somewhere, say, but I couldn't reproduce a problem.  Note that the U
> +FEFF character is defined as *zero-width* non-breaking space.

I assumed psql discards whitespaces automatically, but I see it is
more robust to remove BOM bytes explitly. I'll fix it.

Regards,
---
ITAGAKI Takahiro
NTT Open Source Software Center



В списке pgsql-hackers по дате отправления
От: Tatsuo Ishii
Дата:
От: Jan Urbański
Дата:
FAQ