Re: Possible rounding error of large float values?

Поиск
Список
Период
Сортировка
От Josh Berkus
Тема Re: Possible rounding error of large float values?
Дата
Msg-id 200408241252.30182.josh@agliodbs.com
обсуждение исходный текст
Ответ на Possible rounding error of large float values?  ("Adam Lancaster" <alancaster@preventsys.com>)
Ответы Re: Possible rounding error of large float values?  (Oliver Elphick <olly@lfix.co.uk>)
Список pgsql-sql
Adam,

> 9223372036854775807
>
> It gets selected out as:
>
> 9.22337203685478E18

This is a property of FLOAT data types.  They round.

> Which appears to be rounded. When we cast it to numeric type we get:
>
> 9223372036854780000
>
> Which also is rounded. It is still possible to find the row using the
> original value

Hmmm ... is 15 digits the limit of NUMERIC?   It may be.

> Is this expected behavior?

Yes.

-- 
Josh Berkus
Aglio Database Solutions
San Francisco


В списке pgsql-sql по дате отправления:

Предыдущее
От: "Adam Lancaster"
Дата:
Сообщение: Possible rounding error of large float values?
Следующее
От: Oliver Elphick
Дата:
Сообщение: Re: Possible rounding error of large float values?