Re: Float8 precision problem

Поиск
Список
Период
Сортировка
От Dann Corbit
Тема Re: Float8 precision problem
Дата
Msg-id D425483C2C5C9F49B5B7A41F8944154757DDBB@postal.corporate.connx.com
обсуждение исходный текст
Ответ на Float8 precision problem  (Hengki Suhartoyo <hengman03@yahoo.com>)
Список pgsql-general
And (indeed) that is exactly the answer that you received [within
DLB_DIG units of precision].

I guess that you will be happier with NUMERIC(precision, scale) because
the results of operations will be closer to what you expect.

Suggested reading:
http://www.physics.ohio-state.edu/~dws/grouplinks/floating_point_math.pd
f

________________________________________
From: pgsql-general-owner@postgresql.org
[mailto:pgsql-general-owner@postgresql.org] On Behalf Of Hengki
Suhartoyo
Sent: Thursday, November 30, 2006 2:56 AM
To: pgsql-general@postgresql.org
Subject: [GENERAL] Float8 precision problem

Hi all,

I got problem in postgrsql 8.0 when subtraction in float8, this is my
query :
select 6.1::float8-6::float8

Result>>> 0.099999999999996

I need the result like natural subtraction is 0.1

Help me please....

________________________________________
Want to start your own business? Learn how on Yahoo! Small Business.

В списке pgsql-general по дате отправления:

Предыдущее
От: Hengki Suhartoyo
Дата:
Сообщение: Float8 precision problem
Следующее
От: Teodor Sigaev
Дата:
Сообщение: Re: postgresql 8.2 rc1 - crash