Re: Numeric Scale Differences

Поиск
Список
Период
Сортировка
От Tom Lane
Тема Re: Numeric Scale Differences
Дата
Msg-id 2404795.1634825164@sss.pgh.pa.us
обсуждение исходный текст
Ответ на Numeric Scale Differences  (Nuno Sousa <nunofgs@gmail.com>)
Ответы Re: Numeric Scale Differences  (Nuno Sousa <nunofgs@gmail.com>)
Список pgsql-novice
Nuno Sousa <nunofgs@gmail.com> writes:
> I've run into an interesting issue when trying to do numeric math. I
> expected the following to return the same number of decimal digits in the
> fractional part:

> select scale(1/0.6::numeric), scale(1/6::numeric);

Um ... why did you expect that?  The inputs to the divisions have
different scales:

# select scale(0.6::numeric), scale(6::numeric);
 scale | scale 
-------+-------
     1 |     0
(1 row)

so I find it unsurprising that the outputs do too.  Now the fact
that the output scales differ by 4 not 1 is indeed an implementation
artifact.  It stems from the numeric type working with base-10000
digits, so that scales that are multiples of 4 are most efficient,
hence division will always choose such an output scale.

            regards, tom lane



В списке pgsql-novice по дате отправления:

Предыдущее
От: Nuno Sousa
Дата:
Сообщение: Numeric Scale Differences
Следующее
От: Nuno Sousa
Дата:
Сообщение: Re: Numeric Scale Differences