Re: Add numeric_trim(numeric)
От
Pavel Stehule
Тема
Re: Add numeric_trim(numeric)
Дата
Msg-id
CAFj8pRBW73THWPN8aX0CpXt_hAzk7yvd_tGdfRaXoLzg0yToGw@mail.gmail.com
Ответ на
Add numeric_trim(numeric) (Marko Tiikkaja)
Список
Дерево обсуждения
Add numeric_trim(numeric) Marko Tiikkaja <marko@joh.to>
Re: Add numeric_trim(numeric) Alvaro Herrera <alvherre@2ndquadrant.com>
Re: Add numeric_trim(numeric) Robert Haas <robertmhaas@gmail.com>
Re: Add numeric_trim(numeric) Pavel Stehule <pavel.stehule@gmail.com>
Re: Add numeric_trim(numeric) Pavel Stehule <pavel.stehule@gmail.com>
Re: Add numeric_trim(numeric) Dean Rasheed <dean.a.rasheed@gmail.com>
Re: Add numeric_trim(numeric) Robert Haas <robertmhaas@gmail.com>
Re: Add numeric_trim(numeric) Dean Rasheed <dean.a.rasheed@gmail.com>
Re: Add numeric_trim(numeric) Tom Lane <tgl@sss.pgh.pa.us>
Re: Add numeric_trim(numeric) Marko Tiikkaja <marko@joh.to>
Re: Add numeric_trim(numeric) Dean Rasheed <dean.a.rasheed@gmail.com>
Re: Add numeric_trim(numeric) Pavel Stehule <pavel.stehule@gmail.com>
Re: Add numeric_trim(numeric) Pavel Stehule <pavel.stehule@gmail.com>
Re: Add numeric_trim(numeric) Robert Haas <robertmhaas@gmail.com>
Re: Add numeric_trim(numeric) Dean Rasheed <dean.a.rasheed@gmail.com>
Re: Add numeric_trim(numeric) Pavel Stehule <pavel.stehule@gmail.com>
Hi
2015-11-19 3:58 GMT+01:00 Marko Tiikkaja <marko@joh.to>:
Hi,
Here's a patch for the second function suggested in 5643125E.1030605@joh.to. This is my first patch trying to do anything with numerics, so please be gentle. I'm sure it's full of stupid.
January's commit fest, feedback welcome, yada yada..
I am looking on this patch and I don't understand to formula
dscale = (ndigits - arg.weight - 1) * DEC_DIGITS;
dscale = (ndigits - arg.weight - 1) * DEC_DIGITS;
the following rule is valid
DEC_DIGITS * ndigits >= dscale + arg.weight + 1
so dscale should be calculated like
dscale <= DEC_DIGITS * ndigits - arg.weight - 1
?
?
but your formula is correct and working. Can you explain it?
Regards
Pavel
.m
В списке pgsql-hackers по дате отправления
