Re: WIP: index support for regexp search
От
Alexander Korotkov
Тема
Re: WIP: index support for regexp search
Дата
Msg-id
CAPpHfdv5xmBoTCkxuFBnD8LFtD8-DALQaqrGT7tRLLHKYg-OSQ@mail.gmail.com
Ответ на
Re: WIP: index support for regexp search (Erik Rijkers)
Список
Дерево обсуждения
WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <heikki.linnakangas@enterprisedb.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Marti Raudsepp <marti@juffo.org>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Tomas Vondra <tv@fuzzy.cz>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Pavel Stehule <pavel.stehule@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Pavel Stehule <pavel.stehule@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Heikki Linnakangas <hlinnakangas@vmware.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erikjan Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search David Fetter <david@fetter.org>
Re: WIP: index support for regexp search Tom Lane <tgl@sss.pgh.pa.us>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erikjan Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Stephen Frost <sfrost@snowman.net>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "er" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search "Erik Rijkers" <er@xs4all.nl>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Re: WIP: index support for regexp search Robert Haas <robertmhaas@gmail.com>
Re: WIP: index support for regexp search Alexander Korotkov <aekorotkov@gmail.com>
Hi!
Thank you for your feedback!
On Fri, Jan 20, 2012 at 3:33 AM, Erik Rijkers <er@xs4all.nl> wrote:
------
With best regards,
Alexander Korotkov.
The patch yields spectacular speedups with small, simple-enough regexen. But it does not do agood enough job when guessing where to use the index and where fall back to Seq Scan. This can
lead to (also spectacular) slow-downs, compared to Seq Scan.
Could you give some examples of regexes where index scan becomes slower than seq scan?
I guessed that MAX_COLOR_CHARS limits the character class size (to 4, in your patch), is that
true? I can understand you want that value to be low to limit the above risk, but now it reduces
the usability of the feature a bit: one has to split up larger char-classes into several smaller
ones to make a statement use the index: i.e.:
Yes, MAX_COLOR_CHARS is number of maximum character in automata color when that color is divided to a separated characters. And it's likely there could be better solution than just have this hard limit.
Btw, it seems impossible to Ctrl-C out of a search once it is submitted; I suppose this is
normally necessary for perfomance reasons, but it would be useful te be able to compile a test
version that allows it. I don't know how hard that would be.
I seems that Ctrl-C was impossible because procedure of trigrams exctraction becomes so long while it is not breakable. It's not difficult to make this procedure breakable, but actually it just shouldn't take so long.
There is also a minor bug, I think, when running with 'set enable_seqscan=off' in combination
with a too-large regex:
Thanks for pointing. Will be fixed.
With best regards,
Alexander Korotkov.
В списке pgsql-hackers по дате отправления