Re: multi terabyte fulltext searching

> I am currently using GIST indexes because I receive about 10GB of new
> data a week (then again I am not deleting any information).  The do not
> expect to be able to stop receiving text for about 5 years, so the data
> is not going to become static any time soon.  The reason I am concerned
> with performance is that I am providing a search system for several
> newspapers since essentially the beginning of time.  Many bibliographer
> etc would like to use this utility but if each search takes too long I
> am not going to be able to support many concurrent users.

Use GiST and GIN indexes together: any data older than one month (which doesn't
change) with GIN index and new data with GiST. And one time per month moves data
from GiST to GIN.

--
Teodor Sigaev                                   E-mail: teodor@sigaev.ru
                                                    WWW: http://www.sigaev.ru/