> -----Original Message-----
> From: Joshua D. Drake [mailto:jd@commandprompt.com]
> Sent: 29 August 2006 15:28
> To: Dave Page
> Cc: PostgreSQL WWW
> Subject: Re: [pgsql-www] A counter productive conversation
> about search.
>
>
> >> So is anyone up for helping develop a page grabber?
> >
> > We have one - it builds the static version of the main site
> by spidering
> > it hourly.
>
> Should we look at that then?
Is that the "Royal" we? I'm currently in 'no more project atm' mode, but
as far as I'm concerned you're welcome to work on it yourself on the
understanding that whatever you come up with will only be accepted to
replace the current solution if the community (-www) agrees that it is
a) better from a user perspective, b) more maintainable and c) matches
the main site look'n'feel.
FWIW, one of the problems with building a true online index of the
archives is that we don't know what URL a message might have until it
has been indexed by the archives site. Currently that is then indexed by
ASPSeek sometime later. It might be worth considering rewriting both the
archives and the search to make it all truly realtime. That shouldn't be
terribly difficult apart from generating thread indexes/forward/back
links, and dealing with the historic URL problem. A SMOP you might
say...
:-p
Regards, Dave.