On Wed, 22 Dec 2004, Dave Page wrote:
>
>
>> -----Original Message-----
>> From: Oleg Bartunov [mailto:oleg@sai.msu.su]
>> Sent: 22 December 2004 13:26
>> To: Dave Page
>> Cc: Steve Simms; pgsql-www@postgresql.org
>> Subject: RE: [pgsql-www] Ready to launch?
>>
>> How much pages rebuildes and does everything rebuilded each run,
>> regardless on changes ?
>> 20+ minutes looks too much for medium sized server.
>>
>
> It builds around 10,000 pages, and does so by spidering the site as an
> indexer would, and saving the output. It's clearly not the most
> efficient way, but given the number of different ways that pages get
> built on the site, it is certainly the most maintainable.
>
> I have a suspicion that it might not be avoiding saving duplicate links
> but I haven't checked that yet.
if you spidering via http you could ask if page was modified since last rebuild
and you'll save a lot. Check is your servers actually provides such information,
probably you need to configure them properly.
>
> Regards, Dave
>
> ---------------------------(end of broadcast)---------------------------
> TIP 7: don't forget to increase your free space map settings
>
Regards,
Oleg
_____________________________________________________________
Oleg Bartunov, sci.researcher, hostmaster of AstroNet,
Sternberg Astronomical Institute, Moscow University (Russia)
Internet: oleg@sai.msu.su, http://www.sai.msu.su/~megera/
phone: +007(095)939-16-83, +007(095)939-23-83