Hi,
Dave Page wrote:
>>Do you spider all the static docs every time? They only need to be
>>regenerated on design change or docs update after a new release.
>
> At the moment it spiders the whole site, exactly as you wrote it (with
> the exception that it ignores /redir).
Yes, I also wrote it to accept a -r preg_pattern command line switch.
Running it like mirror.php -r "~/static/~" (not tested) may do the trick...
The script also knows the standard -h / --help switch, BTW...
> Would it? I don't know how many links there are to the doc sets. Mind
> you, I suppose each doc links to the next and previous, so it would hit
> each at least 3 times which it clearly isn't.
Of course, the saved links are remembered and are not crawled again.