I also spotted and fixed another little oversight: the temporary file didn't get deleted after the index build.
I've one note not directly related to buffering build. While I debugging buffering GiST index build, backend was frequently crashed. After recovery partially built index file was remain. Do we have some tool to detect such "dead" files? If not, probably we need some?