On Wed, 28 Feb 2024 at 14:42, Nazir Bilal Yavuz <byavuz81@gmail.com> wrote: > > > The new version of the streaming read API [1] is posted. I updated the > streaming read API changes patch (0001), using the streaming read API > in ANALYZE patch (0002) remains the same. This should make it easier > to review as it can be applied on top of master > >
The new version of the streaming read API is posted [1]. I rebased the patch on top of master and v9 of the streaming read API.
There is a minimal change in the 'using the streaming read API in ANALYZE patch (0002)', I changed STREAMING_READ_FULL to STREAMING_READ_MAINTENANCE to copy exactly the same behavior as before. Also, some benchmarking results:
I created a 22 GB table and set the size of shared buffers to 30GB, the rest is default.
╔═══════════════════════════╦═════════════════════╦════════════╗ ║ ║ Avg Timings in ms ║ ║ ╠═══════════════════════════╬══════════╦══════════╬════════════╣ ║ ║ master ║ patched ║ percentage ║ ╠═══════════════════════════╬══════════╬══════════╬════════════╣ ║ Both OS cache and ║ ║ ║ ║ ║ shared buffers are clear ║ 513.9247 ║ 463.1019 ║ %9.9 ║ ╠═══════════════════════════╬══════════╬══════════╬════════════╣ ║ OS cache is loaded but ║ ║ ║ ║ ║ shared buffers are clear ║ 423.1097 ║ 354.3277 ║ %16.3 ║ ╠═══════════════════════════╬══════════╬══════════╬════════════╣ ║ Shared buffers are loaded ║ ║ ║ ║ ║ ║ 89.2846 ║ 84.6952 ║ %5.1 ║ ╚═══════════════════════════╩══════════╩══════════╩════════════╝