Skip to content

feat(buffer): integrate IVF and DiskANN with shared page cache - #766

Merged
iaojnh merged 6 commits into
alibaba:mainfrom
iaojnh:codex/buffer-pool-core-pr3
Sep 18, 2026
Merged

iaojnh merged 6 commits into
alibaba:mainfrom
iaojnh:codex/buffer-pool-core-pr3

Conversation

@iaojnh

@iaojnh iaojnh commented Sep 17, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add Buffer Storage support for IVF and DiskANN.
  • Reduce IVF posting-list copying through page-span reads.
  • Cache DiskANN graph pages with batched direct-I/O fallback under cache pressure.
  • Handle bypass-only budgets, preserve backing-file identity, and fix cache/I/O resource lifetimes.

Existing mmap and direct-I/O modes remain available.

Testing

  • macOS: 298 tests and 920 targeted regression executions passed.
  • clang-format and clang-tidy passed.
  • Linux and Windows validation pending CI.

@iaojnh iaojnh changed the title Codex/buffer pool core pr3 feat(buffer): integrate IVF and DiskANN with shared page cache Sep 17, 2026
Comment thread src/core/algorithm/ivf/ivf_index_provider.h Outdated
@iaojnh
iaojnh merged commit 059f208 into alibaba:main Sep 18, 2026
19 checks passed
@iaojnh iaojnh linked an issue Sep 18, 2026 that may be closed by this pull request
6 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature] Launch Buffer Storage for Memory-Bounded Query Caching

2 participants