debezium/dbz#2229 feat: implement batching interfaces for vector stor…#17
Open
KMohnishM wants to merge 1 commit into
Open
debezium/dbz#2229 feat: implement batching interfaces for vector stor…#17KMohnishM wants to merge 1 commit into
KMohnishM wants to merge 1 commit into
Conversation
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
2 times, most recently
from
July 15, 2026 04:44
fe6caa0 to
3986f6a
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 15, 2026 04:54
c987006 to
b66b70b
Compare
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 15, 2026 04:54
3986f6a to
f746a2f
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 15, 2026 05:03
b66b70b to
6a341ed
Compare
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 15, 2026 05:03
f746a2f to
3c020d5
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 18, 2026 12:57
6a341ed to
31fc9f8
Compare
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 18, 2026 12:57
3c020d5 to
6ee0c05
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 22, 2026 11:32
31fc9f8 to
d0bec60
Compare
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 22, 2026 11:32
6ee0c05 to
d4effec
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 22, 2026 11:40
d0bec60 to
7af1b13
Compare
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 22, 2026 11:40
d4effec to
73433c9
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 22, 2026 11:47
7af1b13 to
166db5d
Compare
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 22, 2026 11:47
73433c9 to
55eddb4
Compare
KMohnishM
force-pushed
the
gsoc-week-7-guides
branch
from
July 22, 2026 11:52
166db5d to
b2c082f
Compare
…e adapters and add benchmark script Signed-off-by: KMohnishM <kmohnishm@gmail.com>
KMohnishM
force-pushed
the
gsoc-week-8-benchmarks
branch
from
July 22, 2026 11:52
55eddb4 to
dc59b09
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…e adapters and add benchmark script
Description
This PR implements the first part of the GSoC Week 8 milestone for the PyDebeziumAI project. It introduces list-based batch processing interfaces to the
VectorStoreAdaptercontract and implements them across all three backends (Chroma, PGVector, and Milvus). It also adds a performance profiling utility to establish a baseline and measure batching speedup.Proposed Changes
upsert_batch(self, documents: list[Document])anddelete_batch(self, doc_ids: list[str])methods to theVectorStoreAdapterinterface.add_documentsanddeleteusing array parameters) to reduce network round-trips.Verification Results
Running the benchmark suite (
python3 tools/benchmark.py --num-records 100 --batch-size 20) demonstrates a 5.23x throughput speedup:Unit tests have been updated to ensure all mock adapters implemented in test suites comply with the updated interface.