Skip to content

test: verify persistence benchmark CI workflow#322

Open
deven96 wants to merge 1 commit into
mainfrom
test/persistence-benchmark-ci
Open

test: verify persistence benchmark CI workflow#322
deven96 wants to merge 1 commit into
mainfrom
test/persistence-benchmark-ci

Conversation

@deven96

@deven96 deven96 commented Mar 23, 2026

Copy link
Copy Markdown
Owner

Summary

Test PR to verify the persistence benchmark CI workflow works correctly now that the baseline exists on main.

Changes

  • Added a file header comment to the persistence benchmark (trivial change)

Purpose

This PR will trigger the persistence-benchmark.yml workflow when labeled with benchmark-persistence to verify:

  • ✅ Benchmark runs on main branch (baseline now exists)
  • ✅ Benchmark runs on PR branch
  • ✅ Comparison between main and PR is generated
  • ✅ Results are posted as a PR comment

After verification, this PR can be closed without merging.

@deven96 deven96 added the benchmark-persistence Trigger persistence benchmark CI workflow label Mar 23, 2026
@github-actions

github-actions Bot commented Mar 23, 2026

Copy link
Copy Markdown

Test Results

115 tests   115 ✅  4m 55s ⏱️
 28 suites    0 💤
  3 files      0 ❌

Results for commit 1289764.

♻️ This comment has been updated with latest results.

@deven96

deven96 commented Mar 23, 2026

Copy link
Copy Markdown
Owner Author

Bitcode seems to be failing with a sequence without a length

@github-actions

Copy link
Copy Markdown

Benchmark Results

group                                                        main                                   pr
-----                                                        ----                                   --
predicate_query_with_index/size_100                          1.01      3.1±0.00µs        ? ?/sec    1.00      3.0±0.00µs        ? ?/sec
predicate_query_with_index/size_1000                         1.00     28.9±0.02µs        ? ?/sec    1.00     28.8±0.02µs        ? ?/sec
predicate_query_with_index/size_10000                        1.01    401.0±2.62µs        ? ?/sec    1.00    398.0±0.17µs        ? ?/sec
predicate_query_with_index/size_100000                       1.01      4.9±0.01ms        ? ?/sec    1.00      4.9±0.00ms        ? ?/sec
predicate_query_without_index/size_100                       1.00      6.8±0.00µs        ? ?/sec    1.02      6.9±0.01µs        ? ?/sec
predicate_query_without_index/size_1000                      1.02    102.7±0.08µs        ? ?/sec    1.00    100.7±0.07µs        ? ?/sec
predicate_query_without_index/size_10000                     1.07    802.4±2.15µs        ? ?/sec    1.00    751.5±1.47µs        ? ?/sec
predicate_query_without_index/size_100000                    1.00     11.4±0.17ms        ? ?/sec    1.02     11.7±0.18ms        ? ?/sec
store_batch_insertion_without_predicates/size_100            1.00    197.2±1.92µs        ? ?/sec    1.01    199.0±2.34µs        ? ?/sec
store_batch_insertion_without_predicates/size_1000           1.02  1326.3±12.33µs        ? ?/sec    1.00  1300.0±16.86µs        ? ?/sec
store_batch_insertion_without_predicates/size_10000          1.00     14.2±0.17ms        ? ?/sec    1.00     14.1±0.06ms        ? ?/sec
store_batch_insertion_without_predicates/size_100000         1.00    141.6±2.16ms        ? ?/sec    1.02    144.8±1.44ms        ? ?/sec
store_retrieval_linear_cosine_similarity/size_100            1.00     90.0±0.56µs        ? ?/sec    1.00     89.9±0.35µs        ? ?/sec
store_retrieval_linear_cosine_similarity/size_1000           1.00   760.2±12.15µs        ? ?/sec    1.01   765.3±16.44µs        ? ?/sec
store_retrieval_linear_cosine_similarity/size_10000          1.01      7.1±0.05ms        ? ?/sec    1.00      7.1±0.02ms        ? ?/sec
store_retrieval_linear_cosine_similarity/size_100000         1.01     75.4±0.40ms        ? ?/sec    1.00     75.0±0.19ms        ? ?/sec
store_retrieval_linear_dot_product/size_100                  1.00     89.4±0.43µs        ? ?/sec    1.00     89.1±0.62µs        ? ?/sec
store_retrieval_linear_dot_product/size_1000                 1.00    745.7±9.21µs        ? ?/sec    1.00   745.7±11.14µs        ? ?/sec
store_retrieval_linear_dot_product/size_10000                1.00      7.0±0.03ms        ? ?/sec    1.01      7.1±0.06ms        ? ?/sec
store_retrieval_linear_dot_product/size_100000               1.00     73.0±0.45ms        ? ?/sec    1.01     73.9±0.67ms        ? ?/sec
store_retrieval_linear_euclidean_distance/size_100           1.01     89.1±0.76µs        ? ?/sec    1.00     88.6±0.59µs        ? ?/sec
store_retrieval_linear_euclidean_distance/size_1000          1.00    733.3±6.21µs        ? ?/sec    1.00    732.8±7.99µs        ? ?/sec
store_retrieval_linear_euclidean_distance/size_10000         1.00      7.0±0.03ms        ? ?/sec    1.00      7.0±0.04ms        ? ?/sec
store_retrieval_linear_euclidean_distance/size_100000        1.00     73.6±0.37ms        ? ?/sec    1.00     74.0±0.83ms        ? ?/sec
store_retrieval_no_condition/size_100                        1.00     90.4±0.75µs        ? ?/sec    1.00     90.4±0.35µs        ? ?/sec
store_retrieval_no_condition/size_1000                       1.00   766.9±10.50µs        ? ?/sec    1.03   786.9±24.00µs        ? ?/sec
store_retrieval_no_condition/size_10000                      1.00      7.1±0.04ms        ? ?/sec    1.00      7.1±0.04ms        ? ?/sec
store_retrieval_no_condition/size_100000                     1.00     75.5±0.17ms        ? ?/sec    1.01     76.5±0.52ms        ? ?/sec
store_retrieval_non_linear_hnsw/size_100                     1.01    180.1±0.52µs        ? ?/sec    1.00    177.9±0.85µs        ? ?/sec
store_retrieval_non_linear_hnsw/size_1000                    1.01    504.2±1.09µs        ? ?/sec    1.00    498.2±0.81µs        ? ?/sec
store_retrieval_non_linear_hnsw/size_10000                   1.00   1736.7±3.64µs        ? ?/sec    1.07   1857.9±3.60µs        ? ?/sec
store_retrieval_non_linear_hnsw/size_100000                  1.00     10.3±0.07ms        ? ?/sec    1.17     12.0±0.12ms        ? ?/sec
store_retrieval_non_linear_kdtree/size_100                   1.00    182.4±0.57µs        ? ?/sec    1.00    182.8±0.70µs        ? ?/sec
store_retrieval_non_linear_kdtree/size_1000                  1.00   1157.0±1.99µs        ? ?/sec    1.00   1155.6±1.21µs        ? ?/sec
store_retrieval_non_linear_kdtree/size_10000                 1.00     11.8±0.03ms        ? ?/sec    1.01     11.9±0.04ms        ? ?/sec
store_retrieval_non_linear_kdtree/size_100000                1.00    147.8±1.43ms        ? ?/sec    1.01    148.5±0.95ms        ? ?/sec
store_sequential_insertion_without_predicates/size_100       1.00    263.8±0.58µs        ? ?/sec    1.00    264.0±0.67µs        ? ?/sec
store_sequential_insertion_without_predicates/size_1000      1.00      2.6±0.01ms        ? ?/sec    1.01      2.6±0.01ms        ? ?/sec
store_sequential_insertion_without_predicates/size_10000     1.00     25.9±0.06ms        ? ?/sec    1.01     26.1±0.06ms        ? ?/sec
store_sequential_insertion_without_predicates/size_100000    1.00    258.4±0.78ms        ? ?/sec    1.01    260.0±0.31ms        ? ?/sec

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

benchmark-persistence Trigger persistence benchmark CI workflow

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant