Repository navigation
feat: v0.6.0 qualification, memory bounds, and release hardening - #9
Merged
MUDASSIR-75 merged 2 commits intoNov 6, 2026
Merged
Conversation
MUDASSIR-75
approved these changes
Nov 6, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Overview
This PR brings LongCache to v0.6.0, focusing on qualification, memory safety, and release hardening before freezing the
1.0.0public API contract.Existing Format-2 SQLite and Redis caches remain 100% backward-compatible and do not require any cache reset or migration.
Key Improvements
Leaner Index Rebuilds & Compaction:
Instead of pulling full response payloads into memory during cache index rebuilds, backends now stream lightweight
(id, vector, metadata)entries in paged batches. Added an immediate compaction threshold so stale vectors are cleaned up during heavy churn rather than waiting for periodic sweeps.Multi-Process Redis Resilience:
Added a dedicated stress suite (
test_qualification_stress_v6.py) verifying shared Redis stability under sustained write/delete churn, singleflight leader crashes (SIGKILL) with automatic follower takeover, and clean fail-closed quarantine during server restarts.Examples Automation & Format Compatibility:
Added automated end-to-end test execution for all 7 scripts in
examples/and the README quickstart (wheel_examples_v6.py). Verified fail-closed rejection of legacy0.1.xstores and confirmed full roundtrip compatibility across all supported response codecs.Cost-Savings & Latency Model:
Added a reproducible cost model (
evaluation/cost_model.py) and updated benchmark docs with transparent formulas to calculate break-even hit rates and net LLM cost savings.Release Engineering & Runbook:
Bumped version to
0.6.0, added a release verification script (verify_release_v6.py) that audits version sync and package cleanliness without pulling in runtime dependencies, and documented the release checklist and rollback runbook indocs/release-process.md.