[None][perf] enable zero-copy token passing in KVCacheManagerV2 - #17308

Merged

lowsfer merged 12 commits into

NVIDIA:mainfrom

lowsfer:kvcm2-cpp-follow-up

Aug 11, 2026

Commits on Aug 10, 2026

[None][docs] add KVCacheManagerV2 C++ development guide
lowsfer
committed
21c3b10
[None][refactor] simplify KVCacheManagerV2 token and key handling
lowsfer
committed
8860441
[None][perf] KVv2: zero-copy int32 token ingest on the block-reuse hot path
lowsfer
committed
7e87d33
[None][fix] filter partial KV cache event coverage
lowsfer
committed
ebd6115
[None][test] cover KV cache event derivation with real blocks
lowsfer
committed
aece44e
[None][fix] order KV cache tree teardown before storage
lowsfer
committed
c792b3e
[None][fix] harden KVCacheManagerV2 edge cases
lowsfer
committed
66f6b35
[None][fix] address KVCacheManagerV2 review follow-ups
lowsfer
committed
27693ca
[None][fix] drop stale SsmCommittedPage references in KVCacheManagerV2 introspection
lowsfer
committed
ab865ac
[None][fix] add get_tokens_view to KVCacheManagerV2 test request fakes
lowsfer
committed
44eb9fa
[None][fix] address KVCacheManagerV2 review feedback
lowsfer
committed
4fbd212
[None][perf] inline the TokenIdExt hot path and constrain zero-copy ingest to CPU
lowsfer
committed
cb56bff