[TRTLLM-12891][feat] Support the KV cache connector on KVCacheManagerV2 - #18700

Merged

brb-nv merged 10 commits into

NVIDIA:feat/m3_with_msafrom

brb-nv:user/brb/yuehtingc/kvconn-v2-registration

Sep 4, 2026

Commits on Sep 4, 2026

[None][fix] Restore is_generation_only_request as a property on LlmRequest

eopXD
authored and
brb-nv
committed
d33d65b
[None][fix] Reject KVCacheManagerV2 with the C++ cache transceiver

eopXD
authored and
brb-nv
committed
7d6b882
[None][test] Run the KV connector suite against both KV cache managers

eopXD
authored and
brb-nv
committed
d9f6ed9
[None][feat] Describe KVCacheManagerV2's KV pools to the connector

eopXD
authored and
brb-nv
committed
c68b566
[None][feat] Drive the connector's scheduler hooks from KVCacheManagerV2

eopXD
authored and
brb-nv
committed
3f369f2
[None][feat] Let the KV connector reach KVCacheManagerV2 under VSWA

eopXD
authored and
brb-nv
committed
92feaac
[None][feat] Serve a connector-supplied prefix on KVCacheManagerV2

eopXD
authored and
brb-nv
committed
0512058
[None][doc] Document the connector contract on KVCacheManagerV2

eopXD
authored and
brb-nv
committed
31235fa
[None][test] Gate the KVCacheManagerV2 connector tests in pre-merge CI

eopXD
authored and
brb-nv
committed
41a8efd
[None][fix] Address review feedback on the KVCacheManagerV2 connector

eopXD
authored and
brb-nv
committed
5535069