[None][feat] Report per-request speculative-decoding acceptance on the response - #19311

Open

debermudez wants to merge 8 commits into

NVIDIA:mainfrom

debermudez:dbermudez/spec-decode-per-request-stats

Commits on Sep 23, 2026

None: fix per-position spec-decode arrays truncating at 16 positions
debermudez
committed
42369e8
None: feat: per-request speculative-decoding acceptance stats on the response
debermudez
committed
59de05b
None: fix: omit absent spec-decode stats instead of serializing null
debermudez
committed
0caf263
None: test: cover the spec-decode opt-in wiring and pin no-reallocation
debermudez
committed
997c71d
[None][fix] Attribute spec-decode stats to each n > 1 candidate

debermudez
and
claude
committed
cf87aca

Commits on Sep 25, 2026

Commits on Sep 26, 2026

Merge branch 'main' into dbermudez/spec-decode-per-request-stats
allisonlim-nv
authored
dfbb0da