Skip to content

[None][feat] Report per-request speculative-decoding acceptance on the response - #19311

Open
debermudez wants to merge 8 commits into
NVIDIA:mainfrom
debermudez:dbermudez/spec-decode-per-request-stats
Open

debermudez wants to merge 8 commits into
NVIDIA:mainfrom
debermudez:dbermudez/spec-decode-per-request-stats

Merge branch 'main' into dbermudez/spec-decode-per-request-stats

dfbb0da
Select commit
Loading
Failed to load commit list.