Skip to content

serve: speculative decode serves logprobs from each token's own row; verify rows strided by the head width (refs #1781) - #2267

Merged
bong-water-water-bong merged 6 commits into
mainfrom
cl-npuperf/1781-spec-logprobs
Nov 12, 2026
Merged

bong-water-water-bong merged 6 commits into
mainfrom
cl-npuperf/1781-spec-logprobs

Commits

  1. Commits on Nov 12, 2026