Skip to content

serve: forward-serve speculative decoding (--spec-lookup K, --spec-draft <dir>), token for token the plain reply (refs #1781) - #2260

Merged
bong-water-water-bong merged 2 commits into
mainfrom
cl-npuperf/1781-serve-spec
Nov 12, 2026
Merged

bong-water-water-bong merged 2 commits into
mainfrom
cl-npuperf/1781-serve-spec

Commits

  1. Commits on Nov 12, 2026