Skip to content

npu: a grammar-constrained reply can stop, so json_schema/json_object stop padding to max_tokens (#1182) - #1188

Merged
bong-water-water-bong merged 2 commits into
mainfrom
1bit/npu-grammar-eos
Nov 6, 2026
Merged

bong-water-water-bong merged 2 commits into
mainfrom
1bit/npu-grammar-eos

Commits

  1. Commits on Nov 6, 2026