Skip to content

npu: the decode lm head on the host, bit-identical logits — head time 51–78 ms → 8–18 ms per token on Qwen3.5-2B (opt-in, Refs #1785) - #2191

Merged
bong-water-water-bong merged 3 commits into
mainfrom
1bit/1785-host-head
Nov 11, 2026
Merged

bong-water-water-bong merged 3 commits into
mainfrom
1bit/1785-host-head

Commits

  1. Commits on Nov 11, 2026