Repository navigation
npu: the decode lm head on the host, bit-identical logits — head time 51–78 ms → 8–18 ms per token on Qwen3.5-2B (opt-in, Refs #1785) - #2191
Merged
Commits
Commits on Nov 11, 2026
npu: the decode lm head can run on the host, bit for bit the device's (NPU_HEAD_HOST=1) (Refs #1785)
andcommitted
- andcommitted

- authored