Skip to content

npu forward: a batched verify pass launches the int8 lm head once per vocabulary tile, not once per row (3.4x the pass) - #1348

Merged
bong-water-water-bong merged 1 commit into
mainfrom
1bit/1341-head-rows
Nov 7, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
1bit/1341-head-rows

Commits

  1. Commits on Nov 7, 2026