Skip to content

npu forward: the batched int8 head chunks rows by the kernel's capacity, so a 64-row verify pass is 9.9x faster - #1364

Merged
bong-water-water-bong merged 2 commits into
mainfrom
1bit/1341-row-chunks
Nov 7, 2026
Merged

bong-water-water-bong merged 2 commits into
mainfrom
1bit/1341-row-chunks

Commits

  1. Commits on Nov 7, 2026