Skip to content

npu: read the tile-packed embedding table one row per token, so the 27B stops materialising 4.74 GiB (engine#1784) - #1807

Merged
bong-water-water-bong merged 1 commit into
mainfrom
1bit/1784-chunked-row
Nov 10, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
1bit/1784-chunked-row

Commits

  1. Commits on Nov 10, 2026