Skip to content

npu: read the token embedding table in place, one row per token, instead of materialising it (engine#1784) - #1795

Merged
bong-water-water-bong merged 1 commit into
mainfrom
1bit/1784-embed-mmap
Nov 10, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
1bit/1784-embed-mmap

Commits

  1. Commits on Nov 10, 2026