Skip to content

npu-pack: the split q/k/v genre-A layout, its per-head QK gains, and a rope gate that does not punish a large head_dim - #1533

Merged
bong-water-water-bong merged 2 commits into
mainfrom
1bit/npu-genre-a-split-qkv
Nov 8, 2026
Merged

bong-water-water-bong merged 2 commits into
mainfrom
1bit/npu-genre-a-split-qkv

Commits

  1. Commits on Nov 8, 2026