Skip to content

npu-pack: claim the per-head QK gains out of the attention gap, so Hunyuan-7B imports with its q/k norms (engine#1889) - #1928

Merged
bong-water-water-bong merged 1 commit into
mainfrom
fix/1889-hunyuan-qknorm
Nov 10, 2026
Merged

bong-water-water-bong merged 1 commit into
mainfrom
fix/1889-hunyuan-qknorm

Commits

  1. Commits on Nov 10, 2026