Skip to content

npu: NPU_W4_PREFILL, the bit-exact int4-weight M=512 prefill tier (bonsai2-27b: 752/1023 next-token, ~3.7x the corrected int8 prefill) - #2615

Merged
bong-water-water-bong merged 8 commits into
mainfrom
cl-game/w4g32-prefill-tier
Nov 16, 2026
Merged

bong-water-water-bong merged 8 commits into
mainfrom
cl-game/w4g32-prefill-tier

Commits

  1. Commits on Nov 16, 2026