feat(BACKEND-ROCM-BF16-MOE): run BF16 grouped experts on ROCm - #3096

Merged

localai-org-maint-bot merged 33 commits into

mudler:mainfrom

VikashLoomba:row/BACKEND-ROCM-BF16-MOE

Sep 12, 2026

Commits on Sep 9, 2026

spec(BACKEND-ROCM-BF16-MOE): define native expert contract
VikashLoomba
committed
9202e4c
feat(BACKEND-ROCM-BF16-MOE): add native grouped BF16 experts
VikashLoomba
committed
94b8bb0
test(BACKEND-ROCM-BF16-MOE): cover provider subsets and numeric modes
VikashLoomba
committed
9083a5f
spec(BACKEND-ROCM-RESIDUAL-NORM): preserve compiled residual expressions
VikashLoomba
committed
9ec19f8
fix(BACKEND-ROCM-RESIDUAL-NORM): preserve compiled residual lifetimes
VikashLoomba
committed
94ac5d1
fix(BACKEND-ROCM-RESIDUAL-NORM): own the blocked test stream
VikashLoomba
committed
cc9d4f5
spec(BACKEND-ROCM-RESIDUAL-NORM): record the assigned attention and head issues
VikashLoomba
committed
6fd1650

Commits on Sep 10, 2026

Commits on Sep 11, 2026