Nightly 2026-08-03: first MoE architecture (OLMoE-1B-7B), parity-verified - #16

Merged

physics515 merged 4 commits into

mainfrom

mummu-nightly-2026-08-03

Aug 3, 2026

Commits on Aug 3, 2026

deps: cargo update - 8 patch/minor bumps (clap 4.6.5, time 0.3.55, cubecl-hip-sys 7.14, ...)

Justin Icenhour
and
claude
committed
b327514
moe: SparseMoe block + OLMoE-1B-7B architecture (P2's first MoE)

Justin Icenhour
and
claude
committed
a5208a2
docs: OLMoE MoE port ticked [x] - parity gate passed first run

Justin Icenhour
and
claude
committed
a01d829
bench: MoE tier gets a budget row and a regression gate

Justin Icenhour
and
claude
committed
aa88a00