Background
LLaDA 2.0 (by inclusionAI, Ant Group) is the next generation of LLaDA, published after the gsai-ml LLaDA-1.5 release supported in v0.1. Despite the shared "LLaDA" name, LLaDA 2.0 uses a block-diffusion architecture (related to BD3-LMs) rather than the pure masked-diffusion contract of LLaDA-8B/1.5.
This is not a drop-in addition. Block diffusion changes:
- Forward pass shape (block-wise attention masks)
- The denoising loop (per-block iteration is structural, not a config flag like
block_length)
- Quality gates (different reference implementation to bit-match against)
Acceptance criteria
References
Background
LLaDA 2.0 (by inclusionAI, Ant Group) is the next generation of LLaDA, published after the gsai-ml LLaDA-1.5 release supported in v0.1. Despite the shared "LLaDA" name, LLaDA 2.0 uses a block-diffusion architecture (related to BD3-LMs) rather than the pure masked-diffusion contract of LLaDA-8B/1.5.
This is not a drop-in addition. Block diffusion changes:
block_length)Acceptance criteria
reference/dlmserve/models/llada2.pyloaderdlmserve/denoise_loop.py(or new file)scripts/calibrate_local_leap.py --model inclusionAI/LLaDA-2.0-...)References