LLaMA-style pretraining stack with 336M long-run training, FineWeb-Edu data pipelines, fault diagnostics, shared held-out evaluation, and reproducibility audits.
evaluation language-modeling pytorch llama model-training pretraining foundation-models llm training-systems fineweb-edu
-
Updated
Sep 13, 2026 - Python