Issues

• suggestions for more examples

  LambdaLabsML/distributed-training-guide#60 · Filter by author daire-byrne opened on Nov 19, 2025
  1

• MPI instructions missing local rank?

  LambdaLabsML/distributed-training-guide#59 · Filter by author daire-byrne opened on Nov 18, 2025

• FSDP: train_llm.py not outputting LOGGER.info messages?

  LambdaLabsML/distributed-training-guide#58 · Filter by author daire-byrne opened on Nov 18, 2025

• FSDP: GPT2LMHeadModel object has no attribute model

  LambdaLabsML/distributed-training-guide#57 · Filter by author daire-byrne opened on Nov 16, 2025
  2

• Chapter 7 link in readme is broken

  LambdaLabsML/distributed-training-guide#55 · Filter by author fmokadem opened on Nov 5, 2025

• Add guidance on DDP bucket_cap_mb for larger models & torch.compile

  LambdaLabsML/distributed-training-guide#53 · Filter by author chelsea0x3b opened on Oct 22, 2025
  2

• Optimizer Checkpointing with ZeRO

  LambdaLabsML/distributed-training-guide#51 · Filter by author kennethSty opened on Jul 31, 2025
  3