Skip to content

Add multi-GPU training support via FSDP #176

Open
Open
Add multi-GPU training support via FSDP#176
Labels
enhancementNew feature or requesttrainingTraining pipeline issues

Description

@SahilKumar75
SahilKumar75
opened on Jun 28, 2026

Currently training is single-GPU only. Add FSDP wrapping in finetune.py controlled by a NUM_GPUS config flag for users with multi-GPU nodes.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or requesttrainingTraining pipeline issues

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions