Skip to content

Prompt template for Alpaca format adds extra BOS token #172

Open
Open
Prompt template for Alpaca format adds extra BOS token#172
Labels
bugSomething isn't workingdatasetDataset related issuestrainingTraining pipeline issues

Description

@SahilKumar75
SahilKumar75
opened on Jun 28, 2026

prompt_templates.py prepends manually, but the tokenizer already adds it when add_special_tokens=True, resulting in double BOS in every sample.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingdatasetDataset related issuestrainingTraining pipeline issues

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions