Skip to content

chore: release - #368

Open
primer[bot] wants to merge 1 commit into
mainfrom
changeset-release/main
Open

primer[bot] wants to merge 1 commit into
mainfrom
changeset-release/main

Conversation

@primer

@primer primer Bot commented Oct 9, 2026 •

Copy link
Copy Markdown
Contributor

This PR was opened by the Changesets release GitHub action. When you're ready to do a release, you can merge this and the packages will be published to npm automatically. If you're not ready to do a release yet, that's fine, whenever you add more changesets to main, this PR will be updated.

Releases

@primer/agent-eval@0.13.0

Minor Changes

  • 72742af: Require runner on parsed experiment and benchmark trial outputs. Legacy output
    files without a runner default to copilot-cli when parsed. Consumers constructing
    trial output objects directly must include runner: 'copilot-cli' or
    runner: 'copilot-sdk'.

Patch Changes

  • 922afff: Fix output-token totals for Copilot CLI and SDK trials by collecting usage
    statistics instead of relying on message events that no longer include token
    counts. Preserve compatibility with older session output.
  • 7fd247f: Validate manifest consistency through schemas before loading configurations or
    trial artifacts. Reject metadata IDs that differ from their manifest keys,
    duplicate benchmark capability scenario IDs, and conflicting metadata across
    benchmark result shards. Duplicate trial IDs and other merge conflicts now report
    schema errors with field paths.

@primer
primer Bot force-pushed the changeset-release/main branch 3 times, most recently from fc498de to 4e762d1 Compare October 9, 2026 18:36
@primer
primer Bot force-pushed the changeset-release/main branch from 4e762d1 to f7a6aa2 Compare October 9, 2026 19:33

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants