Skip to content

feat(github-reporter): Show eval usage in summaries - #103

Closed
sentry-junior[bot] wants to merge 4 commits into
mainfrom
feat/github-summary-usage
Closed

sentry-junior[bot] wants to merge 4 commits into
mainfrom
feat/github-summary-usage

Conversation

@sentry-junior

@sentry-junior sentry-junior Bot commented Sep 10, 2026 •

Copy link
Copy Markdown
Contributor

Add duration, tokens, estimated cost, tool calls, retries, and models to the GitHub summary when result metadata provides them.

Merge these values across sharded reports. Include usage attached to judge score metadata in the totals.

via David Cramer.

--

View Junior Session [Sentry]

@vercel

vercel Bot commented Sep 10, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
vitest-evals-docs Ready Ready Preview Sep 10, 2026 3:34am UTC

Request Review

Co-Authored-By: David Cramer <david@sentry.io>
@sentry-junior sentry-junior Bot changed the title feat(github-reporter): Summarize eval usage feat(github-reporter): Show eval usage in summaries Sep 10, 2026
@dcramer
dcramer marked this pull request as ready for review September 10, 2026 03:24
@sentry-junior

sentry-junior Bot commented Sep 10, 2026

Copy link
Copy Markdown
Contributor Author

Superseded by #104, which includes the reporter work on the final typed usage contract with separate application and judge totals.

@sentry-junior sentry-junior Bot closed this Sep 10, 2026

This branch was successfully deployed

1 active deployment
Preview — c7f50852 Deployed Sep 10, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants