Repository navigation
Let the bot take result files, and add a benchmark-processor Copilot agent (1.12.0.0) - #40
Merged
Merged
Conversation
A new "Benchmark result (file)" form, and any issue with the benchmark label, can carry one .yaml/.yml/.json result file, attached or pasted. The bot downloads only from github.com/user-attachments/files/ (redirects only to *.githubusercontent.com, 1 MB and 20 s caps), refuses YAML aliases, keeps the file's fields, sets submitted_by only from the Credit box, and drops testbench_id, source, and synthetic. Attachments it can't convert exit 3 and get the needs-maintainer label (docs/PROCESSING_ISSUES.md). Submitting the issue is now the CC BY 4.0 agreement: both forms drop their required checkboxes and show the license as a notice. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Cloudflare Pages preview
|
Assign a benchmark issue to Copilot and pick benchmark-processor: it writes the result YAML from whatever the issue holds (pasted numbers, a file, a raw capture, a screenshot), adds a missing GPU or game with sources, runs the checks, and opens a data-only pull request ready to approve, or a draft with questions. copilot-setup-steps.yml installs the Python dependencies, and parse.py takes --date so captures get the run's day. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Pulls the backlog item "Let the bot process attached or pasted result files" (prompted by #36).
What changes
.yaml/.yml/.jsonresult file. Any issue with thebenchmarklabel and one result file (like Add my benchmark run to the benchmarks results #36's Open GPU Benchmarker export) works too.github.com/user-attachments/files/, with redirects allowed only to*.githubusercontent.com, capped at 1 MB and 20 s, and saved into$OUT, never the checkout.detectedanddiagnostics).submitted_bycomes only from the Credit box.testbench_id,source, andsyntheticare dropped.needs-maintainer, and the steps a maintainer follows are in the newdocs/PROCESSING_ISSUES.md.benchmark-processorCopilot agent (.github/agents/benchmark-processor.agent.md). Assign a benchmark issue to Copilot and pick this agent.parse.py/import_cyberpunk.py), or a screenshot.validate.py/build.py/test_build.py, and opens a data-only PR listing every assumption. If something can't be worked out, it opens a draft with questions instead.data/, and it treats the issue and attachments as untrusted.copilot-setup-steps.yml(one read-only job, no secrets) installs its Python dependencies.parse.pygains--date.Testing
check_issue_files()covers:--attachment-dirand never touches the network.check_bot_safety()makes sure the workflow never passes that flag.data/. It wrotedata/community/rtx_5080_16gb_fe/result_20261026_openbenchmarker_neon_flythrough.yaml, which passes the checks with two warnings (no proof, no official baseline).validate.py,build.py,test_build.py,py_compile, the blog build, andgit diff --checkall pass.After merge
main). If downloads are blocked, addobjects.githubusercontent.comto Settings → Copilot → Internet access.v1.12.0.0.🤖 Generated with Claude Code