Repository navigation
test(ci): Benchmark natural splits of long integration suites - #26420
nicohrubec wants to merge 10 commits into
Conversation
Co-Authored-By: OpenAI Codex <codex@openai.com>
size-limit report 📦Compared: 202fb34 (PR test merge using develop at c7b765f) Against: c7b765f (develop) · base run #66318 ✅ Baseline matches: this diff contains only this PR's changes.
|
| name: timings-node-${{ matrix.node }}-${{ matrix.shard }} | ||
| path: ${{ runner.temp }}/integration-timings.json | ||
| if-no-files-found: error | ||
| retention-days: 7 |
There was a problem hiding this comment.
Timing uploads omit overwrite
Low Severity
The new timing uploads omit overwrite: true, which every other upload-artifact step in this workflow sets. if: always() already uploads after a failed attempt, so a job retry hits a duplicate-name error even if the tests then pass.
Additional Locations (2)
Reviewed by Cursor Bugbot for commit db3629f. Configure here.
Co-Authored-By: OpenAI Codex <codex@openai.com>
Optional E2E testsSome optional checks were not successful. They do not block the merge. 2 not successful, 61 successful. See the run.
Successful checks
|
There was a problem hiding this comment.
Cursor Bugbot has reviewed your changes and found 1 potential issue.
There are 3 total unresolved issues (including 2 from previous reviews).
❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.
Reviewed by Cursor Bugbot for commit 9252e89. Configure here.
Co-Authored-By: OpenAI Codex <codex@openai.com>
Co-Authored-By: OpenAI Codex <codex@openai.com>
Co-Authored-By: OpenAI Codex <codex@openai.com>
Co-Authored-By: OpenAI Codex <codex@openai.com>
Co-Authored-By: OpenAI Codex <codex@openai.com>
809a3be to
edd5fe4
Compare
Co-Authored-By: OpenAI Codex <codex@openai.com>
Co-Authored-By: OpenAI Codex <codex@openai.com>
Co-Authored-By: OpenAI Codex <codex@openai.com>


What
Split large integration test files along version/feature boundaries so the existing shards can distribute the work. Test cases, assertions, dependency versions, worker counts and shard counts stay unchanged.
Why
Slowest required Node integration test step: 184→162s (−22s, 12%); longest complete Node integration job: 229→198s (−31s). Single-run measurements; test-step times exclude setup/queueing, complete-job times include setup/cleanup.
Seconds below; each column adds one split to the preceding state. Values are the slowest integration test step per Node version.
Baseline vs latest measured run, which passed required checks. Node improved most; Bun/Deno have no demonstrated gain. Inventories and pass/skip states match. No overall required-check speedup claimed because other runs had unrelated failures.