test(ci): bound slow shard integration tests - #7759
Conversation
Signed-off-by: Apurv Kumaria <akumaria@nvidia.com>
|
Note Reviews pausedIt looks like this branch is under active development. To avoid overwhelming you with review comments due to an influx of new commits, CodeRabbit has automatically paused this review. You can configure this behavior by changing the Use the following commands to manage reviews:
Use the checkboxes below for quick actions:
📝 WalkthroughWalkthroughThree tests now use explicit timeouts: 40 seconds for the planner-matrix integration test, 15 seconds for the agent base-image test, and 30 seconds for the E2E recommendation test. Existing test behavior and assertions remain unchanged. ChangesTest timeout configuration
Estimated code review effort: 2 (Simple) | ~5 minutes Possibly related PRs
Suggested labels: Suggested reviewers: 🚥 Pre-merge checks | ✅ 5✅ Passed checks (5 passed)
✨ Finishing Touches📝 Generate docstrings
🧪 Generate unit tests (beta)
Comment |
Code Coverage OverviewLanguages: TypeScript TypeScript / code-coverage/pluginThe overall coverage in commit 5403bec in the TypeScript / code-coverage/cliThe overall coverage in commit 5403bec in the Show a code coverage summary of the most impacted files.
Updated |
PR Review Advisor — No blocking findings reportedAdvisor assessment: No blocking advisor findings reported Model lanes
Nemotron output stays in workflow artifacts and does not change the assessment above. E2E guidanceAdvisory only. E2E / PR Gate selects and runs jobs independently. Recommended E2E: This automated review informs maintainers. Warnings and suggestions do not require a response. A maintainer decides whether to merge. |
Signed-off-by: Apurv Kumaria <akumaria@nvidia.com>
Signed-off-by: Apurv Kumaria <akumaria@nvidia.com>
There was a problem hiding this comment.
Actionable comments posted: 1
🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.
Inline comments:
In `@test/pr-review-advisor.test.ts`:
- Line 362: Replace the literal 30_000 timeout in the test case with the shared
timeout helper from test/helpers/timeouts.ts, ensuring NEMOCLAW_TEST_TIMEOUT can
control the test budget while preserving the existing timeout behavior.
🪄 Autofix (Beta)
Fix all unresolved CodeRabbit comments on this PR:
- Push a commit to this branch (recommended)
- Create a new PR with the fixes
ℹ️ Review info
⚙️ Run configuration
Configuration used: Path: .coderabbit.yaml
Review profile: CHILL
Plan: Enterprise
Run ID: 95b3a07a-e68f-4ff9-bbb0-75da40c32139
📒 Files selected for processing (1)
test/pr-review-advisor.test.ts
Signed-off-by: Apurv Kumaria <akumaria@nvidia.com>
|
/ok to test 4ae480f |
Signed-off-by: Julie Yaunches <jyaunches@nvidia.com>
Summary
Three integration-heavy tests exceeded their existing ceilings only under hosted-runner shard coverage load, failing unrelated pull requests. The planner workflow test launches a subprocess with a deliberate 30-second deadline, the base-image test cold-loads the source-backed Docker harness, and the deterministic Advisor rendering test already consumes several seconds without coverage. This gives only those tests bounded headroom while retaining the subprocess's fail-closed 30-second ceiling and every existing behavior assertion. After synchronizing with
main, CI also exposed that the reviewed source-architecture fan-in baseline had improved without ratcheting its budget; this change records the lower observed value.Changes
src/lib/core/shell-quote.ts's reviewed fan-in budget from 27 to the current observed value of 26.Type of Change
Quality Gates
Documentation Writer Review
no-docs-neededDGX Station Hardware Evidence
Verification
Signed-off-by:line and every commit appears asVerifiedin GitHubpre-commit,commit-msg, andpre-pushhooks passed, ornpm run check:diffpassed when hooks were skipped or unavailablenpm testfor broad runtime/test-harness changes;npm run checkfor repo-wide validation/coverage changes — Not applicable to these scoped test-harness ceiling corrections; the affected files, shard-equivalent cases, builds, typecheck, repository checks, and changed-file hooks passed.npm run docsbuilds without warnings (doc changes only)Signed-off-by: Apurv Kumaria akumaria@nvidia.com
Summary by CodeRabbit