Skip to content

ci: retry managed infrastructure failures once - #757

Closed
lilly-luo wants to merge 1 commit into
mainfrom
ci/retry-managed-infra
Closed

lilly-luo wants to merge 1 commit into
mainfrom
ci/retry-managed-infra

Conversation

@lilly-luo

Copy link
Copy Markdown
Collaborator

Hypothesis: managed-config instability can be contained by distinguishing infrastructure timeouts/runner loss from assertion failures and retrying only the former once on fresh runners.

Changes:

  • bound the managed subprocess to 24 minutes so evidence can be uploaded before the 30-minute job deadline
  • persist the subprocess exit code with the integration artifacts
  • classify exit 124 or a non-success job conclusion as infrastructure
  • schedule one fresh-runner retry for both managed lanes
  • do not retry ordinary nonzero assertion failures

This is one of several CI structure experiments prompted by #755.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant