Skip to content

test(e2e): Retry tests in all dev-mode variants - #25640

Merged
mydea merged 1 commit into
developfrom
test/e2e-retry-all-dev-variants
Oct 22, 2026
Merged

mydea merged 1 commit into
developfrom
test/e2e-retry-all-dev-variants

Conversation

@mydea

@mydea mydea commented Oct 22, 2026

Copy link
Copy Markdown
Member

E2E tests get 3 retries in dev mode because dev servers are flaky, but the check only matched `TEST_ENV === 'development'`. The `development-webpack` variants (6 apps) and `dev-turbopack` (`nextjs-15`) ran with zero retries.

This shows up as recurring flakes in the `nextjs-16-*` webpack jobs: `next dev --webpack` logs "Ready" and opens the port immediately, so Playwright starts the tests, but on a slow runner the server can take ~2 minutes to finish initializing. The first few tests then time out on `page.goto` with `net::ERR_ABORTED`, and without retries the whole job fails. Matching on the `dev` prefix gives every dev variant the same retries.

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

Copy link
Copy Markdown
Contributor

size-limit report 📦

Compared: 105e1c1 (PR test merge using develop at 24186f0)

Against: 24186f0 (develop) · base run #63081

✅ Baseline matches: this diff contains only this PR's changes.

Path Size % Change Change
@sentry/browser 29.91 kB - -
@sentry/browser - with treeshaking flags 28.05 kB - -
@sentry/browser - with treeshaking flags tracing without tracing 27.95 kB - -
@sentry/browser (incl. Tracing) 52.1 kB - -
@sentry/browser (incl. Tracing + Span Streaming) 52.1 kB - -
@sentry/browser (incl. Tracing, Profiling) 55.05 kB - -
@sentry/browser (incl. Tracing, Replay) 91.85 kB - -
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 80.72 kB - -
@sentry/browser (incl. Tracing, Replay with Canvas) 96.58 kB - -
@sentry/browser (incl. Tracing, Replay, Feedback) 109.52 kB - -
@sentry/browser (incl. Feedback) 47.42 kB - -
@sentry/browser (incl. sendFeedback) 34.97 kB - -
@sentry/browser (incl. FeedbackAsync) 40.07 kB - -
@sentry/browser (incl. Metrics) 30.93 kB - -
@sentry/browser (incl. Logs) 31.21 kB - -
@sentry/browser (incl. Metrics & Logs) 31.84 kB - -
@sentry/react 31.74 kB - -
@sentry/react (incl. Tracing) 54.42 kB - -
@sentry/vue 38.07 kB - -
@sentry/vue (incl. Tracing) 55.03 kB - -
@sentry/svelte 29.93 kB - -
@sentry/remix (Remix 3 client bundle) 57.11 kB - -
CDN Bundle 31.67 kB - -
CDN Bundle (incl. Tracing) 52.61 kB - -
CDN Bundle (incl. Logs, Metrics) 33.87 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) 54.55 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) 74.79 kB - -
CDN Bundle (incl. Tracing, Replay) 90.28 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) 92.21 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) 96.42 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) 98.37 kB - -
CDN Bundle - uncompressed 93.29 kB - -
CDN Bundle (incl. Tracing) - uncompressed 156.14 kB - -
CDN Bundle (incl. Logs, Metrics) - uncompressed 99.84 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) - uncompressed 162.11 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) - uncompressed 229.88 kB - -
CDN Bundle (incl. Tracing, Replay) - uncompressed 276.31 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) - uncompressed 282.26 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 290.01 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) - uncompressed 295.96 kB - -
@sentry/nextjs (client) 57.31 kB - -
@sentry/sveltekit (client) 52.48 kB - -
@sentry/core/server 41.85 kB - -
@sentry/core/browser 13.81 kB - -
@sentry/node 152.86 kB - -
@sentry/node/import (ESM hook with diagnostics-channel injection) 81.58 kB - -
@sentry/node - without tracing 94.45 kB +0.01% +1 B 🔺
@sentry/node - without channel injection 133.51 kB +0.01% +1 B 🔺
@sentry/aws-serverless 102.62 kB -0.01% -1 B 🔽
@sentry/cloudflare (withSentry) - minified 191.69 kB - -
@sentry/cloudflare (withSentry) 476.34 kB - -
@sentry/nextjs/cloudflare (withSentry) - minified 212.65 kB - -

View base workflow run

@mydea
mydea marked this pull request as ready for review October 22, 2026 08:00
@mydea
mydea requested review from a team, nicohrubec and s1gr1d and removed request for a team October 22, 2026 08:00
@mydea
mydea merged commit ded8524 into develop Oct 22, 2026
348 checks passed
@mydea
mydea deleted the test/e2e-retry-all-dev-variants branch October 22, 2026 08:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants