Skip to content

[test] workflow-server PR #810 - #3647

Closed
vercel-gh-bot-4[bot] wants to merge 1 commit into
mainfrom
test/server-pr-810
Closed

[test] workflow-server PR #810#3647
vercel-gh-bot-4[bot] wants to merge 1 commit into
mainfrom
test/server-pr-810

Conversation

@vercel-gh-bot-4

Copy link
Copy Markdown

This PR was automatically created to test a workflow-server preview deployment.


This PR will be automatically closed after 24 hours.

@changeset-bot

changeset-bot Bot commented Aug 18, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: cec2bec

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercel Bot commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
example-nextjs-workflow-turbopack Ready Ready Preview Aug 18, 2026 11:46pm
example-nextjs-workflow-webpack Ready Ready Preview Aug 18, 2026 11:46pm
example-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-astro-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-express-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-fastify-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-hono-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-nestjs-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-nitro-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-nuxt-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-python-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-sveltekit-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-tanstack-start-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workbench-vite-workflow Ready Ready Preview Aug 18, 2026 11:46pm
workflow-docs Ready Ready Preview, v0 Aug 18, 2026 11:46pm
workflow-swc-playground Ready Ready Preview Aug 18, 2026 11:46pm
workflow-tarballs Ready Ready Preview Aug 18, 2026 11:46pm
workflow-web Ready Ready Preview Aug 18, 2026 11:46pm

@github-actions

github-actions Bot commented Aug 18, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (26 failed)

astro-node (8 failed):

  • parallelStepsThenWebhookWorkflow - no hook_conflict from same-tick replay race | wrun_41M0BMBSFQ0GK4KE9BBXYYMVKZ | 🔍 observability
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getChunks returns same content as reading the stream
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions | wrun_41M0BMK4ZW0GGNAMW74QVQPH5R | 🔍 observability
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_41M0BNCS2V0GKAV9DYEDF8NHE1 | 🔍 observability
  • hookWithSleepFinalStepWorkflow - step only on final payload | wrun_41M0BND7HH0GRNV40RVDKEB431 | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0BNE4270GM3QKDJ53E6P77D | 🔍 observability

express-quickjs (2 failed):

  • utf8StreamWorkflow | wrun_41M0BMKHRW0GN1RFC7NAYMJ9ZK | 🔍 observability
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_41M0BNCS2V0GKAV9DYEDF8NHE1 | 🔍 observability

nitro-node (9 failed):

  • parallelStepsThenWebhookWorkflow - no hook_conflict from same-tick replay race | wrun_41M0BMBSFQ0GK4KE9BBXYYMVKZ | 🔍 observability
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns correct index after stream completes
  • hookSupersedeOwnerWorkflow - duplicate cancels the owner and claims the released token | wrun_41M0BN0DDT0GY9PPS36EMZ4N1J | 🔍 observability
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running | wrun_41M0BN0Z6C0GSRMMPYKYMXCMB4 | 🔍 observability
  • hookTokenReuseLoopWorkflow - same run recreates a hook with the same token after dispose() | wrun_41M0BN1JHF0GP77H6P35GC4B9D | 🔍 observability
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context | wrun_41M0BNAJ3Y0GQ7QDPYZETKD676 | 🔍 observability
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep | wrun_41M0BNCS2V0GKAV9DYEDF8NHE1 | 🔍 observability

sveltekit-node (7 failed):

  • parallelStepsThenWebhookWorkflow - no hook_conflict from same-tick replay race | wrun_41M0BMBSFQ0GK4KE9BBXYYMVKZ | 🔍 observability
  • outputStreamWorkflow positive startIndex (skips first chunk)
  • outputStreamWorkflow negative startIndex (reads from end)
  • outputStreamWorkflow - getTailIndex and getChunks getTailIndex returns correct index after stream completes
  • fetchWorkflow | wrun_41M0BMPEHZ0GTK8W4WFJWXFPQA | 🔍 observability
  • fibonacciWorkflow - recursive workflow composition via start() | wrun_41M0BN5TC00GXRXZQFCY271GGA | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0BNE4270GM3QKDJ53E6P77D | 🔍 observability

vercel-ws-transport (3 failed)

express (3 failed):

  • hookWorkflow | wrun_41M0BM9VEW0GJT5SG5WW3W17HD
  • parallelStepsThenWebhookWorkflow - no hook_conflict from same-tick replay race | wrun_41M0BMBSFQ0GK4KE9BBXYYMVKZ
  • outputStreamWorkflow positive startIndex (skips first chunk)

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

34 flaky tests
  • abortFetchInFlightWorkflow: aborting cancels an in-flight fetch (sveltekit)
  • abortFromStepWorkflow: step abort cancels an in-flight sibling step (nitro)
  • abortParallelWorkflow: abort cancels all parallel steps (astro)
  • abortParallelWorkflow: abort cancels all parallel steps (nitro)
  • abortThrowIfAbortedMidFlightWorkflow: throwIfAborted in a polling loop bails when abort fires (express)
  • abortThrowIfAbortedWorkflow: throwIfAborted causes FatalError, no retries (nitro)
  • abortVoidSleepTimeoutWorkflow: documented void sleep().then(abort) pattern works (sveltekit)
  • agent-level prepareStep is called for each LLM step (sveltekit)
  • Calculator.calculate - static workflow method using static step methods from another class (sveltekit)
  • completes but callbacks are not called (GAP) (sveltekit)
  • completes but needsApproval is not checked (GAP) (sveltekit)
  • fetchWorkflow (express)
  • fibonacciWorkflow - recursive workflow composition via start() (astro)
  • getterStepWorkflow - getter functions with "use step" directive (sveltekit)
  • hook created by a sfo1 run resolves by token and resumes the run (nextjs-turbopack)
  • hookGetConflictWorkflow - hook.getConflict() resolves with the conflicting run when token is already registered (sveltekit)
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep (express)
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep (sveltekit)
  • negative startIndex (reads from end) (express)
  • no startIndex (reads all chunks) (nitro)
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions (nitro)
  • outputStreamInsideStepWorkflow - getWritable() called inside step functions (sveltekit)
  • passes through LanguageModelV3ToolResultOutput from tools (sveltekit)
  • promiseAllWorkflow (sveltekit)
  • promiseRaceStressTestWorkflow (sveltekit)
  • regular Error retries until success (nitro)
  • retainedInterleavingWorkflow (astro)
  • sleepWinsRaceWorkflow (express)
  • step throw round-trips FatalError with cause chain to workflow catch (nitro)
  • stream-level prepareStep overrides constructor-level (sveltekit)
  • thisSerializationWorkflow - step function invoked with .call() and .apply() (nitro)
  • utf8StreamWorkflow (express)
  • webhookWorkflow (express)
  • writableForwardedFromWorkflowWorkflow (sveltekit)

E2E Test Summary

Summary
Passed Failed Skipped Total
❌ ▲ Vercel Production 513 26 241 780
✅ vercel-multi-region 27 0 0 27
❌ vercel-ws-transport 125 3 28 156
Total 665 29 269 963
Details by Category

❌ ▲ Vercel Production

App Passed Failed Skipped
❌ astro-node 120 8 28
❌ express-quickjs 126 2 28
❌ nitro-node 119 9 28
✅ python-node 8 0 148
❌ sveltekit-node 140 7 9

✅ vercel-multi-region

App Passed Failed Skipped
✅ nextjs-turbopack 27 0 0

❌ vercel-ws-transport

App Passed Failed Skipped
❌ express 125 3 28

📋 View full workflow run

@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenario outcome events virt replay violations
smoke-no-steps completed 3 0ms ok 0
smoke-one-step completed 6 0ms ok 0
hook-at-step-started completed 12 0ms ok 0
hook-at-step-completed completed 12 0ms ok 0
hook-at-hook-created completed 12 0ms ok 0
deadline-hook-wins completed 7 1.0h ok 0
deadline-expires completed 7 1.0h ok 0
long-sleep completed 11 30.0d ok 0
hook-never-arrives stalled 3 0ms skipped 0
step-retries-twice completed 10 2.0s ok 0
parallel-steps completed 9 0ms ok 0
hook-on-execution-state completed 12 0ms ok 0
peek-hook-before-branch completed 12 0ms ok 0
peek-hook-after-branch completed 12 0ms ok 0
peek-hook-at-registration completed 12 0ms ok 0
race-hook-before-probe completed 12 0ms ok 0
race-hook-after-probe completed 12 0ms ok 0
race-duplicate-delivery completed 13 0ms ok 0
attr-hook-before-step completed 11 0ms ok 0
attr-hook-after-step completed 11 0ms ok 0
attr-from-step-body completed 13 0ms ok 0
fork-hook-after-timeout completed 14 1.0m ok 0
fork-hook-before-timeout completed 14 1.0m ok 0
count-hook-after-timeout completed 17 1.0m ok 0
count-hook-before-timeout completed 20 1.0m ok 0
stale-read-step-count-fork completed 20 1.0m ok 0
stale-read-equal-step-counts completed 14 1.0m ok 0
step-vs-step-fork completed 12 0ms ok 0
step-vs-step-fork-fenced completed 12 0ms ok 0
fence-catches-benign-direction completed 12 5ms ok 0
in-flight-before-decision completed 17 1.0m ok 0
in-flight-before-decision-counted completed 17 1.0m ok 0
in-flight-after-decision completed 19 2.0m ok 0
stale-read-step-count-fork-fenced completed 20 1.0m ok 0
fork-hook-wins completed 13 1.0m ok 0
fork-timeout-wins completed 13 1.0m ok 0
unclaimed-payload-under-fork completed 17 1.0m ok 0
claimed-payload-under-fork completed 17 1.0m ok 0
writers-independent-step-bodies completed 12 0ms ok 0
writers-scripted-tempo completed 12 0ms ok 0
cancel-mid-step cancelled 7 0ms skipped 0

Full trace: world-sim.txt

@vercel-gh-bot-2 vercel-gh-bot-2 Bot closed this Aug 19, 2026
@vercel-gh-bot-2
vercel-gh-bot-2 Bot deleted the test/server-pr-810 branch August 19, 2026 23:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants