Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

Overlap workflow compile with replay loading - #3796

Merged
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap
Aug 25, 2026
Merged

Overlap workflow compile with replay loading#3796
NathanColosimo merged 1 commit into
codex/replay-stream-preparationfrom
codex/replay-compile-overlap

Conversation

@NathanColosimo

Copy link
Copy Markdown
Contributor

Stack created with GitHub Stacks CLIGive Feedback 💬

Base automatically changed from codex/speed-fresh-replay to codex/replay-stream-preparationAugust 25, 2026 23:34
@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 7a3a214

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@NathanColosimo
NathanColosimo merged commit 7a3a214 into codex/replay-stream-preparationAug 25, 2026
15 checks passed
@NathanColosimo
NathanColosimo deleted the codex/replay-compile-overlap branch August 25, 2026 23:34
@vercel

vercelBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentActionsUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, v0Aug 25, 2026 11:37pm
example-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nestjs-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-python-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-tanstack-start-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-docsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-swc-playgroundReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-tarballsReadyReadyPreview, v0Aug 25, 2026 11:37pm
workflow-webReadyReadyPreview, v0Aug 25, 2026 11:37pm

@github-actions

github-actionsBot commented Aug 25, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

❌ Failed E2E Tests

▲ Vercel Production (8 failed)

python-node (8 failed):

  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C | 🔍 observability
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0 | 🔍 observability
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3 | 🔍 observability
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH | 🔍 observability
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5 | 🔍 observability
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R | 🔍 observability
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8 | 🔍 observability
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7 | 🔍 observability

🌐 Cross-language Conformance (9 failed)

python (9 failed):

  • deploymentId: 'latest' is a no-op in non-Vercel worlds | wrun_01M0XMT8QWY1S95HFCHGEMPN6M
  • promiseAllWorkflow | wrun_41M0XMGECT0GQCVYF0M7J6B78C
  • sleepingWorkflow | wrun_41M0XMH6720GND51AD959R4KT0
  • parallelSleepWorkflow | wrun_41M0XMH8650GYMPGH5T5EFH5K3
  • nullByteWorkflow | wrun_41M0XMHG1B0GWV58SAA1G0Y2CH
  • cancelRun - cancelling a running workflow | wrun_41M0XMPA9R0GTAYGZ699WRADW5
  • cancelRun via CLI - cancelling a running workflow | wrun_41M0XMPAW60GP8300HXTGPWV1R
  • sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration | wrun_41M0XMPJVM0GZHTNEYNS142KG8
  • resilient start: addTenWorkflow completes when run_created returns 500 | wrun_41M0XMQ4WQ0GT7EWEMXPG7CHV7

⚠️ Flaky E2E Tests (passed on retry)

These tests failed at least once and passed on a retry. A recurring entry here is a real race worth investigating.

  • addTenWorkflow (nextjs-turbopack)
  • cancelRun via CLI - cancelling a running workflow (nextjs-webpack)
  • deploymentId: 'latest' is a no-op in non-Vercel worlds (fastify)
  • no startIndex (reads all chunks) (tanstack-start)

🛠 Infra Events (absorbed by the harness)

Platform anomalies the e2e harness detected and worked around (e.g. a run the queue never picked up, replaced by a fresh run). Clustered timestamps indicate a backend blip; a steady drip indicates a platform issue worth escalating.

34 infra events
  • cold-start-warmup · suite warmup (python) · at 23:37:21Z · abandoned wrun_41M0XMEH9R0GJKT4Z2BF6YR345 · (+7 more)
  • run-pickup-stall · sleepingWorkflow (python) · at 23:37:37Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDQ
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BJ0GT2YYVBJPV7K44W
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BS0GJHJZ348A9H1PDR
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6SH0GMAZ436Z1Q4SRQ9
  • run-pickup-stall · nullByteWorkflow (python) · at 23:37:38Z · abandoned wrun_41M0XMJ6BW0GG85P39KX9BC0HT
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:38:11Z · abandoned wrun_41M0XMK6P00GN4K36ZJ7DY2432
  • run-pickup-stall · nullByteWorkflow (python) · at 23:38:38Z · abandoned wrun_41M0XMM20B0GY050KZS56QPQX5
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2160GPTGZGCH44EWS5N
  • run-pickup-stall · sleepingWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM2170GMW7M89KX3NYA1E
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:38:39Z · abandoned wrun_41M0XMM23B0GXQB074SQY6RBEK
  • cold-start-warmup · suite warmup (tanstack-start) · at 23:39:23Z · abandoned wrun_01M0XMN7V538QBXYHXYC6C13B2
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:39:29Z · abandoned wrun_41M0XMM6SP0GSQ8A6267QKDYAY
  • cold-start-warmup · suite warmup (python) · at 23:40:31Z · abandoned wrun_01M0XMMAA4CPX4S0DS1C43V4S5 · (+7 more)
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:40:46Z · abandoned wrun_01M0XMQZERYG6J7J3BR6G2371B
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZES1C21X02BQV93HKSR
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF0J5FCKGTM43X18YT7
  • run-pickup-stall · nullByteWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZF2BYRC2DT8BVQTHYE2
  • run-pickup-stall · sleepingWorkflow (python) · at 23:40:46Z · abandoned wrun_01M0XMQZEZWJK3X7EMZ1WG9DVF
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:41:12Z · abandoned wrun_41M0XMPSWX0GVF4JN8FVJ1RDHE
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:41:12Z · abandoned wrun_41M0XMPYP80GSEY9WP1PCWS2C3
  • run-pickup-stall · deploymentId: 'latest' is a no-op in non-Vercel worlds (python) · at 23:41:46Z · abandoned wrun_01M0XMST2MA9RQAHF4NDPN2JAW
  • run-pickup-stall · promiseAllWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2PY95CW0P4MYM9QNEJ
  • run-pickup-stall · parallelSleepWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2S31XVBT39SG8FF18C
  • run-pickup-stall · sleepingWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2QSD9A1740PJKM3SM5
  • run-pickup-stall · nullByteWorkflow (python) · at 23:41:46Z · abandoned wrun_01M0XMST2YVQP2YJKKQB7F0WGW
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPB0XSGTBQS000Y7J74
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPF4K4Q2B4MRVRBZW26
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:42:46Z · abandoned wrun_01M0XMVMPPHAGHC47XZA3ZKKQG
  • run-pickup-stall · cancelRun via CLI - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3DDDG75JA5GBYZGJNN
  • run-pickup-stall · cancelRun - cancelling a running workflow (python) · at 23:43:16Z · abandoned wrun_01M0XMWJ3CG9T8PDMZ2G8B6T1S
  • run-pickup-stall · hookCleanupTestWorkflow - hook token reuse after workflow completion (nextjs-webpack) · at 23:43:23Z · abandoned wrun_01M0XMWRRRMCBPF968JMB4GRVY
  • run-pickup-stall · concurrent hook token conflict - two workflows cannot use the same hook token simultaneously (nextjs-webpack) · at 23:43:24Z · abandoned wrun_01M0XMWTBYJFCV0898A84J3NEZ
  • run-pickup-stall · sleepInLoopWorkflow - sleep inside loop with steps actually delays each iteration (python) · at 23:43:46Z · abandoned wrun_01M0XMXF9SNPMEJKF15X9NDEQ2

E2E Test Summary

Summary
PassedFailedSkippedTotal
❌ ▲ Vercel Production357087424320
✅ 💻 Local Development392205584480
✅ 📦 Local Production392205584480
✅ 🐘 Local Postgres392205584480
✅ 🪟 Windows32000320
❌ 🌐 Cross-language Conformance09132141
✅ vercel-http-transport8170143960
✅ vercel-multi-region270027
✅ vercel-ws-transport553087640
Total1705317277819848
Details by Category

❌ ▲ Vercel Production

AppPassedFailedSkipped
✅ astro-node132028
✅ astro-quickjs132028
✅ example-node132028
✅ example-quickjs132028
✅ express-node132028
✅ express-quickjs132028
✅ fastify-node132028
✅ fastify-quickjs132028
✅ hono-node132028
✅ hono-quickjs132028
✅ nest-node132028
✅ nest-quickjs132028
✅ nextjs-turbopack-node15703
✅ nextjs-turbopack-quickjs15703
✅ nextjs-webpack-node15703
✅ nextjs-webpack-quickjs15703
✅ nitro-node132028
✅ nitro-quickjs132028
✅ nuxt-node132028
✅ nuxt-quickjs132028
❌ python-node08152
✅ sveltekit-node15109
✅ sveltekit-quickjs15109
✅ tanstack-start-node132028
✅ tanstack-start-quickjs132028
✅ vite-node132028
✅ vite-quickjs132028

✅ 💻 Local Development

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 📦 Local Production

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🐘 Local Postgres

AppPassedFailedSkipped
✅ astro-stable-node134026
✅ astro-stable-quickjs134026
✅ express-stable-node134026
✅ express-stable-quickjs134026
✅ fastify-stable-node134026
✅ fastify-stable-quickjs134026
✅ hono-stable-node134026
✅ hono-stable-quickjs134026
✅ nest-stable-node134026
✅ nest-stable-quickjs134026
✅ nextjs-turbopack-canary-node141019
✅ nextjs-turbopack-canary-quickjs141019
✅ nextjs-turbopack-stable-node16000
✅ nextjs-turbopack-stable-quickjs16000
✅ nextjs-webpack-canary-node141019
✅ nextjs-webpack-canary-quickjs141019
✅ nextjs-webpack-stable-node16000
✅ nextjs-webpack-stable-quickjs16000
✅ nitro-stable-node134026
✅ nitro-stable-quickjs134026
✅ nuxt-stable-node134026
✅ nuxt-stable-quickjs134026
✅ sveltekit-stable-node15307
✅ sveltekit-stable-quickjs15307
✅ tanstack-start-node134026
✅ tanstack-start-quickjs134026
✅ vite-stable-node134026
✅ vite-stable-quickjs134026

✅ 🪟 Windows

AppPassedFailedSkipped
✅ nextjs-turbopack-node16000
✅ nextjs-turbopack-quickjs16000

❌ 🌐 Cross-language Conformance

AppPassedFailedSkipped
❌ python09132

✅ vercel-http-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ hono132028
✅ nextjs-turbopack15703
✅ nitro132028
✅ vite132028

✅ vercel-multi-region

AppPassedFailedSkipped
✅ nextjs-turbopack2700

✅ vercel-ws-transport

AppPassedFailedSkipped
✅ example132028
✅ express132028
✅ nextjs-turbopack15703
✅ vite132028

📋 View full workflow run

@NathanColosimo
NathanColosimo restored the codex/replay-compile-overlap branch August 25, 2026 23:35
@github-actions

Copy link
Copy Markdown
Contributor

Sim World

Simulated world deterministic testing for races. Traces

🟠 world-sim scenario book — 1 fail of 41 total

fence=per-spec

scenariooutcomeeventsvirtreplayviolations
smoke-no-stepscompleted30msok0
smoke-one-stepcompleted60msok0
hook-at-step-startedcompleted120msok0
hook-at-step-completedcompleted120msok0
hook-at-hook-createdcompleted120msok0
deadline-hook-winscompleted71.0hok0
deadline-expirescompleted71.0hok0
long-sleepcompleted1130.0dok0
hook-never-arrivesstalled30msskipped0
step-retries-twicecompleted102.0sok0
parallel-stepscompleted90msok0
hook-on-execution-statecompleted120msok0
peek-hook-before-branchcompleted120msok0
peek-hook-after-branchcompleted120msok0
peek-hook-at-registrationcompleted120msok0
race-hook-before-probecompleted120msok0
race-hook-after-probecompleted120msok0
race-duplicate-deliverycompleted130msok0
attr-hook-before-stepcompleted110msok0
attr-hook-after-stepcompleted110msok0
attr-from-step-bodycompleted130msok0
fork-hook-after-timeoutcompleted141.0mok0
fork-hook-before-timeoutcompleted141.0mok0
count-hook-after-timeoutcompleted171.0mok0
count-hook-before-timeoutcompleted201.0mok0
stale-read-step-count-forkcompleted201.0mok0
stale-read-equal-step-countscompleted141.0mok0
step-vs-step-forkcompleted120msok0
step-vs-step-fork-fencedcompleted120msok0
fence-catches-benign-directioncompleted125msok0
in-flight-before-decisioncompleted171.0mok0
in-flight-before-decision-countedcompleted171.0mok0
in-flight-after-decisioncompleted192.0mok0
stale-read-step-count-fork-fencedcompleted201.0mok0
fork-hook-winscompleted131.0mok0
fork-timeout-winscompleted131.0mok0
unclaimed-payload-under-forkcompleted171.0mok0
claimed-payload-under-forkcompleted171.0mok0
writers-independent-step-bodiescompleted120msok0
writers-scripted-tempocompleted120msok0
cancel-mid-stepcancelled70msskipped0

Full trace: world-sim.txt

@NathanColosimo

Copy link
Copy Markdown
ContributorAuthor

Stack repair note: this PR was marked merged by pushing its head into its stale circular base branch; no code from it reached main. The compile-overlap change now continues against the correct base in #3798.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@NathanColosimo