Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Universal Dark Mode - works on any site (function() { var enabled = true; function applyDarkMode() { if (!enabled) return; // Create style element if it doesn't exist var style = document.getElementById('universal-dark-mode-style'); if (!style) { style = document.createElement('style'); style.id = 'universal-dark-mode-style'; document.head.appendChild(style); } // Dark mode CSS - inverts colors but preserves images/video style.textContent = ' /* Invert everything except media */ html { filter: invert(1) hue-rotate(180deg) !important; background: #1a1a2e !important; } /* Restore images, videos, iframes, canvas */ img, video, iframe, canvas, svg, picture, [style*="background-image"] { filter: invert(1) hue-rotate(180deg) !important; } /* Preserve specific elements that should not be inverted */ .no-dark-mode, .no-dark-mode *, [data-theme="light"], [data-theme="light"], .ace_editor, .ace_editor *, .CodeMirror, .CodeMirror *, .monaco-editor, .monaco-editor *, .markdown-body pre, .markdown-body pre *, .highlight, .highlight *, pre code, pre code * { filter: none !important; } /* Fix common UI elements */ .modal, .popup, .dropdown-menu, .tooltip, .popover { filter: invert(1) hue-rotate(180deg) !important; background: #2d2d44 !important; border-color: #444 !important; } /* Scrollbars */ ::-webkit-scrollbar { background: #1a1a2e !important; } ::-webkit-scrollbar-thumb { background: #444 !important; } ::-webkit-scrollbar-thumb:hover { background: #555 !important; } /* Selection */ ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; } ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; } '; } function removeDarkMode() { var style = document.getElementById('universal-dark-mode-style'); if (style) style.remove(); } // Toggle with Alt+Shift+D document.addEventListener('keydown', function(e) { if (e.altKey && e.shiftKey && e.key === 'D') { e.preventDefault(); enabled = !enabled; if (enabled) { applyDarkMode(); console.log('[Universal Dark Mode] Enabled'); } else { removeDarkMode(); console.log('[Universal Dark Mode] Disabled'); } } }); // Apply on load applyDarkMode(); // Re-apply on dynamic content var observer = new MutationObserver(function(mutations) { if (enabled && !document.getElementById('universal-dark-mode-style')) { applyDarkMode(); } }); observer.observe(document.head, { childList: true }); console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle'); })(); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })(); fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds by pranaygp · Pull Request #2397 · vercel/workflow · GitHub
Skip to content

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds - #2397

Merged
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest
Jun 16, 2026
Merged

fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds#2397
pranaygp merged 2 commits into
mainfrom
pgp/deployment-id-latest

Conversation

@pranaygp

@pranaygppranaygp commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

Summary

start({ deploymentId: 'latest' }) previously threw a WorkflowRuntimeError in any World that doesn't implement resolveLatestDeploymentId() — i.e. local dev and Postgres. That meant a workflow which opts into 'latest' to target the newest deployment on Vercel would fail outright in local development, even though there's nothing for it to do there.

Resolving 'latest' only means something in worlds with atomic, immutable deployments (currently Vercel). Other worlds have no notion of multiple deployments to resolve between. So instead of throwing, the SDK now logs a warning (once per process) and falls back to the current deployment, making 'latest' an effective no-op outside Vercel.

[workflow-sdk] deploymentId: 'latest' has no effect in this world and was ignored.
It is only supported by worlds with atomic deployments, such as Vercel.
The run will target the current deployment.

Changes

  • packages/core/src/runtime/start.ts — when deploymentId === 'latest' and the World has no resolveLatestDeploymentId(), warn via runtimeLogger.warn and fall back to currentDeploymentId instead of throwing. The warning is gated behind a once-per-process guard (hasWarnedLatestNoOp, mirroring the warnOnce pattern in constants.ts) so tight local/Postgres dev loops aren't flooded. Updated the StartOptionsWithDeploymentId JSDoc.
  • packages/core/src/runtime/start.test.ts — replaced the "should throw" unit test with one asserting the warning is logged and the run falls back to the current deployment ID (in both the run_created event and the queue dispatch); added a test asserting the warning fires exactly once across repeated 'latest' starts. Spies are now restored in afterEach via vi.restoreAllMocks() so a throwing assertion can't leak the runtimeLogger.warn spy into later tests.
  • packages/core/e2e/e2e.test.ts — new test gated to non-Vercel worlds (skipIf(WORKFLOW_VERCEL_ENV)) that starts a workflow with deploymentId: 'latest' and asserts it completes — directly exercising the no-op against the real local/Postgres worlds. (This is the e2e coverage that was previously missing for this option.)
  • docs — added a note to the deploymentId: "latest" section of both v4 and v5start.mdx describing the no-op-with-warning behavior in non-Vercel worlds.

Implementation note

The fallback assigns deploymentId = currentDeploymentId (rather than leaving the 'latest' sentinel in place). This is deliberate: the downstream if (deploymentId === currentDeploymentId) gate then takes the same-deployment fast path — byte-stream framing + compression enabled, no cross-deployment health-probe round-trip — which is exactly right for local/Postgres, where 'latest' semantically means "right here." (h/t @TooTallNate for calling this out.)

Behavior matrix

WorldBeforeAfter
Vercelresolves via APIresolves via API (unchanged)
local❌ throws⚠️ warns once, targets current deployment
Postgres❌ throws⚠️ warns once, targets current deployment

Testing

  • pnpm vitest run src/runtime/start.test.ts → 28/28 pass (incl. warn+fallback and warn-once tests)
  • pnpm --filter @workflow/core typecheck → clean
  • New e2e test runs on non-Vercel matrix entries in CI.

Docs Preview

Pagev4v5
start — Using deploymentId: "latest"/docs/…/start#using-deploymentid-latest/v5/docs/…/start#using-deploymentid-latest

(Behind deployment protection — requires Vercel team access.)

🤖 Generated with Claude Code

Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp requested a review from a team as a code ownerJune 13, 2026 06:27
CopilotAI review requested due to automatic review settings June 13, 2026 06:27
@changeset-bot

changeset-botBot commented Jun 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 17604c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.042s (-12.1% 🟢)1.007s (~)0.965s101.00x
💻 LocalExpress0.045s (+5.2% 🔺)1.006s (~)0.962s101.07x
🐘 PostgresExpress0.063s (+3.0%)1.012s (~)0.950s101.49x
💻 LocalNext.js (Turbopack)0.063s (+2.9%)1.005s (~)0.942s101.51x
🐘 PostgresNitro0.064s (~)1.012s (~)0.948s101.53x
🐘 PostgresNext.js (Turbopack)0.069s (+3.0%)1.012s (~)0.943s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.289s (-9.7% 🟢)1.938s (-15.3% 🟢)1.649s101.00x
▲ VercelNitro0.381s (+45.2% 🔺)2.017s (-14.5% 🟢)1.635s101.32x
▲ VercelNext.js (Turbopack)0.400s (~)2.662s (+4.5%)2.261s101.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.093s (-0.8%)2.007s (~)0.914s101.00x
💻 LocalNitro1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.105s (~)2.009s (~)0.904s101.01x
🐘 PostgresNitro1.111s (~)2.010s (~)0.899s101.02x
💻 LocalNext.js (Turbopack)1.132s (-1.3%)2.006s (~)0.874s101.04x
🐘 PostgresNext.js (Turbopack)1.142s (-1.2%)2.010s (~)0.868s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.820s (+11.1% 🔺)3.723s (-2.0%)1.903s101.00x
▲ VercelNext.js (Turbopack)1.856s (+12.6% 🔺)3.793s (-1.0%)1.937s101.02x
▲ VercelExpress1.927s (+15.2% 🔺)3.688s (~)1.761s101.06x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.505s (~)11.022s (~)0.517s31.00x
🐘 PostgresExpress10.515s (~)11.014s (~)0.499s31.00x
🐘 PostgresNitro10.553s (~)11.015s (~)0.462s31.00x
💻 LocalNitro10.568s (~)11.023s (~)0.455s31.01x
💻 LocalNext.js (Turbopack)10.799s (~)11.023s (~)0.224s31.03x
🐘 PostgresNext.js (Turbopack)10.816s (-1.2%)11.019s (-2.9%)0.203s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)14.040s (-8.2% 🟢)16.179s (-6.8% 🟢)2.140s21.00x
▲ VercelExpress14.438s (+2.1%)16.457s (+5.7% 🔺)2.019s21.03x
▲ VercelNitro15.509s (-37.5% 🟢)16.979s (-35.0% 🟢)1.470s21.10x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.702s (~)14.028s (~)0.326s51.00x
💻 LocalNitro13.802s (~)14.028s (~)0.227s51.01x
🐘 PostgresNitro13.949s (~)14.022s (-1.4%)0.073s51.02x
🐘 PostgresExpress13.969s (+1.4%)14.219s (+1.4%)0.250s51.02x
🐘 PostgresNext.js (Turbopack)14.432s (-2.2%)15.018s (-1.7%)0.586s41.05x
💻 LocalNext.js (Turbopack)14.541s (~)15.031s (~)0.489s41.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.047s (+2.3%)25.243s (+3.5%)2.196s31.00x
▲ VercelNitro23.615s (+12.0% 🔺)26.037s (+13.4% 🔺)2.422s31.02x
▲ VercelNext.js (Turbopack)23.625s (+13.3% 🔺)26.023s (+14.4% 🔺)2.397s31.03x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.414s (-0.5%)13.024s (~)0.610s71.00x
🐘 PostgresExpress12.420s (~)13.019s (~)0.600s71.00x
🐘 PostgresNitro12.474s (~)13.021s (~)0.547s71.00x
💻 LocalNitro12.559s (~)13.026s (~)0.467s71.01x
🐘 PostgresNext.js (Turbopack)13.874s (~)14.304s (~)0.429s71.12x
💻 LocalNext.js (Turbopack)13.920s (+2.3%)14.314s (+2.1%)0.394s71.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)34.386s (+13.1% 🔺)36.932s (+13.5% 🔺)2.546s31.00x
▲ VercelExpress36.345s (-4.7%)38.493s (-2.7%)2.148s31.06x
▲ VercelNitro36.506s (+21.6% 🔺)38.979s (+20.7% 🔺)2.473s31.06x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.197s (-2.8%)2.006s (~)0.809s151.00x
💻 LocalNitro1.198s (+0.7%)2.007s (~)0.809s151.00x
🐘 PostgresExpress1.204s (~)2.008s (~)0.804s151.01x
🐘 PostgresNitro1.206s (~)2.007s (~)0.801s151.01x
🐘 PostgresNext.js (Turbopack)1.267s (~)2.008s (~)0.741s151.06x
💻 LocalNext.js (Turbopack)1.305s (~)2.006s (~)0.701s151.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.024s (-33.7% 🟢)4.581s (-23.8% 🟢)1.558s71.00x
▲ VercelNitro3.331s (+36.8% 🔺)4.801s (+18.7% 🔺)1.470s71.10x
▲ VercelNext.js (Turbopack)3.717s (+39.8% 🔺)5.207s (+18.9% 🔺)1.490s61.23x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.353s (~)2.393s (~)1.041s131.00x
🐘 PostgresNitro1.379s (~)2.392s (~)1.013s131.02x
🐘 PostgresNext.js (Turbopack)1.595s (+1.4%)2.222s (-3.1%)0.627s141.18x
💻 LocalExpress1.732s (+6.6% 🔺)2.006s (~)0.274s151.28x
💻 LocalNext.js (Turbopack)1.813s (+2.4%)2.149s (+7.1% 🔺)0.336s141.34x
💻 LocalNitro1.975s (+0.7%)2.316s (~)0.341s131.46x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.139s (+15.0% 🔺)5.923s (+8.7% 🔺)1.784s61.00x
▲ VercelExpress4.759s (+32.3% 🔺)6.326s (+24.2% 🔺)1.567s51.15x
▲ VercelNext.js (Turbopack)4.769s (+53.5% 🔺)6.799s (+31.2% 🔺)2.030s51.15x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.682s (+6.2% 🔺)4.011s (~)2.329s81.00x
🐘 PostgresNitro1.704s (+5.9% 🔺)3.887s (-6.2% 🟢)2.183s81.01x
🐘 PostgresNext.js (Turbopack)3.303s (+0.9%)4.442s (+10.6% 🔺)1.138s71.96x
💻 LocalNext.js (Turbopack)4.241s (-12.5% 🟢)5.013s (-6.2% 🟢)0.772s62.52x
💻 LocalExpress4.609s (+8.8% 🔺)5.012s (+6.1% 🔺)0.403s62.74x
💻 LocalNitro5.412s (-1.6%)5.848s (-2.8%)0.435s63.22x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.298s (-5.4% 🟢)6.683s (+6.2% 🔺)2.385s51.00x
▲ VercelExpress4.606s (+9.5% 🔺)6.346s (+4.8%)1.740s51.07x
▲ VercelNext.js (Turbopack)5.523s (+6.3% 🔺)7.579s (+8.4% 🔺)2.056s41.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.197s (~)2.007s (~)0.811s151.00x
🐘 PostgresNitro1.221s (~)2.007s (~)0.786s151.02x
🐘 PostgresNext.js (Turbopack)1.295s (+0.7%)2.007s (~)0.712s151.08x
💻 LocalNext.js (Turbopack)1.430s (+3.5%)2.006s (~)0.577s151.19x
💻 LocalExpress1.543s (+2.1%)2.006s (~)0.463s151.29x
💻 LocalNitro1.553s (-6.3% 🟢)2.007s (~)0.454s151.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.956s (+22.1% 🔺)4.659s (+12.1% 🔺)1.703s71.00x
▲ VercelNext.js (Turbopack)2.981s (-14.1% 🟢)4.801s (-5.4% 🟢)1.819s71.01x
▲ VercelNitro3.212s (+9.1% 🔺)5.022s (+3.3%)1.811s61.09x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.335s (-1.2%)2.222s (-14.2% 🟢)0.887s141.00x
🐘 PostgresExpress1.383s (-2.1%)2.151s (-7.1% 🟢)0.769s141.04x
🐘 PostgresNext.js (Turbopack)1.543s (-4.8%)2.294s (~)0.751s141.16x
💻 LocalNext.js (Turbopack)2.057s (-0.7%)2.826s (~)0.769s111.54x
💻 LocalExpress2.142s (+22.7% 🔺)2.593s (+20.6% 🔺)0.451s121.60x
💻 LocalNitro2.218s (+3.9%)2.735s (+5.5% 🔺)0.517s111.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.108s (+36.1% 🔺)5.772s (+29.5% 🔺)1.664s61.00x
▲ VercelNitro4.164s (+58.6% 🔺)6.252s (+54.3% 🔺)2.087s51.01x
▲ VercelNext.js (Turbopack)4.509s (+72.0% 🔺)6.513s (+51.2% 🔺)2.004s51.10x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.550s (-1.3%)3.884s (-3.2%)2.334s81.00x
🐘 PostgresNitro1.716s (+6.5% 🔺)4.015s (+6.7% 🔺)2.299s81.11x
🐘 PostgresNext.js (Turbopack)3.691s (+35.0% 🔺)4.586s (+32.6% 🔺)0.895s72.38x
💻 LocalNext.js (Turbopack)4.943s (+0.6%)5.513s (+6.4% 🔺)0.570s63.19x
💻 LocalExpress5.553s (+18.5% 🔺)6.015s (+16.2% 🔺)0.462s63.58x
💻 LocalNitro6.409s (+9.5% 🔺)7.218s (+12.5% 🔺)0.809s54.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.556s (+1.9%)6.729s (+11.7% 🔺)2.173s51.00x
▲ VercelExpress6.433s (+86.1% 🔺)8.146s (+59.4% 🔺)1.713s41.41x
▲ VercelNext.js (Turbopack)6.640s (+87.9% 🔺)8.445s (+55.5% 🔺)1.805s41.46x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.563s (-2.0%)1.006s (-1.7%)0.443s601.00x
🐘 PostgresExpress0.578s (+2.8%)1.023s (+1.7%)0.445s591.03x
💻 LocalExpress0.602s (-3.7%)1.005s (-1.6%)0.403s601.07x
💻 LocalNitro0.614s (-2.2%)1.005s (~)0.391s601.09x
🐘 PostgresNext.js (Turbopack)0.822s (-3.1%)1.006s (-5.0%)0.184s601.46x
💻 LocalNext.js (Turbopack)0.885s (+0.6%)1.039s (~)0.154s581.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)7.161s (+16.8% 🔺)9.054s (+16.2% 🔺)1.893s71.00x
▲ VercelNitro7.477s (+46.0% 🔺)9.473s (+38.7% 🔺)1.996s71.04x
▲ VercelExpress8.012s (+45.3% 🔺)9.787s (+34.9% 🔺)1.776s71.12x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.349s (~)2.007s (-1.1%)0.658s451.00x
🐘 PostgresNitro1.380s (+1.9%)2.007s (~)0.628s451.02x
💻 LocalExpress1.503s (+0.6%)2.006s (~)0.503s451.11x
💻 LocalNitro1.579s (+1.3%)2.007s (~)0.427s451.17x
🐘 PostgresNext.js (Turbopack)1.938s (-2.8%)2.123s (-11.6% 🟢)0.186s431.44x
💻 LocalNext.js (Turbopack)2.147s (-0.6%)3.008s (+1.1%)0.860s301.59x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.945s (+9.6% 🔺)18.225s (+10.9% 🔺)2.280s51.00x
▲ VercelExpress16.730s (+9.3% 🔺)18.719s (+8.3% 🔺)1.989s51.05x
▲ VercelNext.js (Turbopack)17.182s (+4.5%)19.574s (+5.7% 🔺)2.391s51.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.637s (-3.1%)3.059s (-1.7%)0.422s401.00x
🐘 PostgresNitro2.787s (+3.3%)3.086s (~)0.298s391.06x
💻 LocalExpress3.161s (-0.8%)4.010s (+0.8%)0.849s301.20x
💻 LocalNitro3.346s (-0.9%)4.010s (~)0.664s301.27x
🐘 PostgresNext.js (Turbopack)3.818s (-1.0%)4.009s (-0.8%)0.191s301.45x
💻 LocalNext.js (Turbopack)4.381s (+1.7%)5.011s (~)0.629s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.306s (+10.1% 🔺)31.686s (+11.0% 🔺)2.380s41.00x
▲ VercelNitro30.203s (+11.9% 🔺)32.911s (+13.8% 🔺)2.707s41.03x
▲ VercelNext.js (Turbopack)31.012s (+4.1%)33.232s (+4.0%)2.220s41.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.253s (+3.8%)1.006s (~)0.754s601.00x
🐘 PostgresNitro0.270s (+11.5% 🔺)1.007s (~)0.737s601.07x
🐘 PostgresNext.js (Turbopack)0.293s (-0.7%)1.006s (~)0.713s601.16x
💻 LocalExpress0.396s (~)1.004s (~)0.609s601.57x
💻 LocalNitro0.438s (+5.3% 🔺)1.005s (~)0.567s601.73x
💻 LocalNext.js (Turbopack)0.587s (-0.8%)1.058s (+1.8%)0.470s572.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.803s (-3.9%)3.935s (+8.0% 🔺)2.132s161.00x
▲ VercelExpress1.881s (-8.2% 🟢)3.879s (+1.8%)1.998s161.04x
▲ VercelNext.js (Turbopack)1.912s (-5.9% 🟢)3.755s (-4.1%)1.843s161.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.402s (+0.8%)1.029s (+1.1%)0.627s881.00x
🐘 PostgresNitro0.441s (+9.4% 🔺)1.104s (+8.6% 🔺)0.663s821.10x
🐘 PostgresNext.js (Turbopack)0.620s (-6.7% 🟢)1.161s (-7.4% 🟢)0.541s781.54x
💻 LocalExpress2.094s (+2.1%)2.564s (-1.7%)0.469s365.21x
💻 LocalNitro2.145s (-2.1%)2.767s (-3.0%)0.622s335.34x
💻 LocalNext.js (Turbopack)2.471s (+6.8% 🔺)3.183s (+1.1%)0.712s296.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.627s (-7.9% 🟢)4.404s (-11.7% 🟢)1.777s211.00x
▲ VercelExpress2.764s (+6.3% 🔺)4.537s (+9.9% 🔺)1.773s201.05x
▲ VercelNext.js (Turbopack)3.389s (+3.2%)5.003s (-5.5% 🟢)1.615s181.29x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.789s (+3.9%)1.453s (+3.6%)0.665s831.00x
🐘 PostgresNitro0.854s (+8.8% 🔺)1.546s (+9.7% 🔺)0.693s781.08x
🐘 PostgresNext.js (Turbopack)3.030s (-2.7%)3.795s (-5.5% 🟢)0.765s323.84x
💻 LocalExpress9.486s (+6.7% 🔺)10.027s (+5.7% 🔺)0.542s1212.03x
💻 LocalNitro9.883s (~)10.360s (-0.8%)0.476s1212.53x
💻 LocalNext.js (Turbopack)10.725s (+2.1%)11.756s (+3.2%)1.031s1113.60x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-4.7%)7.749s (-1.8%)1.886s161.00x
▲ VercelExpress6.242s (-20.5% 🟢)8.034s (-15.4% 🟢)1.791s151.06x
▲ VercelNext.js (Turbopack)7.802s (-15.0% 🟢)9.743s (-14.0% 🟢)1.940s131.33x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.161s (+0.8%)2.005s (~)0.010s (+1.0%)2.017s (~)0.856s101.00x
🐘 PostgresExpress1.169s (+0.7%)1.998s (~)0.001s (+22.2% 🔺)2.010s (~)0.841s101.01x
🐘 PostgresNitro1.170s (~)1.997s (~)0.002s (+50.0% 🔺)2.011s (~)0.841s101.01x
💻 LocalNitro1.172s (~)2.006s (~)0.012s (-2.4%)2.020s (~)0.848s101.01x
💻 LocalNext.js (Turbopack)1.209s (-0.7%)2.003s (~)0.010s (-1.0%)2.018s (~)0.809s101.04x
🐘 PostgresNext.js (Turbopack)1.221s (-1.0%)2.001s (~)0.001s (+7.7% 🔺)2.010s (~)0.789s101.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.921s (+29.4% 🔺)4.114s (+18.3% 🔺)0.763s (-26.3% 🟢)5.494s (+11.2% 🔺)2.573s101.00x
▲ VercelNext.js (Turbopack)3.276s (+44.6% 🔺)4.001s (+10.1% 🔺)0.975s (+8.3% 🔺)6.086s (+20.2% 🔺)2.809s101.12x
▲ VercelNitro3.285s (+36.6% 🔺)4.299s (+22.4% 🔺)0.675s (-49.7% 🟢)5.851s (+10.2% 🔺)2.566s101.12x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.564s (-0.9%)2.011s (~)0.013s (+7.9% 🔺)2.026s (~)0.462s301.00x
🐘 PostgresExpress1.576s (~)2.004s (~)0.005s (-1.9%)2.027s (~)0.450s301.01x
💻 LocalNitro1.600s (~)2.010s (~)0.013s (+4.6%)2.026s (~)0.426s301.02x
🐘 PostgresNitro1.638s (+3.6%)2.007s (~)0.005s (-3.8%)2.028s (~)0.390s301.05x
💻 LocalNext.js (Turbopack)1.723s (~)2.009s (~)0.012s (+9.3% 🔺)2.025s (~)0.302s301.10x
🐘 PostgresNext.js (Turbopack)1.752s (-1.9%)2.010s (~)0.005s (-9.6% 🟢)2.025s (~)0.273s301.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.862s (-2.6%)7.273s (~)0.579s (+117.0% 🔺)8.399s (+2.8%)2.537s81.00x
▲ VercelExpress6.080s (-4.0%)7.435s (-0.5%)0.225s (-58.0% 🟢)8.206s (-3.5%)2.126s81.04x
▲ VercelNext.js (Turbopack)6.167s (-22.3% 🟢)7.415s (-20.7% 🟢)0.525s (+51.6% 🔺)8.463s (-18.2% 🟢)2.296s81.05x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.733s (-4.3%)1.046s (~)0.000s (+50.0% 🔺)1.060s (~)0.327s571.00x
🐘 PostgresNitro0.852s (+14.5% 🔺)1.105s (+5.8% 🔺)0.000s (+5.6% 🔺)1.120s (+4.9%)0.268s541.16x
🐘 PostgresNext.js (Turbopack)1.034s (-1.2%)1.463s (-4.1%)0.000s (+Infinity% 🔺)1.471s (-4.1%)0.437s411.41x
💻 LocalExpress1.411s (+1.9%)2.014s (~)0.001s (+128.6% 🔺)2.017s (~)0.606s301.93x
💻 LocalNitro1.425s (~)2.014s (~)0.000s (-21.4% 🟢)2.016s (~)0.592s301.94x
💻 LocalNext.js (Turbopack)1.493s (+3.3%)2.013s (~)0.001s (+166.7% 🔺)2.017s (~)0.523s302.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.798s (-15.3% 🟢)4.389s (-9.8% 🟢)0.000s (-100.0% 🟢)4.882s (-9.2% 🟢)2.084s131.00x
▲ VercelExpress2.833s (-7.5% 🟢)4.483s (+7.0% 🔺)0.000s (NaN%)4.977s (+7.5% 🔺)2.144s131.01x
▲ VercelNext.js (Turbopack)2.921s (-32.5% 🟢)4.524s (-22.0% 🟢)0.000s (+Infinity% 🔺)4.980s (-21.2% 🟢)2.059s131.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.595s (-3.3%)2.139s (~)0.000s (+Infinity% 🔺)2.153s (-1.8%)0.558s281.00x
🐘 PostgresNitro1.761s (+2.0%)2.182s (-3.3%)0.000s (+Infinity% 🔺)2.203s (-2.9%)0.442s281.10x
🐘 PostgresNext.js (Turbopack)2.150s (-1.3%)2.571s (-1.6%)0.000s (-100.0% 🟢)2.618s (~)0.468s231.35x
💻 LocalNext.js (Turbopack)3.094s (+5.8% 🔺)3.675s (+3.4%)0.001s (+15.4% 🔺)3.679s (+3.4%)0.585s171.94x
💻 LocalExpress3.106s (+2.1%)3.732s (~)0.001s (+12.5% 🔺)3.736s (~)0.630s171.95x
💻 LocalNitro3.147s (~)3.776s (-1.6%)0.001s (+9.1% 🔺)3.779s (-1.7%)0.632s161.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.350s (-20.9% 🟢)6.036s (-14.9% 🟢)0.000s (-11.1% 🟢)6.747s (-10.9% 🟢)2.397s91.00x
▲ VercelNext.js (Turbopack)4.733s (-28.1% 🟢)6.277s (-24.6% 🟢)0.000s (NaN%)6.724s (-24.1% 🟢)1.990s91.09x
▲ VercelExpress4.999s (-22.8% 🟢)6.368s (-16.9% 🟢)0.000s (-100.0% 🟢)7.008s (-14.7% 🟢)2.009s91.15x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress15/21
🐘 PostgresExpress18/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres13/21
Next.js (Turbopack)🐘 Postgres16/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production144112301672
✅ 💻 Local Development190902192128
✅ 📦 Local Production190902192128
✅ 🐘 Local Postgres189502332128
✅ 🪟 Windows15200152
✅ 📋 Other88501791064
Total8191110809272

❌ Failed Tests

▲ Vercel Production (1 failed)

hono (1 failed):

  • distributedAbortController - TTL expiration triggers signal | wrun_01KV2KS5Q8FWGQK0G5QRTCTT1G | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
❌ hono124127
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15200
✅ nextjs-turbopack-stable-lazy-discovery-enabled15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable-lazy-discovery-disabled15200
✅ nextjs-webpack-stable-lazy-discovery-enabled15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable126026
✅ express-stable126026
✅ fastify-stable126026
✅ hono-stable126026
✅ nextjs-turbopack-canary132020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15101
✅ nextjs-turbopack-stable-lazy-discovery-enabled15101
✅ nextjs-webpack-canary132020
✅ nextjs-webpack-stable-lazy-discovery-disabled15101
✅ nextjs-webpack-stable-lazy-discovery-enabled15101
✅ nitro-stable126026
✅ nuxt-stable126026
✅ sveltekit-stable14507
✅ vite-stable126026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable126026
✅ e2e-local-postgres-tanstack-start-126026
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR adjusts start({ deploymentId: 'latest' }) behavior so it no longer throws in Worlds that don’t implement resolveLatestDeploymentId() (e.g. local dev and Postgres). Instead, it logs a warning and targets the current deployment, making 'latest' an intentional no-op outside atomic-deployment platforms like Vercel.

Changes:

  • Updated start() to resolve 'latest' when supported, otherwise warn + fall back to currentDeploymentId instead of throwing.
  • Reworked unit coverage to assert warn + fallback behavior, and added an e2e test ensuring non-Vercel worlds can start/complete runs using deploymentId: 'latest'.
  • Updated v4/v5 docs and added a changeset documenting the no-op-with-warning behavior.

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 2 comments.

Show a summary per file
FileDescription
packages/core/src/runtime/start.tsWarn + fall back to current deployment when 'latest' is used in Worlds without resolveLatestDeploymentId().
packages/core/src/runtime/start.test.tsReplaces the previous “throws” expectation with a warn + fallback assertion (event payload + queue dispatch).
packages/core/e2e/e2e.test.tsAdds a non-Vercel-gated e2e test verifying 'latest' doesn’t break local/Postgres runs.
docs/content/docs/v5/api-reference/workflow-api/start.mdxDocuments 'latest' being a no-op (with warning) outside atomic-deployment worlds.
docs/content/docs/v4/api-reference/workflow-api/start.mdxSame documentation update for v4 docs.
.changeset/deployment-id-latest-noop-non-vercel.mdPatch changeset describing the behavior change.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment on lines +518 to +522
it('should warn and fall back to the current deployment ID when "latest" is used with a World that does not implement resolveLatestDeploymentId', async () => {
const warnSpy = vi
.spyOn(runtimeLogger, 'warn')
.mockImplementation(() => {});

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fixed in 17604c2. The block's afterEach now calls vi.restoreAllMocks() (in addition to vi.clearAllMocks()), so the runtimeLogger.warn spy is restored even if an assertion throws before the test's own cleanup. Dropped the manual warnSpy.mockRestore(), and the guard is reset in beforeEach so the warn path is exercisable regardless of test order.

Comment threadpackages/core/src/runtime/start.ts Outdated
Comment on lines +207 to +213
runtimeLogger.warn(
"deploymentId: 'latest' has no effect in this world and was ignored. " +
'It is only supported by worlds with atomic deployments, such as Vercel. ' +
'The run will target the current deployment.',
{ currentDeploymentId }
);
deploymentId = currentDeploymentId;

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good call — done in 17604c2. The warning is now gated behind a once-per-process guard (hasWarnedLatestNoOp), mirroring the warnOnce pattern already used in constants.ts. Users still get the nudge that 'latest' is a no-op here, but a workflow that hardcodes 'latest' for Vercel won't flood a tight local/Postgres dev loop. Exposed _resetLatestNoOpWarnForTests() (@internal) so the warn path stays testable, and added a test asserting it fires exactly once across repeated 'latest' starts.

@TooTallNateTooTallNate left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approve — correct behavior change, and it quietly fixes a second bug too

Turning deploymentId: 'latest' from a hard throw into a warn-and-fall-back is the right call: a workflow that opts into 'latest' to target the newest Vercel deployment shouldn't be unrunnable in local dev or Postgres, where there's no deployment set to resolve between. The fix is minimal and the reasoning in both the code comment and the JSDoc is clear about why it's a no-op rather than just that it is.

What I verified:

  • WorkflowRuntimeError import is not orphaned — still used at 8 other sites in start.ts; runtimeLogger and currentDeploymentId are both already in scope above the check.
  • The fallback also fixes a downstream interaction the PR doesn't mention. Setting deploymentId = currentDeploymentId (not leaving it as the 'latest' sentinel) means the later if (deploymentId === currentDeploymentId) gate takes the same-deployment fast path — framing + compression enabled, no health-probe round-trip. That's exactly right for local/Postgres, where 'latest' semantically means "right here." Had it fallen through with the sentinel still set, it would have taken the cross-deployment branch and either probed a nonexistent target or disabled framing. Worth a sentence in the PR body, but the code does the correct thing.
  • The unit test is the right replacement — asserts the warning (message + currentDeploymentId context) and that the fallback lands on both payloads (run_created eventData and the queue dispatch's deploymentId), not just that it didn't throw. 27/27 pass locally; typecheck clean.
  • The e2e test is well-scoped: reuses addTenWorkflow (no new workbench files), correctly skipIf(WORKFLOW_VERCEL_ENV) so it exercises the real no-op on local/Postgres while leaving Vercel's actual resolve-API path alone, and asserts both the return value and the CLI-inspected run record. This is genuinely new coverage — 'latest' previously had no e2e exercise on non-Vercel worlds.
  • Docs (v4 + v5) accurately describe the no-op-with-warning behavior and the "still runs unchanged locally" implication. Changeset is a correctly-scoped patch on @workflow/core.

One small note (non-blocking)

The warning fires on everystart({ deploymentId: 'latest' }) call in local dev — which, for a workflow that hardcodes 'latest' for its Vercel deployment, means every single local run logs it. That's arguably the intended nudge ("this option does nothing here"), but for a tight dev loop it could get noisy. Not worth gating or deduping for this PR; flagging only in case repeated-warning noise comes up — runtimeLogger.warn once-per-process would be a trivial follow-up if it does.

CI

The three red lanes are all unrelated to this change: E2E Windows Tests aborted in dev.test.ts on a "Next.js dev server unhealthy / Turbopack" startup failure (the new test never ran — the suite bailed before it), and Benchmark Vercel (express) + the E2E Required Check cascade are this cycle's known baseline flakes. The new test is gated off Vercel anyway. Nothing here implicates the PR.

LGTM.

…anup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
@pranaygp
pranaygp merged commit 4b7a720 into mainJun 16, 2026
119 of 121 checks passed
@pranaygp
pranaygp deleted the pgp/deployment-id-latest branch June 16, 2026 23:09
@github-actionsgithub-actionsBot mentioned this pull request Jun 16, 2026
pranaygp added a commit that referenced this pull request Jun 16, 2026
* origin/main:
fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds (#2397)
fix(deps): upgrade astro to 6.4.6 to resolve CVE-2026-54299 (#2457)
Small detail panel cleanup (#2459)
Fix lazy Next workflow HMR (#2438)
Prevent peer dependency-only major bumps (#2437)
fix(changesets): only major-bump peer dependents when out of range (#2439)
Version Packages (beta) (#2428)
otel: explicit traceparent injection + linked-trace mode for bounded per-invocation traces (#2363)
[next] Clarify `serverExternalPackages` warning (#2417)
Add .swc gitignore handling to builder (#2427)
Version Packages (beta) (#2390)
[ci] Increase dev.test.ts cleanup hook timeout (#2416)
[world-vercel] Switch event endpoints to v4 wire format (#2055)
github-actionsBot added a commit that referenced this pull request Jun 16, 2026
…2397)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
---------
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2464. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp pushed a commit that referenced this pull request Jun 17, 2026
…2397) (#2464)
* fix(core): make deploymentId 'latest' a no-op in non-Vercel worlds
Previously, start({ deploymentId: 'latest' }) threw a WorkflowRuntimeError
in any World that doesn't implement resolveLatestDeploymentId() (local dev,
Postgres). That meant a workflow which opts into 'latest' on Vercel would
fail outright in local development.
Resolving 'latest' only means something in worlds with atomic, immutable
deployments. In other worlds there is nothing to resolve between, so instead
of throwing we now log a warning and fall back to the current deployment,
making 'latest' an effective no-op there.
- start.ts: warn + fall back to currentDeploymentId instead of throwing
- start.test.ts: replace the "should throw" test with a warn + fallback test
- e2e.test.ts: assert 'latest' completes (no-op) on non-Vercel worlds
- docs: note the no-op behavior in v4 + v5 start.mdx
* fix(core): warn once for deploymentId 'latest' no-op; harden test cleanup
Address PR review:
- Gate the 'latest'-has-no-effect warning behind a once-per-process guard
(mirrors the warnOnce pattern in constants.ts) so a workflow that hardcodes
'latest' for Vercel doesn't flood local/Postgres dev logs on every run.
Exposes _resetLatestNoOpWarnForTests() (@internal) for unit tests.
- start.test.ts: reset the guard in beforeEach and restore spies in afterEach
via vi.restoreAllMocks() so a throwing assertion can't leak the
runtimeLogger.warn spy into later tests; drop the manual mockRestore().
- Add a test asserting the warning fires exactly once across repeated
'latest' starts while every run still falls back to the current deployment.
---------
Signed-off-by: Pranay Prakash <pranay.gp@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@pranaygp@TooTallNate@VaguelySerious