Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Universal Dark Mode - works on any site (function() { var enabled = true; function applyDarkMode() { if (!enabled) return; // Create style element if it doesn't exist var style = document.getElementById('universal-dark-mode-style'); if (!style) { style = document.createElement('style'); style.id = 'universal-dark-mode-style'; document.head.appendChild(style); } // Dark mode CSS - inverts colors but preserves images/video style.textContent = ' /* Invert everything except media */ html { filter: invert(1) hue-rotate(180deg) !important; background: #1a1a2e !important; } /* Restore images, videos, iframes, canvas */ img, video, iframe, canvas, svg, picture, [style*="background-image"] { filter: invert(1) hue-rotate(180deg) !important; } /* Preserve specific elements that should not be inverted */ .no-dark-mode, .no-dark-mode *, [data-theme="light"], [data-theme="light"], .ace_editor, .ace_editor *, .CodeMirror, .CodeMirror *, .monaco-editor, .monaco-editor *, .markdown-body pre, .markdown-body pre *, .highlight, .highlight *, pre code, pre code * { filter: none !important; } /* Fix common UI elements */ .modal, .popup, .dropdown-menu, .tooltip, .popover { filter: invert(1) hue-rotate(180deg) !important; background: #2d2d44 !important; border-color: #444 !important; } /* Scrollbars */ ::-webkit-scrollbar { background: #1a1a2e !important; } ::-webkit-scrollbar-thumb { background: #444 !important; } ::-webkit-scrollbar-thumb:hover { background: #555 !important; } /* Selection */ ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; } ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; } '; } function removeDarkMode() { var style = document.getElementById('universal-dark-mode-style'); if (style) style.remove(); } // Toggle with Alt+Shift+D document.addEventListener('keydown', function(e) { if (e.altKey && e.shiftKey && e.key === 'D') { e.preventDefault(); enabled = !enabled; if (enabled) { applyDarkMode(); console.log('[Universal Dark Mode] Enabled'); } else { removeDarkMode(); console.log('[Universal Dark Mode] Disabled'); } } }); // Apply on load applyDarkMode(); // Re-apply on dynamic content var observer = new MutationObserver(function(mutations) { if (enabled && !document.getElementById('universal-dark-mode-style')) { applyDarkMode(); } }); observer.observe(document.head, { childList: true }); console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle'); })(); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })(); cli: restore dynamic world loading for community backends by karthikscale3 · Pull Request #2806 · vercel/workflow · GitHub
Skip to content

cli: restore dynamic world loading for community backends - #2806

Merged
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends
Jul 7, 2026
Merged

cli: restore dynamic world loading for community backends#2806
karthikscale3 merged 3 commits into
mainfrom
karthik/cli-generic-world-backends

Conversation

@karthikscale3

Copy link
Copy Markdown
Contributor

What changed

Follow-up to #2804, fixing the same class of #2752 regression on the CLI side.

Since #2752 moved world selection to static injection, setupCliWorld (packages/cli/src/lib/inspect/setup.ts) only constructs the vercel, local, and postgres worlds explicitly and throws for anything else:

Unsupported workflow backend for CLI world initialization: @workflow-worlds/turso

Before #2752, any non-vercel backend fell through to the dynamic createWorld() loader in @workflow/core/runtime, so community worlds (@workflow-worlds/turso, @workflow-worlds/mongodb, @workflow-worlds/redis, workflow-world-jazz, …) worked with workflow inspect / workflow web. The --backend flag help still advertises <your-package-name>, and @workflow/web ships an env allowlist for these worlds — they're a supported configuration.

Fix

Generalize the postgres-only dynamic path (createPostgresCliWorld) into createDynamicCliWorld(backendId): any backend other than vercel/local is resolved from the user's project directory via createRequire().resolve() and loaded through its createWorld() export — the same construction @workflow/web uses after #2804 — with clear errors when the package isn't installed or doesn't export createWorld().

The vercel, local, and postgres (@workflow/world-postgres resolves through the identical code it used before) paths are behaviorally unchanged.

Validation

  • tsc --noEmit on @workflow/cli — clean
  • biome check on the changed file — only the pre-existing setupCliWorld complexity warning, present on main
  • Smoke test against a fixture project: a fake @workflow-worlds/fakeworld package exporting createWorld() is resolved from the project's node_modules and constructed; a missing package produces Could not resolve workflow backend package …; a package without the export produces … does not export createWorld()

Follow-up

This helper is now line-for-line the shape of createWorldForBackend in @workflow/web (#2804). Once both land, extracting a shared resolver (e.g. into @workflow/utils, guarded for Node-only usage) would keep them from drifting.

🤖 Generated with Claude Code

Since #2752 moved world selection to static injection, setupCliWorld only
constructed the vercel, local, and postgres worlds explicitly and threw
'Unsupported workflow backend' for anything else — breaking community
worlds (e.g. @workflow-worlds/turso) that previously loaded through the
dynamic createWorld() in @workflow/core/runtime.
Generalize the postgres-only dynamic path: any backend other than
vercel/local is now resolved from the user's project directory and loaded
via its createWorld() export, matching @workflow/web's world construction
(#2804), with clear errors when the package is missing or does not export
createWorld().
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 requested review from a team and ijjk as code ownersJuly 7, 2026 21:08
@changeset-bot

changeset-botBot commented Jul 7, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a0cc4d

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/cliPatch
workflowPatch
@workflow/world-testingPatch
@workflow/corePatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/webPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/nuxtPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.048s (+3.7%)1.006s (~)0.957s101.00x
💻 LocalExpress0.049s (+9.8% 🔺)1.006s (~)0.957s101.02x
💻 LocalNext.js (Turbopack)0.055s (+4.1%)1.005s (~)0.950s101.15x
🐘 PostgresNitro0.072s (+10.4% 🔺)1.012s (~)0.940s101.50x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.295s (+30.9% 🔺)2.157s (+5.4% 🔺)1.862s101.00x
▲ VercelNitro0.399s (+111.9% 🔺)1.659s (-18.2% 🟢)1.260s101.35x
▲ VercelNext.js (Turbopack)0.900s (+270.3% 🔺)2.665s (+12.0% 🔺)1.765s103.06x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.083s (~)2.007s (~)0.923s101.00x
💻 LocalNitro1.086s (+0.8%)2.006s (~)0.920s101.00x
💻 LocalNext.js (Turbopack)1.094s (~)2.006s (~)0.912s101.01x
🐘 PostgresNitro1.099s (~)2.010s (~)0.911s101.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.441s (+1.7%)3.192s (+13.1% 🔺)1.751s101.00x
▲ VercelNitro1.451s (+6.6% 🔺)3.122s (+3.5%)1.671s101.01x
▲ VercelNext.js (Turbopack)2.442s (+4.1%)3.896s (+8.5% 🔺)1.454s101.69x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.474s (~)11.024s (~)0.550s31.00x
💻 LocalNitro10.481s (~)11.022s (~)0.542s31.00x
💻 LocalNext.js (Turbopack)10.484s (~)11.024s (~)0.539s31.00x
🐘 PostgresNitro10.534s (~)11.019s (~)0.485s31.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro11.796s (+0.9%)13.703s (+7.9% 🔺)1.907s31.00x
▲ VercelExpress11.934s (+2.2%)13.378s (-4.1%)1.445s31.01x
▲ VercelNext.js (Turbopack)13.011s (+0.7%)14.658s (+3.4%)1.646s31.10x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.589s (-0.8%)14.019s (~)0.430s51.00x
💻 LocalNext.js (Turbopack)13.649s (~)14.028s (~)0.379s51.00x
💻 LocalExpress13.663s (~)14.029s (~)0.366s51.01x
💻 LocalNitro13.744s (~)14.028s (~)0.285s51.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.829s (+4.0%)18.459s (+5.9% 🔺)1.630s41.00x
▲ VercelExpress16.990s (+1.9%)18.547s (-2.1%)1.556s41.01x
▲ VercelNext.js (Turbopack)17.844s (-0.7%)20.019s (+1.3%)2.175s31.06x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro12.133s (-1.6%)13.017s (~)0.884s71.00x
💻 LocalNitro12.312s (+0.7%)13.026s (~)0.714s71.01x
💻 LocalNext.js (Turbopack)12.366s (+1.0%)13.025s (~)0.659s71.02x
💻 LocalExpress12.437s (+1.8%)13.025s (~)0.589s71.03x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express18.079s (+4.5%)19.607s (+2.2%)1.528s51.00x
▲ VercelNitro18.392s (+7.7% 🔺)20.496s (+9.2% 🔺)2.104s51.02x
▲ VercelNext.js (Turbopack)21.018s (+6.7% 🔺)22.897s (+5.6% 🔺)1.879s41.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.170s (-1.4%)2.008s (~)0.838s151.00x
💻 LocalExpress1.399s (-3.1%)2.006s (~)0.607s151.20x
💻 LocalNitro1.415s (+0.5%)2.006s (~)0.592s151.21x
💻 LocalNext.js (Turbopack)1.476s (+4.9%)2.073s (+3.3%)0.597s151.26x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (-9.6% 🟢)4.062s (+12.7% 🔺)1.994s81.00x
▲ VercelExpress2.162s (-4.9%)3.478s (-10.9% 🟢)1.315s91.05x
▲ VercelNext.js (Turbopack)3.710s (+26.3% 🔺)5.391s (+16.2% 🔺)1.681s61.79x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.418s (+1.4%)2.393s (-3.2%)0.974s131.00x
💻 LocalExpress2.326s (-12.4% 🟢)3.009s (-3.2%)0.683s101.64x
💻 LocalNext.js (Turbopack)2.390s (-3.9%)3.008s (-3.2%)0.618s101.68x
💻 LocalNitro2.536s (+9.3% 🔺)3.009s (~)0.473s101.79x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.589s (+2.4%)4.090s (+14.9% 🔺)1.502s81.00x
▲ VercelExpress2.724s (+4.5%)4.070s (-1.2%)1.347s81.05x
▲ VercelNext.js (Turbopack)3.946s (+18.5% 🔺)5.806s (+18.3% 🔺)1.861s61.52x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.625s (~)4.013s (-3.0%)2.389s81.00x
💻 LocalNitro4.234s (-1.4%)5.014s (+2.9%)0.780s62.61x
💻 LocalExpress4.504s (+2.0%)5.012s (-3.2%)0.507s62.77x
💻 LocalNext.js (Turbopack)4.844s (+3.1%)5.347s (-3.0%)0.503s62.98x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.843s (~)4.589s (+1.8%)1.746s71.00x
▲ VercelExpress3.383s (+15.9% 🔺)5.036s (+14.6% 🔺)1.652s61.19x
▲ VercelNext.js (Turbopack)4.814s (+21.8% 🔺)6.673s (+15.6% 🔺)1.859s51.69x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.188s (-0.7%)2.006s (~)0.818s151.00x
💻 LocalExpress1.390s (-4.3%)2.006s (~)0.617s151.17x
💻 LocalNext.js (Turbopack)1.450s (-3.4%)2.007s (~)0.557s151.22x
💻 LocalNitro1.465s (+3.6%)2.007s (~)0.542s151.23x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.068s (+8.9% 🔺)3.855s (+15.2% 🔺)1.787s81.00x
▲ VercelExpress2.070s (+7.1% 🔺)3.401s (-6.9% 🟢)1.332s91.00x
▲ VercelNext.js (Turbopack)4.029s (+35.5% 🔺)5.736s (+21.9% 🔺)1.706s61.95x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.354s (+2.6%)2.223s (+10.7% 🔺)0.870s141.00x
💻 LocalNext.js (Turbopack)2.479s (-11.8% 🟢)3.009s (-10.0% 🟢)0.530s101.83x
💻 LocalExpress2.490s (~)3.009s (~)0.519s101.84x
💻 LocalNitro2.728s (+11.7% 🔺)3.109s (+3.3%)0.381s102.01x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.256s (+2.7%)3.811s (+8.7% 🔺)1.555s81.00x
▲ VercelExpress2.493s (-19.6% 🟢)3.793s (-17.1% 🟢)1.300s81.11x
▲ VercelNext.js (Turbopack)3.703s (+17.4% 🔺)5.347s (+17.8% 🔺)1.644s61.64x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.786s (+9.2% 🔺)4.439s (+3.2%)2.653s71.00x
💻 LocalNext.js (Turbopack)3.790s (-29.9% 🟢)5.682s (-5.5% 🟢)1.892s62.12x
💻 LocalExpress5.057s (+41.8% 🔺)5.846s (+16.6% 🔺)0.789s62.83x
💻 LocalNitro5.794s (+4.9%)6.215s (+3.3%)0.421s53.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.085s (+21.1% 🔺)5.219s (+37.1% 🔺)2.134s61.00x
▲ VercelExpress3.547s (+33.2% 🔺)5.230s (+17.9% 🔺)1.683s61.15x
▲ VercelNext.js (Turbopack)4.214s (-6.6% 🟢)6.033s (-1.8%)1.819s51.37x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.528s (-12.2% 🟢)1.006s (-1.7%)0.477s601.00x
💻 LocalExpress0.586s (-3.2%)1.005s (~)0.419s601.11x
💻 LocalNitro0.605s (+3.6%)1.005s (~)0.399s601.15x
💻 LocalNext.js (Turbopack)0.641s (+7.1% 🔺)1.022s (+1.7%)0.381s591.21x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.608s (+4.8%)4.017s (+1.2%)1.409s151.00x
▲ VercelNitro2.768s (+6.2% 🔺)4.378s (+9.1% 🔺)1.610s141.06x
▲ VercelNext.js (Turbopack)3.650s (-9.9% 🟢)5.554s (-1.9%)1.904s111.40x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.258s (-9.8% 🟢)2.030s (~)0.772s451.00x
💻 LocalExpress1.491s (~)2.006s (~)0.515s451.19x
💻 LocalNitro1.521s (+5.1% 🔺)2.006s (~)0.486s451.21x
💻 LocalNext.js (Turbopack)1.573s (~)2.006s (~)0.434s451.25x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.204s (+6.5% 🔺)7.705s (+3.0%)1.501s121.00x
▲ VercelNitro6.798s (+16.4% 🔺)8.333s (+12.9% 🔺)1.535s111.10x
▲ VercelNext.js (Turbopack)8.792s (+6.6% 🔺)10.758s (+12.2% 🔺)1.965s91.42x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.565s (-9.9% 🟢)3.112s (-3.4%)0.546s391.00x
💻 LocalExpress3.219s (-3.4%)4.009s (~)0.790s301.25x
💻 LocalNitro3.305s (+4.0%)4.009s (+1.6%)0.704s301.29x
💻 LocalNext.js (Turbopack)3.418s (~)4.009s (~)0.591s301.33x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.018s (+4.6%)13.798s (+6.7% 🔺)1.779s91.00x
▲ VercelExpress12.133s (+3.8%)13.555s (-2.0%)1.423s91.01x
▲ VercelNext.js (Turbopack)17.751s (+3.6%)19.668s (+5.1% 🔺)1.917s71.48x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.216s (-2.4%)1.006s (~)0.791s601.00x
💻 LocalExpress0.513s (-0.7%)1.005s (~)0.492s602.38x
💻 LocalNitro0.534s (+4.2%)1.022s (+1.7%)0.488s592.47x
💻 LocalNext.js (Turbopack)0.637s (-0.9%)1.022s (~)0.385s592.95x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.080s (-1.5%)2.609s (+8.7% 🔺)1.529s231.00x
▲ VercelExpress1.138s (+1.1%)2.346s (-10.7% 🟢)1.208s261.05x
▲ VercelNext.js (Turbopack)2.431s (+24.1% 🔺)4.107s (+22.3% 🔺)1.676s152.25x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.333s (-5.0%)1.017s (+1.1%)0.685s891.00x
💻 LocalNitro2.451s (-3.0%)3.009s (~)0.558s307.37x
💻 LocalExpress2.483s (-1.9%)3.010s (-1.1%)0.526s307.46x
💻 LocalNext.js (Turbopack)2.563s (-6.7% 🟢)3.008s (-4.4%)0.446s307.70x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.414s (-0.8%)2.716s (-11.0% 🟢)1.302s341.00x
▲ VercelNitro1.485s (+12.2% 🔺)2.965s (+19.1% 🔺)1.481s311.05x
▲ VercelNext.js (Turbopack)2.738s (+5.7% 🔺)4.538s (+11.8% 🔺)1.800s201.94x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.539s (-6.0% 🟢)1.097s (+1.8%)0.558s1101.00x
💻 LocalExpress5.583s (-6.6% 🟢)8.426s (-0.7%)2.843s1510.36x
💻 LocalNitro5.668s (-3.1%)8.090s (-6.9% 🟢)2.421s1510.52x
💻 LocalNext.js (Turbopack)6.055s (-5.8% 🟢)8.814s (-4.6%)2.759s1411.24x
🐘 PostgresExpress⚠️missing----
🐘 PostgresNext.js (Turbopack)⚠️missing----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.761s (+5.7% 🔺)3.777s (+6.7% 🔺)2.016s321.00x
▲ VercelExpress1.937s (+20.7% 🔺)3.551s (-2.4%)1.613s341.10x
▲ VercelNext.js (Turbopack)4.091s (-2.6%)6.049s (+5.6% 🔺)1.958s202.32x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.143s (~)1.966s (~)0.012s (+16.5% 🔺)2.020s (~)0.877s101.00x
🐘 PostgresNitro1.146s (-1.4%)2.000s (~)0.001s (~)2.010s (~)0.864s101.00x
💻 LocalExpress1.159s (~)2.004s (~)0.012s (+7.0% 🔺)2.019s (~)0.860s101.01x
💻 LocalNitro1.169s (+1.2%)2.004s (~)0.012s (+16.2% 🔺)2.020s (~)0.851s101.02x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.985s (+4.1%)3.879s (+31.0% 🔺)5.374s (+192.2% 🔺)9.873s (+89.1% 🔺)7.888s101.00x
▲ VercelExpress2.066s (+9.3% 🔺)3.591s (+10.9% 🔺)5.322s (+224.9% 🔺)9.327s (+74.5% 🔺)7.261s101.04x
▲ VercelNext.js (Turbopack)3.465s (+8.8% 🔺)4.780s (+36.6% 🔺)5.354s (+267.7% 🔺)11.157s (+73.3% 🔺)7.691s101.75x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.534s (-5.9% 🟢)2.008s (~)0.005s (-1.3%)2.030s (~)0.496s301.00x
💻 LocalNitro1.573s (-0.6%)2.011s (-1.4%)0.012s (-8.2% 🟢)2.027s (-1.5%)0.455s301.03x
💻 LocalExpress1.573s (~)2.010s (~)0.013s (+13.2% 🔺)2.026s (~)0.453s301.03x
💻 LocalNext.js (Turbopack)1.600s (~)1.968s (~)0.014s (+10.6% 🔺)2.027s (~)0.427s301.04x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.435s (-4.5%)7.415s (+12.5% 🔺)0.147s (-37.1% 🟢)8.036s (+8.4% 🔺)2.601s81.00x
▲ VercelExpress5.687s (+4.8%)6.935s (-1.7%)0.678s (+204.3% 🔺)8.051s (+3.5%)2.364s81.05x
▲ VercelNext.js (Turbopack)9.644s (+1.4%)11.332s (+7.5% 🔺)0.215s (-1.7%)12.096s (+4.7%)2.452s51.77x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.778s (-8.2% 🟢)1.064s (-5.2% 🟢)0.000s (+89.3% 🔺)1.079s (-5.5% 🟢)0.301s561.00x
💻 LocalNext.js (Turbopack)1.300s (-7.2% 🟢)1.976s (~)0.000s (-57.9% 🟢)2.016s (~)0.715s301.67x
💻 LocalNitro1.346s (~)1.982s (+1.7%)0.001s (+183.3% 🔺)1.984s (+1.7%)0.639s311.73x
💻 LocalExpress1.350s (~)1.950s (+1.6%)0.000s (+67.7% 🔺)1.953s (+1.6%)0.603s311.73x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.008s (-42.4% 🟢)4.355s (-34.2% 🟢)0.000s (-76.9% 🟢)4.758s (-33.4% 🟢)1.749s131.00x
▲ VercelNitro3.093s (-24.7% 🟢)4.668s (-11.1% 🟢)0.000s (+Infinity% 🔺)5.122s (-10.5% 🟢)2.030s121.03x
▲ VercelNext.js (Turbopack)4.968s (+10.4% 🔺)6.268s (+16.0% 🔺)0.000s (NaN%)7.270s (+17.8% 🔺)2.302s91.65x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.712s (-3.9%)2.255s (-6.7% 🟢)0.000s (NaN%)2.278s (-6.3% 🟢)0.567s271.00x
💻 LocalNitro3.180s (-1.9%)3.777s (-3.2%)0.001s (-10.0% 🟢)3.780s (-3.2%)0.600s161.86x
💻 LocalNext.js (Turbopack)3.266s (-5.6% 🟢)3.925s (-1.7%)0.001s (-44.9% 🟢)3.966s (-1.6%)0.700s161.91x
💻 LocalExpress3.414s (+2.8%)4.027s (+3.1%)0.001s (+326.7% 🔺)4.030s (+3.2%)0.617s151.99x
🐘 PostgresExpress⚠️missing-----
🐘 PostgresNext.js (Turbopack)⚠️missing-----

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.569s (+1.8%)5.815s (+2.1%)0.000s (NaN%)6.220s (+0.9%)1.651s101.00x
▲ VercelNitro4.599s (+5.7% 🔺)6.043s (+15.1% 🔺)0.001s (+Infinity% 🔺)6.514s (+15.0% 🔺)1.914s101.01x
▲ VercelNext.js (Turbopack)7.584s (+3.0%)8.287s (+6.2% 🔺)0.000s (NaN%)9.393s (+5.0% 🔺)1.810s71.66x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress10/21
🐘 PostgresNitro21/21
▲ VercelNitro13/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local17/21
Next.js (Turbopack)💻 Local19/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)
  • 🌐 Platformatic: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202301672
✅ 💻 Local Development147202001672
✅ 📦 Local Production160502191824
✅ 🐘 Local Postgres160502191824
✅ 🪟 Windows15200152
✅ 📋 Other88701771064
Total7163010458208

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125027
✅ example125027
✅ express125027
✅ fastify125027
✅ hono125027
✅ nextjs-turbopack14903
✅ nextjs-webpack14903
✅ nitro125027
✅ nuxt125027
✅ sveltekit14408
✅ vite125027
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable127025
✅ express-stable127025
✅ fastify-stable127025
✅ hono-stable127025
✅ nextjs-turbopack-canary133019
✅ nextjs-turbopack-stable15200
✅ nextjs-webpack-canary133019
✅ nextjs-webpack-stable15200
✅ nitro-stable127025
✅ nuxt-stable127025
✅ sveltekit-stable14606
✅ vite-stable127025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15200
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable127025
✅ e2e-local-dev-tanstack-start-127025
✅ e2e-local-postgres-nest-stable127025
✅ e2e-local-postgres-tanstack-start-127025
✅ e2e-local-prod-nest-stable127025
✅ e2e-local-prod-tanstack-start-127025
✅ e2e-vercel-prod-tanstack-start125027

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: failure
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

Review feedback on #2804: import() of a require-resolved CJS entry relies
on cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
karthikscale3 added a commit that referenced this pull request Jul 7, 2026
…#2804)
* web: construct worlds explicitly instead of via static-injection stub
Since #2752, createWorld() from @workflow/core/runtime is a stub that
throws unless a framework build plugin aliases it to a world package.
The CLI was migrated to construct worlds directly, but @workflow/web
still called the stub, so 'workflow web' crashed with 'Workflow target
world was not statically injected' for local and postgres backends
(the vercel path was unaffected since it constructs the world directly).
Mirror the CLI: import the local world statically and resolve any other
configured world package from the inspected project's directory.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
* web: fall back to default.createWorld for CJS world packages
Review feedback: import() of a require-resolved CJS entry relies on
cjs-module-lexer to surface named exports; fall back to
mod.default.createWorld when detection fails. Mirrored in the CLI in #2806.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
---------
Co-authored-by: Claude Fable 5 <noreply@anthropic.com>
@karthikscale3
karthikscale3 merged commit 54f46f9 into mainJul 7, 2026
109 of 113 checks passed
@karthikscale3
karthikscale3 deleted the karthik/cli-generic-world-backends branch July 7, 2026 22:48
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 54f46f9 (AI decision).

This commit fixes a regression introduced by #2752 (static world injection), which is a main-only change. On stable, setupCliWorld still uses the pre-#2752 dynamic createWorld() loader with no createPostgresCliWorld helper or "Unsupported workflow backend" throw, so community backends already work there and the bug being fixed does not exist.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

54f46f976da8d8d5a646bceab60cfab7f0ae47e9

VaguelySerious added a commit that referenced this pull request Jul 29, 2026
This reverts the static world-target injection and restores runtime
resolution of the world package from `WORKFLOW_TARGET_WORLD`.
Because 141 commits have landed on top of #2752, this is a surgical
revert rather than a mechanical one. Removed: the `world-target` modules
in core/builders/utils, the bundler aliases and `define`s wired through
next/nitro/nuxt/astro/sveltekit/rollup/nest, the
`@workflow/core/runtime/world-target` export, and the
pg-native/node-compat-banner helpers that only existed to support the
statically bundled world.
Kept (later work that builds on #2752):
- `createWorldFromModule` / `WorldFactoryModule` in core (used by
world-testing and the nitro dev handler)
- `world-init` / `world-init-stub` / `getWorldLazy` and their
registration of `getWorld` on globalThis, plus the #3001 isolated
route bundle regression test
- #2804 (web), #2806 (cli dynamic community backends), #3112 (world
factory alias removal), #2988 (nest vercel builder), #2925/#2908
(nitro), #2799 (sveltekit typescript stub is dropped with the
injection it existed for), next basePath support, and the windows /
canary test timeout tuning
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@karthikscale3@VaguelySerious