Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' [world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Universal Dark Mode - works on any site (function() { var enabled = true; function applyDarkMode() { if (!enabled) return; // Create style element if it doesn't exist var style = document.getElementById('universal-dark-mode-style'); if (!style) { style = document.createElement('style'); style.id = 'universal-dark-mode-style'; document.head.appendChild(style); } // Dark mode CSS - inverts colors but preserves images/video style.textContent = ' /* Invert everything except media */ html { filter: invert(1) hue-rotate(180deg) !important; background: #1a1a2e !important; } /* Restore images, videos, iframes, canvas */ img, video, iframe, canvas, svg, picture, [style*="background-image"] { filter: invert(1) hue-rotate(180deg) !important; } /* Preserve specific elements that should not be inverted */ .no-dark-mode, .no-dark-mode *, [data-theme="light"], [data-theme="light"], .ace_editor, .ace_editor *, .CodeMirror, .CodeMirror *, .monaco-editor, .monaco-editor *, .markdown-body pre, .markdown-body pre *, .highlight, .highlight *, pre code, pre code * { filter: none !important; } /* Fix common UI elements */ .modal, .popup, .dropdown-menu, .tooltip, .popover { filter: invert(1) hue-rotate(180deg) !important; background: #2d2d44 !important; border-color: #444 !important; } /* Scrollbars */ ::-webkit-scrollbar { background: #1a1a2e !important; } ::-webkit-scrollbar-thumb { background: #444 !important; } ::-webkit-scrollbar-thumb:hover { background: #555 !important; } /* Selection */ ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; } ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; } '; } function removeDarkMode() { var style = document.getElementById('universal-dark-mode-style'); if (style) style.remove(); } // Toggle with Alt+Shift+D document.addEventListener('keydown', function(e) { if (e.altKey && e.shiftKey && e.key === 'D') { e.preventDefault(); enabled = !enabled; if (enabled) { applyDarkMode(); console.log('[Universal Dark Mode] Enabled'); } else { removeDarkMode(); console.log('[Universal Dark Mode] Disabled'); } } }); // Apply on load applyDarkMode(); // Re-apply on dynamic content var observer = new MutationObserver(function(mutations) { if (enabled && !document.getElementById('universal-dark-mode-style')) { applyDarkMode(); } }); observer.observe(document.head, { childList: true }); console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle'); })(); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })(); [world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings by VaguelySerious · Pull Request #2415 · vercel/workflow · GitHub
Skip to content

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings - #2415

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs
Jun 17, 2026
Merged

[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings#2415
VaguelySerious merged 2 commits into
mainfrom
peter/v4-list-lazy-refs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

What

getWorkflowRunEvents applied resolveDataonly client-side: on the v4 wire it always downloaded the resolved payload bytes for every event (step inputs/outputs, run input/output, hook payloads, errors), then discarded them in buildEventFromV4 when resolveData was 'none'. Pure wasted bandwidth for metadata-only consumers — and v4 has no per-event /refs path to opt out of.

The v4 list endpoints already accept remoteRefBehavior (resolve|lazy, default resolve). This maps resolveData: 'none'remoteRefBehavior: 'lazy' and sends it on both the runId and correlationId list queries, so the backend emits empty-body frames and skips the per-event blob read entirely. resolveData: 'all' sends resolve (the default), unchanged.

This is the SDK half of the metadata-only-listing optimization; it pairs with the backend change that honors remoteRefBehavior=lazy on the v4 list/stream.

Why it's safe

  • No new wire concept: reuses the existing remoteRefBehavior param — the same one v2/v3 use, which resolveData has always mapped to.
  • Backward compatible with an older backend: one that predates the flag simply ignores it and streams full bodies; buildEventFromV4 still strips them for resolveData: 'none'. So correctness holds regardless of backend version — it's purely a bandwidth optimization that kicks in once the backend supports it.
  • The frame meta is unchanged in lazy mode (the event entity + payload ref descriptor still ride in the frame); only the resolved bytes are withheld.

Test plan

  • getWorkflowRunEvents({ resolveData: 'none' }) sends ?remoteRefBehavior=lazy and strips any body the backend still returns (events.test.ts)
  • Default (resolveData: 'all') sends ?remoteRefBehavior=resolve and splices the body bytes into eventData
  • Both runId and correlationId list query builders send the param (appendListParams)
  • world-vercel unit suite (148 tests) + typecheck clean

getWorkflowRunEvents applied resolveData only client-side: it always
downloaded the resolved payload bytes for every event, then discarded them
when resolveData was 'none'. The v4 list endpoints accept remoteRefBehavior
(resolve|lazy, default resolve), so map resolveData 'none' → lazy and send
it on the runId and correlationId list queries — the backend then emits
empty-body frames and skips the per-event blob read.
Safe against a backend that predates the flag: it ignores the param and
streams full bodies, and buildEventFromV4 still strips them for
resolveData 'none', so this is a pure bandwidth optimization either way.
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 14, 2026 11:24
@vercel

vercelBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 14, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: e6d0f6f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production144202191661
✅ 💻 Local Development189502192114
✅ 📦 Local Production189502192114
✅ 🐘 Local Postgres173102321963
✅ 🪟 Windows15100151
✅ 📋 Other87901781057
Total7993010679060

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro125026
✅ example125026
✅ express125026
✅ fastify125026
✅ hono125026
✅ nextjs-turbopack14902
✅ nextjs-webpack14902
✅ nitro125026
✅ nuxt125026
✅ sveltekit14407
✅ vite125026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable126025
✅ express-stable126025
✅ fastify-stable126025
✅ hono-stable126025
✅ nextjs-turbopack-canary132019
✅ nextjs-turbopack-stable-lazy-discovery-disabled15100
✅ nextjs-turbopack-stable-lazy-discovery-enabled15100
✅ nextjs-webpack-canary132019
✅ nextjs-webpack-stable-lazy-discovery-disabled15100
✅ nextjs-webpack-stable-lazy-discovery-enabled15100
✅ nitro-stable126025
✅ nuxt-stable126025
✅ sveltekit-stable14506
✅ vite-stable126025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable125026
✅ express-stable125026
✅ fastify-stable125026
✅ hono-stable125026
✅ nextjs-turbopack-canary131020
✅ nextjs-turbopack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-canary131020
✅ nextjs-webpack-stable-lazy-discovery-disabled15001
✅ nextjs-webpack-stable-lazy-discovery-enabled15001
✅ nitro-stable125026
✅ nuxt-stable125026
✅ sveltekit-stable14407
✅ vite-stable125026
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack15100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable126025
✅ e2e-local-dev-tanstack-start-126025
✅ e2e-local-postgres-nest-stable125026
✅ e2e-local-postgres-tanstack-start-125026
✅ e2e-local-prod-nest-stable126025
✅ e2e-local-prod-tanstack-start-126025
✅ e2e-vercel-prod-tanstack-start125026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: success
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 14, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.040s (-4.5%)1.006s (~)0.966s101.00x
💻 LocalExpress0.041s (-12.3% 🟢)1.006s (~)0.964s101.02x
🐘 PostgresExpress0.063s (+4.5%)1.013s (~)0.950s101.55x
💻 LocalNext.js (Turbopack)0.065s (+0.8%)1.006s (~)0.941s101.60x
🐘 PostgresNext.js (Turbopack)0.073s (+5.3% 🔺)1.012s (~)0.939s101.82x
🐘 PostgresNitro0.084s (+38.0% 🔺)1.026s (+1.3%)0.942s102.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.248s (-53.2% 🟢)2.339s (-13.8% 🟢)2.091s101.00x
▲ VercelNitro0.274s (-59.2% 🟢)2.149s (-31.9% 🟢)1.876s101.10x
▲ VercelNext.js (Turbopack)0.285s (-54.8% 🟢)2.370s (~)2.085s101.15x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.912s101.00x
💻 LocalExpress1.099s (~)2.006s (~)0.907s101.00x
🐘 PostgresExpress1.105s (-0.9%)2.010s (~)0.906s101.01x
💻 LocalNext.js (Turbopack)1.129s (~)2.007s (~)0.877s101.03x
🐘 PostgresNext.js (Turbopack)1.148s (+0.9%)2.011s (~)0.862s101.05x
🐘 PostgresNitro1.242s (+12.9% 🔺)2.073s (+3.1%)0.831s101.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.638s (-41.7% 🟢)3.794s (-19.0% 🟢)2.156s101.00x
▲ VercelExpress1.706s (-27.6% 🟢)3.941s (+3.5%)2.234s101.04x
▲ VercelNext.js (Turbopack)1.790s (-23.4% 🟢)3.994s (+2.2%)2.204s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.500s (~)11.022s (~)0.522s31.00x
🐘 PostgresExpress10.531s (-0.7%)11.021s (~)0.490s31.00x
💻 LocalExpress10.537s (~)11.023s (~)0.486s31.00x
💻 LocalNext.js (Turbopack)10.796s (-0.7%)11.023s (~)0.226s31.03x
🐘 PostgresNext.js (Turbopack)10.824s (-0.6%)11.019s (-2.9%)0.195s31.03x
🐘 PostgresNitro11.014s (+3.4%)11.348s (+3.0%)0.334s31.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express14.536s (-4.0%)16.766s (-2.3%)2.231s21.00x
▲ VercelNitro15.021s (-1.4%)17.452s (+1.9%)2.431s21.03x
▲ VercelNext.js (Turbopack)16.851s (+15.2% 🔺)18.571s (+13.1% 🔺)1.720s21.16x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.823s (~)14.028s (~)0.205s51.00x
💻 LocalNitro13.867s (+0.7%)14.227s (+1.4%)0.360s51.00x
🐘 PostgresExpress13.919s (-0.5%)14.017s (-1.4%)0.097s51.01x
🐘 PostgresNitro14.294s (+3.3%)14.618s (+4.3%)0.324s51.03x
💻 LocalNext.js (Turbopack)14.355s (-0.7%)15.029s (~)0.674s41.04x
🐘 PostgresNext.js (Turbopack)14.505s (~)15.020s (~)0.515s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro25.182s (+2.4%)26.910s (+1.0%)1.728s31.00x
▲ VercelExpress25.749s (+5.5% 🔺)27.605s (+4.6%)1.855s31.02x
▲ VercelNext.js (Turbopack)27.371s (+4.7%)29.432s (+6.2% 🔺)2.061s31.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express12.373s (-2.3%)13.025s (-1.1%)0.652s71.00x
💻 LocalNitro12.385s (~)13.024s (~)0.639s71.00x
🐘 PostgresExpress12.531s (-1.8%)13.020s (~)0.489s71.01x
🐘 PostgresNitro12.838s (+2.5%)13.159s (+1.1%)0.322s71.04x
💻 LocalNext.js (Turbopack)13.791s (~)14.027s (~)0.236s71.11x
🐘 PostgresNext.js (Turbopack)14.187s (+2.8%)14.590s (+3.1%)0.403s71.15x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.384s (-31.1% 🟢)36.387s (-30.2% 🟢)2.002s31.00x
▲ VercelExpress35.843s (-29.8% 🟢)37.984s (-29.3% 🟢)2.141s31.04x
▲ VercelNext.js (Turbopack)38.289s (-18.7% 🟢)40.639s (-16.6% 🟢)2.350s31.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.201s (-2.0%)2.008s (~)0.807s151.00x
💻 LocalNitro1.213s (+1.5%)2.007s (~)0.793s151.01x
💻 LocalExpress1.214s (-1.5%)2.006s (~)0.792s151.01x
🐘 PostgresNext.js (Turbopack)1.280s (~)2.007s (~)0.727s151.07x
💻 LocalNext.js (Turbopack)1.295s (-4.9%)2.006s (~)0.711s151.08x
🐘 PostgresNitro1.406s (+16.4% 🔺)2.106s (+4.9%)0.700s151.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.628s (-19.2% 🟢)4.088s (-18.5% 🟢)1.460s81.00x
▲ VercelExpress2.638s (-5.7% 🟢)4.049s (-4.3%)1.411s81.00x
▲ VercelNext.js (Turbopack)2.856s (+1.0%)4.582s (+5.0% 🔺)1.726s71.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.472s (+5.1% 🔺)2.508s (+1.5%)1.037s121.00x
🐘 PostgresNitro1.536s (+13.5% 🔺)2.323s (-10.4% 🟢)0.787s131.04x
🐘 PostgresNext.js (Turbopack)1.610s (+2.2%)2.511s (+8.4% 🔺)0.901s121.09x
💻 LocalExpress1.736s (-12.9% 🟢)2.006s (-12.5% 🟢)0.270s151.18x
💻 LocalNitro1.742s (~)2.006s (~)0.264s151.18x
💻 LocalNext.js (Turbopack)1.868s (-2.7%)2.222s (+10.7% 🔺)0.354s141.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.208s (-19.7% 🟢)5.088s (-12.2% 🟢)1.880s61.00x
▲ VercelNitro3.257s (-14.2% 🟢)5.023s (-11.4% 🟢)1.765s61.02x
▲ VercelNext.js (Turbopack)4.426s (-56.0% 🟢)6.432s (-44.7% 🟢)2.006s51.38x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.593s (~)3.769s (-8.9% 🟢)2.176s81.00x
🐘 PostgresNitro1.911s (+15.1% 🔺)3.568s (-8.2% 🟢)1.657s91.20x
🐘 PostgresNext.js (Turbopack)3.474s (-29.9% 🟢)4.266s (-25.0% 🟢)0.793s82.18x
💻 LocalExpress4.606s (-15.1% 🟢)5.012s (-16.7% 🟢)0.406s62.89x
💻 LocalNitro5.249s (+6.6% 🔺)5.681s (+3.0%)0.432s63.30x
💻 LocalNext.js (Turbopack)5.532s (-8.1% 🟢)6.016s (-6.2% 🟢)0.484s53.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.766s (+16.4% 🔺)6.506s (+7.7% 🔺)1.740s51.00x
▲ VercelNext.js (Turbopack)5.047s (-2.1%)7.205s (+11.6% 🔺)2.158s51.06x
▲ VercelExpress5.129s (+13.4% 🔺)7.533s (+17.5% 🔺)2.404s41.08x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.231s (+1.5%)2.008s (~)0.777s151.00x
🐘 PostgresNitro1.256s (+4.2%)2.007s (~)0.751s151.02x
🐘 PostgresNext.js (Turbopack)1.297s (+0.9%)2.007s (~)0.711s151.05x
💻 LocalNext.js (Turbopack)1.386s (-0.9%)2.006s (~)0.620s151.13x
💻 LocalExpress1.572s (-2.4%)2.007s (~)0.435s151.28x
💻 LocalNitro1.590s (+7.2% 🔺)2.006s (~)0.417s151.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.445s (-8.8% 🟢)4.670s (+5.6% 🔺)2.225s71.00x
▲ VercelNext.js (Turbopack)2.909s (+5.4% 🔺)4.744s (+7.9% 🔺)1.835s71.19x
▲ VercelNitro2.992s (+7.7% 🔺)4.822s (+6.0% 🔺)1.830s71.22x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.359s (-8.5% 🟢)2.226s (-18.7% 🟢)0.866s141.00x
🐘 PostgresExpress1.409s (-3.6%)2.152s (-10.1% 🟢)0.743s141.04x
🐘 PostgresNext.js (Turbopack)1.597s (+5.8% 🔺)2.393s (+15.4% 🔺)0.796s131.17x
💻 LocalExpress1.924s (-12.3% 🟢)2.392s (-12.6% 🟢)0.469s131.42x
💻 LocalNitro1.957s (-2.0%)2.393s (~)0.436s131.44x
💻 LocalNext.js (Turbopack)2.084s (~)2.917s (+3.1%)0.833s111.53x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.950s (-8.9% 🟢)4.839s (+3.0%)1.889s71.00x
▲ VercelExpress3.100s (-8.0% 🟢)4.788s (-7.9% 🟢)1.688s71.05x
▲ VercelNext.js (Turbopack)3.433s (+20.9% 🔺)5.274s (+27.1% 🔺)1.840s61.16x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.932s (+17.5% 🔺)3.762s (-3.2%)1.831s81.00x
🐘 PostgresNitro2.222s (+35.8% 🔺)3.760s (-11.8% 🟢)1.538s81.15x
🐘 PostgresNext.js (Turbopack)3.681s (+4.9%)4.873s (+9.7% 🔺)1.193s71.91x
💻 LocalNitro5.411s (-1.0%)5.849s (-5.9% 🟢)0.438s62.80x
💻 LocalExpress5.521s (-7.3% 🟢)5.850s (-8.8% 🟢)0.330s62.86x
💻 LocalNext.js (Turbopack)5.535s (-14.9% 🟢)6.219s (-11.4% 🟢)0.683s52.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.218s (-15.7% 🟢)6.089s (-8.6% 🟢)1.870s61.00x
▲ VercelExpress4.773s (+30.9% 🔺)6.919s (+30.9% 🔺)2.147s51.13x
▲ VercelNext.js (Turbopack)4.922s (+16.0% 🔺)6.682s (+19.8% 🔺)1.760s51.17x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.601s (-2.4%)1.059s (+3.4%)0.458s571.00x
💻 LocalExpress0.606s (-1.4%)1.005s (~)0.399s601.01x
💻 LocalNitro0.608s (-2.1%)1.022s (~)0.414s591.01x
🐘 PostgresNitro0.627s (+7.9% 🔺)1.046s (+2.3%)0.419s581.04x
🐘 PostgresNext.js (Turbopack)0.836s (+2.4%)1.006s (~)0.171s601.39x
💻 LocalNext.js (Turbopack)0.882s (-3.0%)1.039s (-1.8%)0.158s581.47x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.834s (+70.5% 🔺)8.814s (+59.2% 🔺)1.980s71.00x
▲ VercelExpress7.080s (+56.4% 🔺)8.696s (+38.8% 🔺)1.616s71.04x
▲ VercelNitro7.740s (+65.0% 🔺)9.712s (+51.4% 🔺)1.972s71.13x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.371s (-3.1%)2.052s (+2.2%)0.681s451.00x
💻 LocalExpress1.527s (-4.0%)2.006s (-1.1%)0.479s451.11x
💻 LocalNitro1.548s (+2.1%)2.028s (+1.1%)0.481s451.13x
🐘 PostgresNitro1.658s (+21.7% 🔺)2.238s (+11.4% 🔺)0.580s411.21x
🐘 PostgresNext.js (Turbopack)2.014s (-1.1%)2.258s (-14.4% 🟢)0.244s401.47x
💻 LocalNext.js (Turbopack)2.122s (-4.3%)3.008s (~)0.886s301.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro17.020s (+64.0% 🔺)19.190s (+54.7% 🔺)2.170s51.00x
▲ VercelExpress17.195s (+84.1% 🔺)19.260s (+71.8% 🔺)2.065s51.01x
▲ VercelNext.js (Turbopack)17.632s (+44.5% 🔺)19.831s (+45.3% 🔺)2.200s51.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.645s (-5.8% 🟢)3.058s (-3.4%)0.413s401.00x
🐘 PostgresNitro2.760s (-4.2%)3.253s (-0.8%)0.493s371.04x
💻 LocalNitro3.320s (+1.2%)4.010s (-0.8%)0.690s301.26x
💻 LocalExpress3.330s (+0.7%)4.010s (~)0.679s301.26x
🐘 PostgresNext.js (Turbopack)3.891s (-11.4% 🟢)4.076s (-20.1% 🟢)0.185s301.47x
💻 LocalNext.js (Turbopack)4.408s (-2.5%)5.010s (~)0.602s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro34.024s (+37.1% 🔺)37.171s (+40.3% 🔺)3.147s41.00x
▲ VercelExpress34.568s (+39.6% 🔺)37.586s (+40.5% 🔺)3.018s41.02x
▲ VercelNext.js (Turbopack)36.602s (+37.0% 🔺)39.365s (+38.7% 🔺)2.763s41.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.227s (-3.1%)1.006s (~)0.779s601.00x
🐘 PostgresNext.js (Turbopack)0.305s (-1.9%)1.006s (~)0.702s601.34x
🐘 PostgresNitro0.376s (+56.8% 🔺)1.041s (+3.4%)0.665s581.65x
💻 LocalExpress0.403s (-1.6%)1.004s (~)0.602s601.77x
💻 LocalNitro0.412s (+3.6%)1.004s (~)0.592s601.82x
💻 LocalNext.js (Turbopack)0.546s (-7.4% 🟢)1.005s (~)0.459s602.41x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.972s (+59.3% 🔺)3.842s (+37.2% 🔺)1.870s161.00x
▲ VercelExpress1.973s (+50.1% 🔺)4.034s (+45.6% 🔺)2.060s161.00x
▲ VercelNext.js (Turbopack)2.224s (+61.9% 🔺)4.123s (+12.2% 🔺)1.899s151.13x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.347s (+0.8%)1.017s (-2.3%)0.670s891.00x
🐘 PostgresNitro0.513s (+39.7% 🔺)1.092s (+6.1% 🔺)0.579s831.48x
🐘 PostgresNext.js (Turbopack)0.542s (-4.7%)1.174s (+7.5% 🔺)0.632s781.56x
💻 LocalNitro2.052s (-1.9%)2.610s (+1.1%)0.558s355.91x
💻 LocalExpress2.112s (-3.6%)2.609s (-1.8%)0.498s356.09x
💻 LocalNext.js (Turbopack)2.463s (-10.8% 🟢)3.149s (-7.9% 🟢)0.686s297.10x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.594s (+58.1% 🔺)5.505s (+34.5% 🔺)1.911s171.00x
▲ VercelNitro3.869s (+21.3% 🔺)5.770s (+6.2% 🔺)1.901s161.08x
▲ VercelNext.js (Turbopack)4.288s (+71.3% 🔺)6.425s (+53.7% 🔺)2.137s151.19x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.578s (+2.1%)1.161s (-7.7% 🟢)0.583s1041.00x
🐘 PostgresNitro0.628s (+7.8% 🔺)1.130s (-6.5% 🟢)0.502s1071.09x
🐘 PostgresNext.js (Turbopack)2.507s (-23.6% 🟢)3.543s (-24.2% 🟢)1.036s344.34x
💻 LocalNitro8.967s (-1.6%)9.644s (~)0.677s1315.51x
💻 LocalExpress9.488s (-0.9%)9.951s (-2.4%)0.463s1316.41x
💻 LocalNext.js (Turbopack)10.662s (-1.8%)11.756s (-0.8%)1.095s1118.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.591s (+89.9% 🔺)8.947s (+76.5% 🔺)2.356s141.00x
▲ VercelNitro6.709s (+21.9% 🔺)8.975s (+24.6% 🔺)2.267s141.02x
▲ VercelNext.js (Turbopack)7.293s (+7.5% 🔺)9.510s (+13.7% 🔺)2.218s131.11x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.162s (~)2.004s (~)0.010s (-7.2% 🟢)2.017s (~)0.855s101.00x
💻 LocalExpress1.163s (-2.4%)2.005s (~)0.010s (-15.7% 🟢)2.018s (~)0.854s101.00x
🐘 PostgresExpress1.165s (-0.9%)2.000s (~)0.001s (-16.7% 🟢)2.010s (~)0.845s101.00x
💻 LocalNext.js (Turbopack)1.213s (-0.9%)2.004s (~)0.012s (-8.1% 🟢)2.020s (~)0.807s101.04x
🐘 PostgresNitro1.233s (+6.1% 🔺)1.998s (~)0.010s (+930.0% 🔺)2.018s (~)0.785s101.06x
🐘 PostgresNext.js (Turbopack)1.242s (+1.1%)2.001s (~)0.002s (+25.0% 🔺)2.011s (~)0.769s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.479s (+4.9%)3.957s (+20.8% 🔺)0.637s (-37.2% 🟢)5.079s (+8.1% 🔺)2.600s101.00x
▲ VercelExpress2.616s (+2.6%)3.802s (+8.3% 🔺)0.712s (-27.6% 🟢)5.014s (+1.2%)2.398s101.06x
▲ VercelNitro2.830s (+14.6% 🔺)3.824s (+8.4% 🔺)0.932s (+16.5% 🔺)5.215s (+7.8% 🔺)2.385s101.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.580s (~)2.010s (~)0.013s (-2.1%)2.025s (~)0.445s301.00x
💻 LocalExpress1.582s (-1.2%)2.010s (~)0.014s (+6.7% 🔺)2.026s (~)0.445s301.00x
🐘 PostgresExpress1.587s (-2.8%)2.003s (~)0.005s (+12.2% 🔺)2.027s (~)0.440s301.00x
💻 LocalNext.js (Turbopack)1.753s (+1.1%)2.009s (~)0.013s (+4.8%)2.025s (~)0.272s301.11x
🐘 PostgresNext.js (Turbopack)1.784s (-16.0% 🟢)2.011s (-33.2% 🟢)0.005s (-11.3% 🟢)2.027s (-33.2% 🟢)0.243s301.13x
🐘 PostgresNitro1.899s (+16.8% 🔺)2.348s (+17.2% 🔺)0.004s (-21.2% 🟢)2.371s (+17.0% 🔺)0.472s261.20x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)6.679s (+12.1% 🔺)8.260s (+13.0% 🔺)0.294s (+15.4% 🔺)9.023s (+11.9% 🔺)2.344s71.00x
▲ VercelNitro6.725s (+10.1% 🔺)8.551s (+13.8% 🔺)0.273s (+47.1% 🔺)9.306s (+13.8% 🔺)2.581s71.01x
▲ VercelExpress7.362s (+18.9% 🔺)9.103s (+20.2% 🔺)0.291s (+4.7%)9.932s (+19.5% 🔺)2.569s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.778s (~)1.047s (-5.7% 🟢)0.000s (+Infinity% 🔺)1.061s (-5.2% 🟢)0.283s571.00x
🐘 PostgresNitro0.995s (+26.5% 🔺)1.388s (+28.2% 🔺)0.000s (-48.8% 🟢)1.408s (+27.2% 🔺)0.413s431.28x
🐘 PostgresNext.js (Turbopack)1.060s (-18.1% 🟢)1.535s (-22.1% 🟢)0.000s (-20.5% 🟢)1.553s (-21.6% 🟢)0.493s391.36x
💻 LocalNitro1.405s (+1.9%)2.014s (~)0.000s (+100.0% 🔺)2.016s (~)0.611s301.81x
💻 LocalExpress1.418s (+1.5%)2.014s (~)0.000s (+100.0% 🔺)2.017s (~)0.598s301.82x
💻 LocalNext.js (Turbopack)1.491s (-0.6%)2.013s (~)0.001s (-28.6% 🟢)2.017s (~)0.525s301.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.011s (+8.7% 🔺)4.484s (+5.6% 🔺)0.000s (+116.7% 🔺)5.004s (+5.3% 🔺)1.993s121.00x
▲ VercelExpress3.196s (+13.7% 🔺)4.718s (+10.7% 🔺)0.000s (+Infinity% 🔺)5.266s (+9.3% 🔺)2.070s121.06x
▲ VercelNext.js (Turbopack)3.281s (+14.7% 🔺)4.688s (+9.7% 🔺)0.000s (-100.0% 🟢)5.209s (+9.4% 🔺)1.927s121.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.531s (-6.0% 🟢)2.063s (-5.3% 🟢)0.000s (+Infinity% 🔺)2.088s (-4.5%)0.557s291.00x
🐘 PostgresNext.js (Turbopack)2.185s (-23.9% 🟢)2.653s (-20.5% 🟢)0.000s (-100.0% 🟢)2.662s (-21.3% 🟢)0.477s231.43x
🐘 PostgresNitro2.660s (+68.7% 🔺)3.147s (+47.4% 🔺)0.000s (-30.0% 🟢)3.179s (+47.1% 🔺)0.520s201.74x
💻 LocalNext.js (Turbopack)2.974s (+5.8% 🔺)3.555s (+4.2%)0.001s (+100.0% 🔺)3.559s (+4.2%)0.585s171.94x
💻 LocalExpress3.026s (-4.2%)3.732s (-4.0%)0.001s (+323.5% 🔺)3.735s (-4.4%)0.709s171.98x
💻 LocalNitro3.179s (+1.2%)4.028s (~)0.001s (-7.7% 🟢)4.031s (~)0.852s152.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)4.345s (-0.9%)5.824s (+4.6%)0.000s (-100.0% 🟢)6.302s (+4.1%)1.957s101.00x
▲ VercelExpress4.467s (-1.0%)6.005s (+2.0%)0.000s (-100.0% 🟢)6.539s (+1.4%)2.072s101.03x
▲ VercelNitro4.969s (-14.8% 🟢)6.508s (-14.3% 🟢)0.000s (NaN%)6.981s (-14.7% 🟢)2.012s91.14x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro11/21
🐘 PostgresExpress20/21
▲ VercelNitro11/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres15/21
Next.js (Turbopack)🐘 Postgres14/21
Nitro🐘 Postgres11/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Approving. Reviewed for blockers/regressions — none found. Small, well-scoped bandwidth optimization; 11/11 tests pass and typecheck is clean. Verification notes posted inline.

cursor: pagination?.cursor ?? undefined,
limit: pagination?.limit,
sortOrder: pagination?.sortOrder,
remoteRefBehavior: (resolveData === 'none' ? 'lazy' : 'resolve') as

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified this mapping is exhaustive — ResolveData is typed 'none' | 'all' (packages/world/src/shared.ts:48), so the binary 'none' ? 'lazy' : 'resolve' covers every case with no silent fallthrough. The as 'lazy' | 'resolve' cast is harmless. Note: default ('all') listings now always send remoteRefBehavior=resolve where they previously sent no param — a behavioral no-op since resolve is the backend default.

// full bodies regardless; buildEventFromV4 still strips them when
// resolveData is 'none', so this is purely a bandwidth optimization and is
// safe against an older backend.
const wirePagination = {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified backward-compatibility with an older backend. buildEventFromV4 (line 438) still strips eventData whenever resolveData === 'none', regardless of whether the body arrived — so correctness holds even if the backend ignores lazy and streams full bodies. The new test deliberately simulates this (sends lazy AND asserts a still-present body is stripped).

* Shared by the runId and correlationId list query builders so both send
* `remoteRefBehavior` identically.
*/
function appendListParams(sp: URLSearchParams, params: ListEventsV4Params) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ai: Verified both list paths send the param identically — appendListParams is now called by both paginationToQuery (runId path) and getEventsByCorrelationIdV4. This refactor also removes the pre-existing duplication of cursor/limit/sortOrder in the correlationId builder, eliminating drift. remoteRefBehavior is optional and only set by getWorkflowRunEvents, so no other V4 callers are affected.

Comment thread.changeset/v4-lazy-list-refs.md Outdated
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

No backport to stable for 6aa1ce0 (AI decision).

This commit modifies the v4 event-listing wire path (events-v4.ts, buildEventFromV4, frame-stream listing), which does not exist on stable — both packages/world-vercel/src/events-v4.ts and the test file are main-only, and stable's getWorkflowRunEvents is an entirely different v2/v3 implementation that already always sends remoteRefBehavior=lazy and hydrates refs client-side. The change builds exclusively on main-only v4 behavior, so it does not apply to stable.

To override, re-run the Backport to stable workflow manually via workflow_dispatch and paste this commit SHA into the ref input:

6aa1ce0054d0af80c25bb47b7d6d726320f0e5b4

@github-actionsgithub-actionsBot mentioned this pull request Jun 17, 2026
pranaygp added a commit that referenced this pull request Jun 18, 2026
…-hydration
* origin/main:
perf(core): lazy inline step start (save one world round-trip per step) (#2478)
perf(core): skip per-step events.list via inline event-log delta (#2475)
Version Packages (beta) (#2491)
[world-vercel] Honor hasMore flag from v4 list pagination endpoint (#2486)
Version Packages (beta) (#2451)
Fix Next workflow module specifier root (#2455)
[world-vercel] Send remoteRefBehavior=lazy on v4 metadata-only event listings (#2415)
[swc-plugin] Fix eager discovery for object property steps (#2484)
fix(web-shared): align attributes panel styling (#2483)
[web-shared] Auto-scroll trace viewer on J/K span navigation (#2366)
fix(web): render restarted step segment as solid gray, not running stripes (#2480)
fix(web-shared): use solid gray for queued trace segment (#2474)
Add trace viewer span markers for hooks and attributes (#2452)
test: support Vercel protection bypass secret in e2e headers (#2458)
fix(core): bump payload-compression cutoff to 5.0.0-beta.18 (#2470)
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
# Conflicts:
#	packages/core/src/runtime.ts
VaguelySerious added a commit that referenced this pull request Jun 22, 2026
… + lazy metadata-only listings (#2414)
Co-authored-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@karthikscale3