Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
[world-vercel] Retry transient response-body parse failures in the HTTP client by VaguelySerious · Pull Request #2204 · vercel/workflow · GitHub
Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Retry transient response-body parse failures in the HTTP client by VaguelySerious · Pull Request #2204 · vercel/workflow · GitHub
Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Retry transient response-body parse failures in the HTTP client by VaguelySerious · Pull Request #2204 · vercel/workflow · GitHub
Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' [world-vercel] Retry transient response-body parse failures in the HTTP client by VaguelySerious · Pull Request #2204 · vercel/workflow · GitHub
Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Retry transient response-body parse failures in the HTTP client by VaguelySerious · Pull Request #2204 · vercel/workflow · GitHub
Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); })(); [world-vercel] Retry transient response-body parse failures in the HTTP client by VaguelySerious · Pull Request #2204 · vercel/workflow · GitHub
Skip to content

[world-vercel] Retry transient response-body parse failures in the HTTP client - #2204

Merged
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures
Jun 1, 2026
Merged

[world-vercel] Retry transient response-body parse failures in the HTTP client#2204
pranaygp merged 3 commits into
mainfrom
peter/world-vercel-retry-parse-failures

Conversation

@VaguelySerious

@VaguelySeriousVaguelySerious commented Jun 1, 2026

Copy link
Copy Markdown
Member

Problem

A sporadic failure reading or decoding a successful (2xx) response body - for example, a truncated or terminated stream, a connection reset mid-body, or a gateway returning a non-CBOR/JSON body - surfaces as a PARSE_ERROR.

The shared RetryAgent in http-client.ts retries connection and 5xx failures, but body consumption happens after it has handed back the response, so transient response-body failures do not reach that retry logic.

Approach

@workflow/world-vercel now retries response-body read/decode failures directly in makeRequest with bounded exponential backoff:

  • MAX_BODY_PARSE_RETRIES = 2
  • BODY_PARSE_RETRY_BASE_MS = 100
  • retries are limited to idempotent requests (GET/HEAD)

This covers the reported events.list failure path while avoiding retries for writes that may already have been applied. Schema-validation failures remain non-retryable because retrying the same decoded payload would not make it valid.

If an idempotent request continues to fail after the retry budget is exhausted, or if a non-idempotent request encounters a body-parse failure, makeRequest continues to surface a PARSE_ERROR.

Tests

  • packages/world-vercel/src/utils.test.ts: a GET retries a transient body-read failure and then succeeds.
  • packages/world-vercel/src/utils.test.ts: a GET exhausts the retry budget and throws PARSE_ERROR.
  • packages/world-vercel/src/utils.test.ts: a POST body-parse failure is not retried.

…e HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 1, 2026 19:18
@vercel

vercelBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

changeset-botBot commented Jun 1, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 1706a5e

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelPatch
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production126602191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7183010528235

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro109026
✅ example109026
✅ express109026
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run

@github-actions

github-actionsBot commented Jun 1, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.7% 🟢)1.004s (~)0.973s101.00x
💻 LocalNitro0.041s (-4.4%)1.006s (~)0.965s101.30x
🐘 PostgresExpress0.061s (+4.5%)1.013s (~)0.953s101.92x
💻 LocalNext.js (Turbopack)0.061s1.006s0.945s101.92x
🐘 PostgresNitro0.061s (-36.1% 🟢)1.012s (-3.0%)0.951s101.92x
🐘 PostgresNext.js (Turbopack)0.073s1.012s0.939s102.30x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.322s (+36.7% 🔺)2.162s (+1.2%)1.840s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.080s (-4.0%)2.005s (~)0.925s101.00x
💻 LocalNitro1.093s (-3.4%)2.007s (~)0.914s101.01x
🐘 PostgresNitro1.109s (-2.7%)2.012s (~)0.903s101.03x
🐘 PostgresExpress1.110s (-3.2%)2.010s (~)0.900s101.03x
💻 LocalNext.js (Turbopack)1.125s2.006s0.881s101.04x
🐘 PostgresNext.js (Turbopack)1.150s2.011s0.861s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express1.625s (-13.3% 🟢)3.269s (-14.1% 🟢)1.644s101.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express10.422s (-4.6%)11.020s (~)0.598s31.00x
🐘 PostgresNitro10.516s (-3.3%)11.019s (~)0.503s31.01x
🐘 PostgresExpress10.522s (-4.0%)11.020s (~)0.498s31.01x
💻 LocalNitro10.533s (-3.8%)11.022s (~)0.489s31.01x
💻 LocalNext.js (Turbopack)10.782s11.022s0.240s31.03x
🐘 PostgresNext.js (Turbopack)11.017s11.351s0.334s31.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express13.921s (-18.0% 🟢)15.589s (-22.1% 🟢)1.668s21.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.499s (-9.8% 🟢)14.026s (-6.7% 🟢)0.527s51.00x
🐘 PostgresNitro13.724s (-6.0% 🟢)14.020s (-6.7% 🟢)0.296s51.02x
💻 LocalNitro13.726s (-8.9% 🟢)14.026s (-12.5% 🟢)0.300s51.02x
🐘 PostgresExpress13.759s (-5.7% 🟢)14.022s (-6.7% 🟢)0.263s51.02x
💻 LocalNext.js (Turbopack)14.266s15.030s0.764s41.06x
🐘 PostgresNext.js (Turbopack)14.520s15.023s0.502s41.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express23.725s (-52.8% 🟢)25.550s (-51.4% 🟢)1.825s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express11.936s (-28.1% 🟢)12.146s (-28.7% 🟢)0.210s81.00x
💻 LocalNitro12.404s (-26.1% 🟢)13.024s (-23.5% 🟢)0.619s71.04x
🐘 PostgresNitro12.423s (-11.1% 🟢)13.015s (-9.0% 🟢)0.592s71.04x
🐘 PostgresExpress12.455s (-11.1% 🟢)13.018s (-10.8% 🟢)0.563s71.04x
💻 LocalNext.js (Turbopack)13.624s14.027s0.403s71.14x
🐘 PostgresNext.js (Turbopack)14.026s14.450s0.423s71.18x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express32.073s (-73.5% 🟢)33.644s (-72.8% 🟢)1.571s31.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.175s (-6.8% 🟢)2.008s (~)0.833s151.00x
🐘 PostgresNitro1.190s (-6.7% 🟢)2.008s (~)0.818s151.01x
💻 LocalExpress1.239s (-16.8% 🟢)2.006s (~)0.767s151.05x
💻 LocalNitro1.261s (-22.7% 🟢)2.007s (-3.3%)0.745s151.07x
🐘 PostgresNext.js (Turbopack)1.265s2.009s0.743s151.08x
💻 LocalNext.js (Turbopack)1.334s2.006s0.671s151.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.085s (+7.9% 🔺)4.749s (+2.7%)1.664s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.261s (-46.4% 🟢)2.007s (-33.3% 🟢)0.746s151.00x
🐘 PostgresExpress1.277s (-45.9% 🟢)2.007s (-33.3% 🟢)0.729s151.01x
🐘 PostgresNext.js (Turbopack)1.416s2.007s0.591s151.12x
💻 LocalExpress1.611s (-45.4% 🟢)2.005s (-42.0% 🟢)0.394s151.28x
💻 LocalNext.js (Turbopack)1.715s2.075s0.360s151.36x
💻 LocalNitro1.827s (-41.9% 🟢)2.074s (-46.6% 🟢)0.247s151.45x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.533s (-2.4%)5.137s (+0.5%)1.605s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.395s (-59.9% 🟢)2.008s (-49.9% 🟢)0.613s151.00x
🐘 PostgresExpress1.440s (-58.7% 🟢)2.008s (-49.9% 🟢)0.568s151.03x
🐘 PostgresNext.js (Turbopack)1.750s2.395s0.645s131.25x
💻 LocalExpress3.884s (-53.4% 🟢)4.585s (-49.2% 🟢)0.700s72.78x
💻 LocalNext.js (Turbopack)4.471s5.180s0.709s63.21x
💻 LocalNitro5.170s (-38.1% 🟢)5.678s (-37.1% 🟢)0.508s63.71x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express5.264s (+24.2% 🔺)6.754s (+10.2% 🔺)1.490s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.179s (-6.2% 🟢)2.009s (~)0.830s151.00x
🐘 PostgresExpress1.199s (-4.7%)2.009s (~)0.810s151.02x
🐘 PostgresNext.js (Turbopack)1.277s2.009s0.732s151.08x
💻 LocalNext.js (Turbopack)1.379s2.006s0.627s151.17x
💻 LocalExpress1.420s (-25.0% 🟢)2.005s (-15.2% 🟢)0.584s151.20x
💻 LocalNitro1.605s (-13.9% 🟢)2.007s (-14.3% 🟢)0.401s151.36x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.809s (+8.8% 🔺)4.384s (+0.8%)1.576s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.241s (-47.0% 🟢)2.008s (-33.3% 🟢)0.768s151.00x
🐘 PostgresExpress1.244s (-46.9% 🟢)2.008s (-33.3% 🟢)0.764s151.00x
🐘 PostgresNext.js (Turbopack)1.454s2.076s0.622s151.17x
💻 LocalExpress1.603s (-48.8% 🟢)2.005s (-46.7% 🟢)0.402s151.29x
💻 LocalNext.js (Turbopack)1.948s2.392s0.444s131.57x
💻 LocalNitro2.066s (-32.6% 🟢)2.507s (-35.5% 🟢)0.441s121.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.027s (+26.2% 🔺)5.316s (+10.9% 🔺)1.288s61.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.373s (-60.8% 🟢)2.008s (-49.9% 🟢)0.635s151.00x
🐘 PostgresNitro1.381s (-60.3% 🟢)2.008s (-49.9% 🟢)0.627s151.01x
🐘 PostgresNext.js (Turbopack)1.763s2.741s0.978s111.28x
💻 LocalExpress4.181s (-52.5% 🟢)4.727s (-49.0% 🟢)0.546s73.05x
💻 LocalNext.js (Turbopack)5.429s6.019s0.590s53.95x
💻 LocalNitro6.071s (-33.6% 🟢)6.416s (-36.0% 🟢)0.344s54.42x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.699s (+4.4%)8.283s (+1.3%)1.584s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.506s (-48.5% 🟢)1.003s (-6.7% 🟢)0.497s601.00x
🐘 PostgresExpress0.550s (-34.4% 🟢)1.007s (-1.6%)0.456s601.09x
🐘 PostgresNitro0.560s (-31.7% 🟢)1.007s (~)0.447s601.11x
💻 LocalNitro0.593s (-39.5% 🟢)1.005s (-8.2% 🟢)0.411s601.17x
💻 LocalNext.js (Turbopack)0.848s1.004s0.156s601.67x
🐘 PostgresNext.js (Turbopack)0.881s1.079s0.198s561.74x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.235s (-67.2% 🟢)7.880s (-63.1% 🟢)1.645s81.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.278s (-57.6% 🟢)2.005s (-44.1% 🟢)0.727s451.00x
🐘 PostgresNitro1.304s (-32.3% 🟢)2.008s (-4.4%)0.704s451.02x
🐘 PostgresExpress1.371s (-30.6% 🟢)2.007s (-11.1% 🟢)0.636s451.07x
💻 LocalNitro1.526s (-49.7% 🟢)2.029s (-46.0% 🟢)0.503s451.19x
💻 LocalNext.js (Turbopack)2.079s2.911s0.832s311.63x
🐘 PostgresNext.js (Turbopack)2.177s3.010s0.832s301.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express17.143s (-50.4% 🟢)19.252s (-47.7% 🟢)2.109s51.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.639s (-35.7% 🟢)3.059s (-33.6% 🟢)0.420s401.00x
🐘 PostgresExpress2.671s (-33.1% 🟢)3.111s (-28.8% 🟢)0.440s391.01x
💻 LocalExpress2.802s (-69.6% 🟢)3.164s (-68.4% 🟢)0.363s381.06x
💻 LocalNitro3.210s (-65.5% 🟢)4.010s (-60.0% 🟢)0.800s301.22x
💻 LocalNext.js (Turbopack)4.329s5.011s0.682s241.64x
🐘 PostgresNext.js (Turbopack)4.382s5.014s0.632s241.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express29.653s (-77.2% 🟢)31.923s (-75.8% 🟢)2.270s41.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.209s (-26.3% 🟢)1.006s (~)0.797s601.00x
🐘 PostgresExpress0.228s (-19.4% 🟢)1.007s (~)0.779s601.09x
🐘 PostgresNext.js (Turbopack)0.312s1.008s0.696s601.49x
💻 LocalNitro0.436s (-28.0% 🟢)1.004s (-1.7%)0.569s602.09x
💻 LocalExpress0.471s (-15.9% 🟢)1.095s (+9.1% 🔺)0.624s552.26x
💻 LocalNext.js (Turbopack)0.579s1.004s0.426s602.77x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.863s (+46.5% 🔺)4.420s (+21.5% 🔺)1.557s141.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.331s (-33.3% 🟢)1.007s (~)0.676s901.00x
🐘 PostgresExpress0.360s (-29.5% 🟢)1.007s (~)0.647s901.09x
🐘 PostgresNext.js (Turbopack)0.547s1.008s0.461s901.65x
💻 LocalExpress1.933s (-23.1% 🟢)2.403s (-20.1% 🟢)0.470s385.84x
💻 LocalNitro2.152s (-15.2% 🟢)2.767s (-8.1% 🟢)0.615s336.50x
💻 LocalNext.js (Turbopack)2.281s3.043s0.762s306.89x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express4.764s (+56.4% 🔺)6.210s (+29.2% 🔺)1.447s151.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.659s (-16.6% 🟢)1.007s (~)0.348s1201.00x
🐘 PostgresExpress0.677s (-17.3% 🟢)1.007s (-1.1%)0.330s1201.03x
🐘 PostgresNext.js (Turbopack)1.073s2.010s0.937s601.63x
💻 LocalExpress8.007s (-28.4% 🟢)8.666s (-27.4% 🟢)0.659s1412.15x
💻 LocalNitro9.707s (-13.3% 🟢)10.358s (-11.2% 🟢)0.651s1214.73x
💻 LocalNext.js (Turbopack)10.108s10.944s0.835s1215.34x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express15.625s (+110.6% 🔺)17.296s (+87.1% 🔺)1.671s71.00x
▲ VercelNext.js (Turbopack)⚠️missing----
▲ VercelNitro⚠️missing----

🔍 Observability: Express

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.130s (+467.4% 🔺)2.004s (+99.5% 🔺)0.008s (-30.6% 🟢)2.015s (+97.9% 🔺)0.885s101.00x
🐘 PostgresNitro1.153s (+462.7% 🔺)1.999s (+100.0% 🔺)0.001s (-26.7% 🟢)2.010s (+98.8% 🔺)0.857s101.02x
💻 LocalNitro1.164s (+444.5% 🔺)2.005s (+99.6% 🔺)0.013s (+2.4%)2.020s (+98.2% 🔺)0.856s101.03x
🐘 PostgresExpress1.169s (+469.7% 🔺)2.001s (+100.3% 🔺)0.001s (-37.5% 🟢)2.010s (+98.8% 🔺)0.842s101.03x
💻 LocalNext.js (Turbopack)1.204s2.003s0.010s2.017s0.813s101.07x
🐘 PostgresNext.js (Turbopack)1.248s2.002s0.001s2.011s0.763s101.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.412s (-3.7%)3.357s (-17.9% 🟢)2.045s (+112.9% 🔺)5.866s (+4.9%)3.454s101.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express1.470s (+94.2% 🔺)2.008s (+95.1% 🔺)0.009s (-6.2% 🟢)2.018s (+94.1% 🔺)0.548s301.00x
🐘 PostgresNitro1.573s (+152.0% 🔺)2.003s (+99.0% 🔺)0.004s (-4.9%)2.025s (+98.0% 🔺)0.452s301.07x
🐘 PostgresExpress1.575s (+150.1% 🔺)2.008s (+99.5% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.450s301.07x
💻 LocalNitro1.586s (+89.1% 🔺)2.010s (+98.6% 🔺)0.010s (+5.3% 🔺)2.021s (+81.1% 🔺)0.435s301.08x
💻 LocalNext.js (Turbopack)1.723s2.008s0.010s2.021s0.297s301.17x
🐘 PostgresNext.js (Turbopack)1.853s2.010s0.004s2.027s0.174s301.26x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express6.162s (-5.3% 🟢)7.400s (-7.6% 🟢)0.324s (-20.8% 🟢)8.249s (-6.6% 🟢)2.087s81.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express0.711s (-26.0% 🟢)1.050s (-17.8% 🟢)0.000s (+61.4% 🔺)1.060s (-18.9% 🟢)0.349s571.00x
🐘 PostgresNitro0.712s (-26.5% 🟢)1.032s (-17.3% 🟢)0.000s (-100.0% 🟢)1.053s (-16.3% 🟢)0.341s571.00x
🐘 PostgresNext.js (Turbopack)0.919s1.220s0.000s1.236s0.317s501.29x
💻 LocalExpress1.165s (-4.9%)1.886s (-6.7% 🟢)0.000s (-34.4% 🟢)1.888s (-6.7% 🟢)0.722s321.64x
💻 LocalNitro1.460s (+19.4% 🔺)2.013s (~)0.000s (+266.7% 🔺)2.016s (~)0.555s302.05x
💻 LocalNext.js (Turbopack)1.484s2.012s0.000s2.016s0.532s302.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express3.904s (+4.4%)5.353s (+4.9%)0.010s (+5300.0% 🔺)5.807s (+5.0% 🔺)1.903s111.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.410s (-21.3% 🟢)2.177s (+1.7%)0.000s (-100.0% 🟢)2.195s (+1.0%)0.785s281.00x
🐘 PostgresExpress1.412s (-20.3% 🟢)2.066s (-5.1% 🟢)0.000s (+Infinity% 🔺)2.111s (-4.0%)0.699s291.00x
🐘 PostgresNext.js (Turbopack)1.928s2.503s0.000s2.511s0.584s241.37x
💻 LocalExpress2.337s (-32.6% 🟢)2.838s (-29.6% 🟢)0.001s (-26.1% 🟢)2.843s (-29.6% 🟢)0.505s221.66x
💻 LocalNext.js (Turbopack)2.887s3.469s0.000s3.473s0.585s182.05x
💻 LocalNitro3.439s (+1.5%)4.027s (~)0.001s (+62.5% 🔺)4.030s (~)0.591s152.44x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express49.701s (+983.4% 🔺)50.862s (+744.6% 🔺)0.000s (NaN%)51.309s (+694.6% 🔺)1.608s71.00x
▲ VercelNext.js (Turbopack)⚠️missing-----
▲ VercelNitro⚠️missing-----

🔍 Observability: Express

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalExpress19/21
🐘 PostgresNitro16/21
▲ VercelExpress21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres12/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres18/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

@pranaygppranaygp left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed the current adapter-only diff at 1706a5e61: response-body retries are bounded to idempotent GET/HEAD requests, POST writes are covered as non-retryable, and the PR description now matches the remaining scope. Required checks are green. The non-required Benchmark Vercel (nextjs-turbopack) stream-correctness failure should still be rerun or explicitly accepted before merge.

@pranaygp
pranaygp merged commit 7994629 into mainJun 1, 2026
182 of 192 checks passed
@pranaygp
pranaygp deleted the peter/world-vercel-retry-parse-failures branch June 1, 2026 20:49
@github-actionsgithub-actionsBot mentioned this pull request Jun 1, 2026
github-actionsBot added a commit that referenced this pull request Jun 1, 2026
…TP client (#2204)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2207. Merge conflicts were resolved by AI — please review carefully. (backport job run)

pranaygp added a commit that referenced this pull request Jun 2, 2026
* origin/main:
[world-vercel] Retry transient response-body parse failures in the HTTP client (#2204)
Add virtualization to the trace viewer (#2205)
Trace viewer: scroll-load events past an auto-load cap (#2200)
fix(core): resolve forwarded stream keys across deployments (#2191)
[e2e] Improve error labeling in event-log-race-repro CI job (#2190)
[core] Harden event pagination response parsing (#2180) (#2179)
Add loading skeleton to the new trace viewer (#2164)
Add tooltip components + apply on up/down detail pane (#2163)
fix(swc-plugin): allow wasm host imports during link (#2174)
[test] Forward-port reused-sleep replay divergence test (#2172)
[e2e] Add `event-log-race-repro` label for triggering CI stress-test (#2159)
Version Packages (beta) (#2162)
fix(world-local): skip Nov 2025 ghost versions on npm (#2168)
fix(core,errors): classify SDK encryption failures as RUNTIME_ERROR (#2145)
[web-shared][web] Fix events tab search (#2107)
Version Packages (beta) (#2147)
Allow setting workflow attributes from steps (#2157)
Better search handling on the trace viewer (#2144)
[docs] Document experimental attributes feature (#2141)
pranaygp pushed a commit that referenced this pull request Jun 2, 2026
…TP client (#2204) (#2207)
* fix(world-vercel): retry transient response-body parse failures in the HTTP client
A sporadic failure reading/decoding a 2xx response body (truncated or
terminated stream, connection reset mid-body, or a gateway returning a
non-CBOR/JSON body) was surfaced immediately as a PARSE_ERROR. The
shared RetryAgent only retries connection/5xx failures — body
consumption happens after it returns the response, so these escape its
retry logic.
Retry such failures inside `makeRequest` with bounded exponential
backoff, scoped to idempotent methods (GET/HEAD) so writes are never
replayed. This fixes the reported `events.list` parse failure at the
adapter layer.
* fix(core): propagate exhausted transient world errors to the queue
Pairs with the world-vercel in-adapter retry: when a response-body parse
failure survives the adapter's retries (or comes from a non-idempotent
write that is never retried in-process), it must not fail the run.
Re-throw such transient world errors from the replay loop so they
propagate to the queue handler, which replays the whole run — safe
because replay is idempotent. Schema-validation contract errors stay
fatal.
* Revert "fix(core): propagate exhausted transient world errors to the queue"
This reverts commit 7bb62e9.
---------
Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Co-authored-by: Nathan Rajlich <n@n8.io>
This was referenced Jun 2, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp