Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail by VaguelySerious · Pull Request #2356 · vercel/workflow · GitHub
Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail by VaguelySerious · Pull Request #2356 · vercel/workflow · GitHub
Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail by VaguelySerious · Pull Request #2356 · vercel/workflow · GitHub
Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' [ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail by VaguelySerious · Pull Request #2356 · vercel/workflow · GitHub
Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail by VaguelySerious · Pull Request #2356 · vercel/workflow · GitHub
Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); })(); [ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail by VaguelySerious · Pull Request #2356 · vercel/workflow · GitHub
Skip to content

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail - #2356

Merged
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture
Jun 11, 2026
Merged

[ci] Capture Vercel runtime logs when e2e Vercel Prod lanes fail#2356
VaguelySerious merged 1 commit into
mainfrom
peter/e2e-runtime-log-capture

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

Summary

When an E2E Vercel Prod Tests lane fails, CI now fetches the runtime request logs of the deployment under test and uploads them as part of the existing e2e-results-vercel-prod-* artifact, with the most relevant rows echoed into the job log.

Runtime logs are the missing piece when triaging these flakes: the harness already captures workflow run state and event timelines, but not what the deployed functions actually logged (crashes, unhandled rejections, cold-start failures). Today that information is simply lost.

How it works

  • A new .github/scripts/fetch-e2e-runtime-logs.mjs runs with if: failure() after the test step, using the same request-logs API as vercel logs.
  • The deployment is shared with concurrent CI runs and a test window can span tens of thousands of request rows, so instead of a bulk dump the script makes targeted queries:
    1. an error/fatal-level sweep of the test window (server-side level filter), and
    2. a per-failed-run query for each workflow run ID found in the e2e-failures-*.json sidecar (each request row carries a workflowRunId).
  • Rows are deduped by request ID and written to e2e-runtime-logs-{app}-vercel.json; the aggregation script excludes the new sidecar from vitest-result globbing.
  • The script never fails the job (exit 0 on any error) and no-ops gracefully when env/sidecars are missing.

Validation

Ran the script locally against the deployment from a real failed lane (E2E Vercel Prod (nitro), run 27291235666, 2026-06-10). It captured 23 targeted rows including the failed test's run — and immediately surfaced the kind of evidence this exists for:

[error] Unhandled Rejection: TypeError: fetch failed
[fatal] Node.js process exited with exit status: 128.

i.e. the deployed function process crashed mid-test — the failure mode addressed by #2336, invisible until now from the CI side.

Empty changeset: CI tooling only, no published packages touched.

🤖 Generated with Claude Code

When the e2e test step fails, fetch the deployment's runtime request logs
via the same request-logs API the vercel CLI uses — an error/fatal-level
sweep of the test window plus per-failed-run queries keyed by the workflow
run IDs from the failures sidecar — and upload them as a job artifact.
Runtime logs were the missing diagnostic: the harness records run state
and event timelines, but not what the deployed functions logged (crashes,
unhandled rejections, cold-start failures).
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerJune 11, 2026 10:22
@vercel

vercelBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

@changeset-bot

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 0a43289

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 0 packages

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro0.041s (-3.3%)1.006s (~)0.965s101.00x
💻 LocalExpress0.048s (+10.2% 🔺)1.007s (~)0.960s101.15x
🐘 PostgresNitro0.056s (-11.9% 🟢)1.012s (~)0.957s101.35x
🐘 PostgresExpress0.059s (-10.4% 🟢)1.012s (~)0.953s101.43x
💻 LocalNext.js (Turbopack)0.060s (+9.6% 🔺)1.006s (~)0.946s101.46x
🐘 PostgresNext.js (Turbopack)0.062s (-11.7% 🟢)1.011s (~)0.949s101.49x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.267s (+2.0%)2.346s (-3.7%)2.079s101.00x
▲ VercelNext.js (Turbopack)0.282s (-14.3% 🟢)2.592s (+10.7% 🔺)2.310s101.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.094s (~)2.006s (~)0.913s101.00x
💻 LocalExpress1.097s (~)2.007s (~)0.909s101.00x
🐘 PostgresExpress1.103s (+1.0%)2.010s (~)0.907s101.01x
🐘 PostgresNitro1.107s (-0.6%)2.009s (~)0.903s101.01x
🐘 PostgresNext.js (Turbopack)1.125s (-1.4%)2.010s (~)0.884s101.03x
💻 LocalNext.js (Turbopack)1.130s (+1.9%)2.006s (~)0.876s101.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.695s (+8.2% 🔺)3.520s (~)1.825s101.00x
▲ VercelNext.js (Turbopack)1.772s (+6.4% 🔺)3.766s (-7.6% 🟢)1.994s101.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.520s (~)11.023s (~)0.503s31.00x
🐘 PostgresNitro10.541s (~)11.019s (~)0.478s31.00x
🐘 PostgresExpress10.563s (-1.4%)11.015s (-3.0%)0.452s31.00x
💻 LocalExpress10.586s (~)11.024s (~)0.438s31.01x
🐘 PostgresNext.js (Turbopack)10.660s (-1.5%)11.022s (~)0.362s31.01x
💻 LocalNext.js (Turbopack)10.771s (+1.6%)11.024s (~)0.253s31.02x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.355s (+7.8% 🔺)15.964s (+2.4%)1.609s21.00x
▲ VercelNext.js (Turbopack)15.120s (+12.0% 🔺)16.716s (+3.8%)1.596s21.05x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express13.755s (-1.1%)14.028s (-1.4%)0.272s51.00x
🐘 PostgresNitro13.800s (~)14.017s (~)0.218s51.00x
💻 LocalNitro13.804s (+0.6%)14.026s (~)0.222s51.00x
🐘 PostgresExpress13.914s (+0.6%)14.019s (-1.5%)0.105s51.01x
🐘 PostgresNext.js (Turbopack)14.024s (-3.9%)14.821s (-1.3%)0.797s51.02x
💻 LocalNext.js (Turbopack)14.304s (+2.0%)15.029s (+2.8%)0.725s41.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro22.983s (-9.9% 🟢)24.662s (-10.7% 🟢)1.679s31.00x
▲ VercelNext.js (Turbopack)23.428s (-8.2% 🟢)25.672s (-5.6% 🟢)2.244s31.02x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express12.350s (-3.0%)13.016s (-2.2%)0.665s71.00x
🐘 PostgresNitro12.422s (-2.5%)13.019s (~)0.596s71.01x
💻 LocalNitro12.439s (~)13.026s (~)0.586s71.01x
💻 LocalExpress12.472s (-1.0%)13.027s (~)0.554s71.01x
🐘 PostgresNext.js (Turbopack)13.101s (-4.8%)13.730s (-2.1%)0.629s71.06x
💻 LocalNext.js (Turbopack)13.657s (+5.5% 🔺)14.027s (+5.4% 🔺)0.369s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro32.711s (+12.6% 🔺)34.708s (+10.6% 🔺)1.997s31.00x
▲ VercelNext.js (Turbopack)33.765s (+14.0% 🔺)36.258s (+13.8% 🔺)2.493s31.03x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.180s (-1.7%)2.007s (-0.7%)0.828s151.00x
💻 LocalNitro1.180s (-2.7%)2.006s (~)0.826s151.00x
🐘 PostgresNitro1.195s (~)2.008s (~)0.813s151.01x
💻 LocalExpress1.264s (~)2.006s (~)0.742s151.07x
🐘 PostgresNext.js (Turbopack)1.280s (+2.3%)2.074s (+3.3%)0.795s151.08x
💻 LocalNext.js (Turbopack)1.307s (+6.8% 🔺)2.006s (~)0.700s151.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.615s (-5.6% 🟢)4.027s (-7.2% 🟢)1.412s81.00x
▲ VercelNext.js (Turbopack)3.199s (+19.0% 🔺)4.592s (+8.8% 🔺)1.392s71.22x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.245s (-1.1%)2.007s (~)0.762s151.00x
🐘 PostgresExpress1.272s (-4.1%)2.007s (~)0.735s151.02x
🐘 PostgresNext.js (Turbopack)1.349s (-4.3%)2.007s (~)0.658s151.08x
💻 LocalNitro1.715s (+0.6%)2.006s (-3.2%)0.291s151.38x
💻 LocalExpress1.748s (-7.1% 🟢)2.006s (-9.7% 🟢)0.258s151.40x
💻 LocalNext.js (Turbopack)1.836s (+6.4% 🔺)2.074s (+3.4%)0.238s151.48x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.676s (-9.7% 🟢)5.193s (-16.4% 🟢)1.517s61.00x
▲ VercelNext.js (Turbopack)4.162s (+1.4%)5.659s (-7.8% 🟢)1.496s61.13x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.383s (-1.6%)2.008s (~)0.625s151.00x
🐘 PostgresExpress1.402s (+0.6%)2.007s (~)0.605s151.01x
🐘 PostgresNext.js (Turbopack)1.596s (-9.3% 🟢)2.143s (-6.6% 🟢)0.547s151.15x
💻 LocalNitro4.620s (-2.1%)5.012s (~)0.391s63.34x
💻 LocalExpress4.638s (-12.5% 🟢)5.345s (-11.1% 🟢)0.707s63.35x
💻 LocalNext.js (Turbopack)5.511s (+25.4% 🔺)6.013s (+20.0% 🔺)0.501s53.98x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.462s (-18.9% 🟢)7.360s (-15.5% 🟢)1.898s51.00x
▲ VercelNext.js (Turbopack)6.898s (+17.5% 🔺)8.815s (+13.3% 🔺)1.917s41.26x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.187s (-1.1%)2.008s (~)0.821s151.00x
🐘 PostgresExpress1.188s (-1.2%)2.008s (~)0.820s151.00x
🐘 PostgresNext.js (Turbopack)1.200s (-5.2% 🟢)2.009s (~)0.808s151.01x
💻 LocalNext.js (Turbopack)1.340s (+2.6%)2.007s (~)0.667s151.13x
💻 LocalNitro1.485s (-3.8%)2.006s (~)0.521s151.25x
💻 LocalExpress1.507s (-9.0% 🟢)2.007s (-3.2%)0.500s151.27x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.456s (-8.1% 🟢)3.852s (-11.1% 🟢)1.396s81.00x
▲ VercelNext.js (Turbopack)2.655s (-39.3% 🟢)4.323s (-31.3% 🟢)1.668s71.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.235s (-3.1%)2.008s (~)0.772s151.00x
🐘 PostgresExpress1.250s (+0.5%)2.009s (~)0.759s151.01x
🐘 PostgresNext.js (Turbopack)1.316s (-5.8% 🟢)2.007s (~)0.690s151.07x
💻 LocalNext.js (Turbopack)2.020s (~)2.592s (+3.4%)0.572s121.63x
💻 LocalNitro2.031s (+15.6% 🔺)2.591s (+25.0% 🔺)0.560s121.64x
💻 LocalExpress2.040s (-4.0%)2.470s (-4.6%)0.430s131.65x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.367s (-25.5% 🟢)4.908s (-20.4% 🟢)1.541s71.00x
▲ VercelNitro3.602s (-12.0% 🟢)5.404s (-10.0% 🟢)1.802s61.07x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.378s (-5.7% 🟢)2.007s (~)0.629s151.00x
🐘 PostgresExpress1.400s (-6.7% 🟢)2.008s (-16.2% 🟢)0.608s151.02x
🐘 PostgresNext.js (Turbopack)1.616s (-2.4%)2.151s (+3.7%)0.535s141.17x
💻 LocalExpress5.184s (-11.6% 🟢)5.848s (-5.9% 🟢)0.664s63.76x
💻 LocalNitro5.367s (+13.2% 🔺)6.015s (+12.6% 🔺)0.648s63.89x
💻 LocalNext.js (Turbopack)5.729s (+11.0% 🔺)6.414s (+6.6% 🔺)0.685s54.16x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.785s (+17.3% 🔺)7.247s (+7.6% 🔺)1.462s51.00x
▲ VercelNext.js (Turbopack)6.222s (+7.4% 🔺)8.268s (+9.1% 🔺)2.046s41.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.566s (-7.0% 🟢)1.023s (+1.6%)0.457s591.00x
🐘 PostgresExpress0.569s (-14.6% 🟢)1.041s (-0.6%)0.472s581.01x
💻 LocalNitro0.583s (-27.6% 🟢)1.005s (-16.6% 🟢)0.422s601.03x
💻 LocalExpress0.598s (-8.8% 🟢)1.005s (-3.3%)0.407s601.06x
🐘 PostgresNext.js (Turbopack)0.664s (-18.3% 🟢)1.023s (+1.7%)0.360s591.17x
💻 LocalNext.js (Turbopack)0.850s (+22.1% 🔺)1.005s (~)0.155s601.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.519s (-26.0% 🟢)6.990s (-26.6% 🟢)1.471s91.00x
▲ VercelNext.js (Turbopack)5.864s (+16.2% 🔺)7.891s (+15.2% 🔺)2.027s81.06x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.315s (-7.2% 🟢)2.008s (~)0.693s451.00x
🐘 PostgresExpress1.382s (-10.0% 🟢)2.029s (-5.7% 🟢)0.647s451.05x
💻 LocalNitro1.516s (+3.6%)2.006s (~)0.490s451.15x
💻 LocalExpress1.542s (-3.1%)2.007s (-1.1%)0.465s451.17x
🐘 PostgresNext.js (Turbopack)1.576s (-18.9% 🟢)2.007s (-7.7% 🟢)0.431s451.20x
💻 LocalNext.js (Turbopack)2.054s (+18.8% 🔺)3.008s (+48.3% 🔺)0.954s301.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.967s (+5.7% 🔺)15.727s (+1.6%)1.760s61.00x
▲ VercelNext.js (Turbopack)15.435s (+4.5%)17.236s (+1.8%)1.801s61.11x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.584s (-11.3% 🟢)3.034s (-7.5% 🟢)0.449s401.00x
🐘 PostgresExpress2.692s (-7.5% 🟢)3.136s (-11.4% 🟢)0.444s391.04x
🐘 PostgresNext.js (Turbopack)3.127s (-19.0% 🟢)4.009s (-1.7%)0.882s301.21x
💻 LocalNitro3.272s (+2.1%)3.978s (-0.8%)0.705s311.27x
💻 LocalExpress3.337s (-2.4%)4.010s (~)0.673s301.29x
💻 LocalNext.js (Turbopack)4.322s (+15.9% 🔺)5.010s (+21.9% 🔺)0.688s241.67x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.486s (-11.1% 🟢)28.519s (-10.8% 🟢)2.033s51.00x
▲ VercelNext.js (Turbopack)29.701s (+10.1% 🔺)32.280s (+10.3% 🔺)2.579s41.12x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.215s (-8.5% 🟢)1.006s (~)0.791s601.00x
🐘 PostgresExpress0.221s (-12.3% 🟢)1.006s (~)0.785s601.03x
🐘 PostgresNext.js (Turbopack)0.240s (-15.0% 🟢)1.006s (~)0.766s601.11x
💻 LocalNitro0.466s (+9.8% 🔺)1.022s (+1.8%)0.556s592.16x
💻 LocalExpress0.469s (+1.0%)1.005s (~)0.535s602.18x
💻 LocalNext.js (Turbopack)0.581s (-4.9%)1.005s (-3.3%)0.424s602.70x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.282s (+3.7%)3.811s (-9.7% 🟢)1.530s161.00x
▲ VercelNitro2.283s (-2.6%)3.784s (-12.7% 🟢)1.501s161.00x
▲ VercelExpress⚠️missing----

🔍 Observability: Next.js (Turbopack) | Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.337s (-9.1% 🟢)1.007s (~)0.669s901.00x
🐘 PostgresExpress0.346s (+2.2%)1.007s (~)0.660s901.03x
🐘 PostgresNext.js (Turbopack)0.419s (-13.1% 🟢)1.006s (~)0.587s901.24x
💻 LocalNitro2.112s (+2.3%)2.580s (-2.2%)0.469s356.26x
💻 LocalExpress2.217s (+1.2%)2.797s (-0.9%)0.580s336.58x
💻 LocalNext.js (Turbopack)2.325s (-5.1% 🟢)3.009s (-3.2%)0.684s306.90x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.265s (-88.0% 🟢)6.802s (-85.2% 🟢)1.536s141.00x
▲ VercelNext.js (Turbopack)5.662s (-9.7% 🟢)7.304s (-14.0% 🟢)1.641s131.08x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.662s (-6.4% 🟢)1.007s (~)0.345s1201.00x
🐘 PostgresExpress0.666s (+6.4% 🔺)1.006s (-4.6%)0.341s1201.01x
🐘 PostgresNext.js (Turbopack)0.817s (-16.6% 🟢)1.006s (-37.4% 🟢)0.189s1201.23x
💻 LocalNitro9.727s (+11.7% 🔺)10.194s (+9.2% 🔺)0.467s1214.69x
💻 LocalExpress9.905s (-4.0%)10.446s (-3.9%)0.540s1214.96x
💻 LocalNext.js (Turbopack)10.259s (-0.5%)10.936s (-3.2%)0.677s1115.50x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro15.846s (-94.9% 🟢)17.641s (-94.4% 🟢)1.795s81.00x
▲ VercelNext.js (Turbopack)18.329s (-88.5% 🟢)20.381s (-87.4% 🟢)2.052s61.16x
▲ VercelExpress⚠️missing----

🔍 Observability: Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.157s (-3.1%)2.001s (~)0.001s (-97.7% 🟢)2.011s (-1.6%)0.854s101.00x
💻 LocalExpress1.162s (-0.5%)2.005s (~)0.011s (-18.0% 🟢)2.018s (~)0.856s101.00x
💻 LocalNitro1.164s (+1.2%)2.005s (~)0.011s (+5.0%)2.018s (~)0.853s101.01x
🐘 PostgresNitro1.169s (-1.0%)1.997s (~)0.001s (-21.4% 🟢)2.010s (~)0.840s101.01x
🐘 PostgresNext.js (Turbopack)1.202s (-2.6%)2.000s (~)0.001s (-13.3% 🟢)2.010s (~)0.807s101.04x
💻 LocalNext.js (Turbopack)1.208s (+3.4%)2.004s (~)0.012s (+18.8% 🔺)2.020s (~)0.812s101.04x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.560s (+18.3% 🔺)3.481s (+1.9%)1.422s (+175.7% 🔺)5.458s (+22.1% 🔺)2.898s101.00x
▲ VercelNext.js (Turbopack)2.635s (+17.5% 🔺)3.564s (~)1.068s (-91.4% 🟢)5.102s (-69.1% 🟢)2.467s101.03x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.571s (-9.6% 🟢)2.002s (-6.6% 🟢)0.005s (+75.1% 🔺)2.027s (-6.2% 🟢)0.456s301.00x
🐘 PostgresNitro1.572s (-5.5% 🟢)2.003s (~)0.005s (+34.2% 🔺)2.028s (~)0.456s301.00x
💻 LocalNitro1.581s (-9.3% 🟢)2.010s (~)0.013s (+42.7% 🔺)2.026s (-7.9% 🟢)0.445s301.01x
💻 LocalExpress1.600s (-2.2%)2.011s (~)0.014s (+26.9% 🔺)2.027s (~)0.427s301.02x
🐘 PostgresNext.js (Turbopack)1.648s (-6.5% 🟢)2.009s (~)0.004s (+8.3% 🔺)2.025s (~)0.376s301.05x
💻 LocalNext.js (Turbopack)1.717s (+4.6%)2.009s (~)0.013s (+29.4% 🔺)2.025s (~)0.308s301.09x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.716s (-0.5%)6.856s (-9.8% 🟢)0.237s (-29.9% 🟢)7.551s (-11.0% 🟢)1.835s81.00x
▲ VercelNext.js (Turbopack)5.946s (-6.7% 🟢)7.117s (-10.3% 🟢)0.202s (-44.2% 🟢)7.771s (-12.3% 🟢)1.825s81.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.663s (-8.2% 🟢)1.011s (-1.9%)0.000s (-67.2% 🟢)1.024s (-2.2%)0.361s591.00x
🐘 PostgresExpress0.692s (-29.2% 🟢)1.012s (-29.1% 🟢)0.000s (-52.5% 🟢)1.033s (-28.7% 🟢)0.340s591.04x
🐘 PostgresNext.js (Turbopack)0.818s (-1.8%)1.071s (~)0.000s (-1.8%)1.078s (~)0.260s571.23x
💻 LocalNitro1.408s (+4.1%)2.013s (~)0.000s (-33.3% 🟢)2.016s (~)0.607s302.12x
💻 LocalNext.js (Turbopack)1.448s (~)2.013s (~)0.000s (-37.5% 🟢)2.016s (~)0.568s302.18x
💻 LocalExpress1.450s (-2.2%)2.014s (~)0.000s (-6.7% 🟢)2.017s (~)0.567s302.19x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.079s (-14.5% 🟢)4.197s (-17.2% 🟢)0.000s (NaN%)4.623s (-17.9% 🟢)1.544s131.00x
▲ VercelNext.js (Turbopack)3.151s (-4.8%)4.387s (-10.4% 🟢)0.000s (NaN%)4.831s (-11.5% 🟢)1.680s131.02x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.289s (-8.6% 🟢)2.034s (+1.9%)0.000s (NaN%)2.052s (+2.0%)0.763s301.00x
🐘 PostgresExpress1.468s (-9.1% 🟢)2.140s (-5.0% 🟢)0.000s (+Infinity% 🔺)2.169s (-4.8%)0.701s281.14x
🐘 PostgresNext.js (Turbopack)1.603s (-7.2% 🟢)2.225s (-1.6%)0.000s (NaN%)2.247s (-1.0%)0.644s271.24x
💻 LocalNext.js (Turbopack)2.746s (-14.6% 🟢)3.287s (-15.7% 🟢)0.000s (+34.7% 🔺)3.290s (-15.6% 🟢)0.545s192.13x
💻 LocalNitro3.180s (+2.1%)3.901s (~)0.000s (+75.0% 🔺)3.904s (~)0.724s162.47x
💻 LocalExpress3.309s (-0.7%)3.966s (+3.3%)0.001s (+66.7% 🔺)3.969s (+3.3%)0.660s162.57x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.830s (-31.4% 🟢)6.389s (-25.5% 🟢)0.000s (NaN%)6.814s (-25.0% 🟢)1.983s91.00x
▲ VercelNext.js (Turbopack)5.038s (-2.5%)6.197s (-7.2% 🟢)0.000s (-100.0% 🟢)6.657s (-7.6% 🟢)1.620s101.04x
▲ VercelExpress⚠️missing-----

🔍 Observability: Nitro | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro19/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres20/21
Nitro🐘 Postgres16/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

@github-actions

github-actionsBot commented Jun 11, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production126422191485
✅ 💻 Local Development167102191890
✅ 📦 Local Production167102191890
✅ 🐘 Local Postgres167102191890
✅ 🪟 Windows13500135
✅ 📋 Other7690176945
Total7181210528235

❌ Failed Tests

▲ Vercel Production (2 failed)

astro (1 failed):

  • outputStreamWorkflow positive startIndex (skips first chunk)

express (1 failed):

  • fibonacciWorkflow - recursive workflow composition via start() | wrun_01KTV3RAK0WZJ5E3J6CG2TAGHH | 🔍 observability

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
❌ astro108126
✅ example109026
❌ express108126
✅ fastify109026
✅ hono109026
✅ nextjs-turbopack13302
✅ nextjs-webpack13302
✅ nitro109026
✅ nuxt109026
✅ sveltekit12807
✅ vite109026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable110025
✅ express-stable110025
✅ fastify-stable110025
✅ hono-stable110025
✅ nextjs-turbopack-canary116019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13500
✅ nextjs-turbopack-stable-lazy-discovery-enabled13500
✅ nextjs-webpack-canary116019
✅ nextjs-webpack-stable-lazy-discovery-disabled13500
✅ nextjs-webpack-stable-lazy-discovery-enabled13500
✅ nitro-stable110025
✅ nuxt-stable110025
✅ sveltekit-stable12906
✅ vite-stable110025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13500
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable110025
✅ e2e-local-dev-tanstack-start-110025
✅ e2e-local-postgres-nest-stable110025
✅ e2e-local-postgres-tanstack-start-110025
✅ e2e-local-prod-nest-stable110025
✅ e2e-local-prod-tanstack-start-110025
✅ e2e-vercel-prod-tanstack-start109026

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: success
  • Local Prod: success
  • Local Postgres: success
  • Windows: success

Check the workflow run for details.

@VaguelySerious
VaguelySerious merged commit c000462 into mainJun 11, 2026
112 of 116 checks passed
@VaguelySerious
VaguelySerious deleted the peter/e2e-runtime-log-capture branch June 11, 2026 10:36
pranaygp added a commit that referenced this pull request Jun 11, 2026
…hook-ready
* origin-https/main: (119 commits)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
Patch vulnerable package dependencies (#2301)
Deprecate DurableAgent and update it with WorkflowAgent in v5 docs (#2285)
[codex] Fix partial world-local exclusive writes (#2296)
...
# Conflicts:
#	packages/core/src/runtime.ts
#	packages/core/src/runtime/suspension-handler.ts
pranaygp added a commit that referenced this pull request Jun 11, 2026
…t-race-eager-wait
* origin/main:
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
pranaygp added a commit that referenced this pull request Jun 11, 2026
…docs-run-idempotency
* origin-https/main: (115 commits)
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Version Packages (beta) (#2254)
...
# Conflicts:
#	docs/content/docs/v4/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/advanced/child-workflows.mdx
#	docs/content/docs/v5/cookbook/agent-patterns/durable-agent.mdx
pranaygp added a commit that referenced this pull request Jun 11, 2026
* origin/main:
[core] V2: unify wait+step queue dispatch in suspension processing (#1925)
fix(world-local,world-postgres): make duplicate hook_created idempotent (#2295)
docs(observability): remove MVP implementation detail bullet (#2367)
fix: settle aborted parallel steps before completing abortParallelWorkflow (#2244)
Add native v4 workflow attribute events (#2226)
Version Packages (beta) (#2326)
[ci] Fix flaky windows unit tests (#2359)
Capture Vercel runtime logs when e2e Vercel Prod lanes fail (#2356)
Fix e2e failure reporting under vitest 4 and preserve fetch error causes (#2355)
[core] Fix process crash from rejected waitUntil promises (#2336)
[core] Remove duplicate `waitUntil` for suspension handler async operations (#2345)
Prevent local tests from hanging (#2338)
feat(core): add optional namespace for queue topic prefix (#2305)
[web-shared] Show precise durations in the new trace viewer (#2335)
Validate unique workflow step IDs at build time (#2018)
Move run attributes into their own detail card (#2327)
[core] Forward-port stream reconnect to getReadable level (#2318)
[docs] Add "Step executed multiple times" error page (#2310)
Fix flickering on the detail panel when navigating the trace viewer (#2325)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@VaguelySerious