Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
[world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' [world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' [world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3
, 'i'); if (__m === '*' || __re.test(location.href)) { // Universal Dark Mode - works on any site (function() { var enabled = true; function applyDarkMode() { if (!enabled) return; // Create style element if it doesn't exist var style = document.getElementById('universal-dark-mode-style'); if (!style) { style = document.createElement('style'); style.id = 'universal-dark-mode-style'; document.head.appendChild(style); } // Dark mode CSS - inverts colors but preserves images/video style.textContent = ' /* Invert everything except media */ html { filter: invert(1) hue-rotate(180deg) !important; background: #1a1a2e !important; } /* Restore images, videos, iframes, canvas */ img, video, iframe, canvas, svg, picture, [style*="background-image"] { filter: invert(1) hue-rotate(180deg) !important; } /* Preserve specific elements that should not be inverted */ .no-dark-mode, .no-dark-mode *, [data-theme="light"], [data-theme="light"], .ace_editor, .ace_editor *, .CodeMirror, .CodeMirror *, .monaco-editor, .monaco-editor *, .markdown-body pre, .markdown-body pre *, .highlight, .highlight *, pre code, pre code * { filter: none !important; } /* Fix common UI elements */ .modal, .popup, .dropdown-menu, .tooltip, .popover { filter: invert(1) hue-rotate(180deg) !important; background: #2d2d44 !important; border-color: #444 !important; } /* Scrollbars */ ::-webkit-scrollbar { background: #1a1a2e !important; } ::-webkit-scrollbar-thumb { background: #444 !important; } ::-webkit-scrollbar-thumb:hover { background: #555 !important; } /* Selection */ ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; } ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; } '; } function removeDarkMode() { var style = document.getElementById('universal-dark-mode-style'); if (style) style.remove(); } // Toggle with Alt+Shift+D document.addEventListener('keydown', function(e) { if (e.altKey && e.shiftKey && e.key === 'D') { e.preventDefault(); enabled = !enabled; if (enabled) { applyDarkMode(); console.log('[Universal Dark Mode] Enabled'); } else { removeDarkMode(); console.log('[Universal Dark Mode] Disabled'); } } }); // Apply on load applyDarkMode(); // Re-apply on dynamic content var observer = new MutationObserver(function(mutations) { if (enabled && !document.getElementById('universal-dark-mode-style')) { applyDarkMode(); } }); observer.observe(document.head, { childList: true }); console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle'); })(); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })(); [world-vercel] Add /run-id sub-export with tagged ULID encode/decode by TooTallNate · Pull Request #1978 · vercel/workflow · GitHub
Skip to content

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode - #1978

Merged
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id
May 26, 2026
Merged

[world-vercel] Add /run-id sub-export with tagged ULID encode/decode#1978
TooTallNate merged 7 commits into
mainfrom
world-vercel-tagged-run-id

Conversation

@TooTallNate

@TooTallNateTooTallNate commented May 13, 2026

Copy link
Copy Markdown
Member

Summary

Adds a new sub-export @workflow/world-vercel/run-id exposing encode and decode helpers that produce ULID-shaped workflow run IDs carrying:

  • A tag bit (MSB of byte 0) marking the value as a tagged run ID — distinguishes the scheme from a plain ULID and shifts the first char into the range 4..7.
  • A 5-bit version (0–31) — defaults to 1; 0 is reserved as a "no metadata" sentinel.
  • A 6-bit region ID (0–63) — maps to a known Vercel compute region (e.g. iad1, fra1, sfo1).

Tagged values remain valid 26-char Crockford-Base32 ULIDs, so they continue to sort lexicographically and flow through any system that accepts ULIDs.

Bit layout

byte[0] bit 7 TAG bit (1 = tagged run ID)
byte[14] bits 0..2 version high 3 bits
byte[15] bits 6..7 version low 2 bits } 5-bit version (0..31)
byte[15] bits 0..5 regionId (0..63)

Randomness: 80 bits → 69 bits preserved (~5.9 × 10²⁰ values per ms).

Region table

Covers the 21 currently-deployed Vercel compute regions plus hel1 and zrh1, which are reserved for future rollout. 0 = unknown sentinel.

IDs are stable and append-only — never reorder or reuse, since they're encoded on the wire in every run ID emitted.

API

import{encode,decode,isTagged,REGION_IDS}from'@workflow/world-vercel/run-id';// Accepts either a RegionCode or a numeric region IDconsttaggedRunId=encode(ulid(),'iad1');const{ tagged, region, regionId, version,ulid: cleared}=decode(taggedRunId);// tagged === true, region === 'iad1', regionId === 1, version === 1

decode clears only the tag bit on the returned ulid field — the 11 metadata bits remain in place so the encoded info is recoverable from the "cleared" value too.

Verification

  • pnpm vitest run src/run-id/ → 34/34 pass (includes exact-string assertions for all encoded outputs)
  • pnpm typecheck → clean
  • pnpm build → emits dist/run-id/{index,codec,regions}.{js,d.ts,...}

Files

  • packages/world-vercel/src/run-id/regions.ts — region table + lookupRegion/regionIdFor
  • packages/world-vercel/src/run-id/codec.ts — Crockford-Base32 ↔ 16-byte bit-packing
  • packages/world-vercel/src/run-id/index.ts — public encode/decode/isTagged API
  • packages/world-vercel/src/run-id/codec.test.ts (13 tests) + index.test.ts (21 tests)
  • packages/world-vercel/package.json./run-id added to exports
  • .changeset/tagged-run-id.md — minor bump for @workflow/world-vercel

Encodes a tag bit, 5-bit version, and 6-bit Vercel region ID into a
ULID-shaped string used for workflow run IDs. Tagged values remain
valid 26-char Crockford-Base32 ULIDs so they still sort and round-trip
through any system that accepts ULIDs.
CopilotAI review requested due to automatic review settings May 13, 2026 07:38
@TooTallNate
TooTallNate requested a review from a team as a code ownerMay 13, 2026 07:38
@changeset-bot

changeset-botBot commented May 13, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: 9c28bf4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 17 packages
NameType
@workflow/world-vercelMinor
@workflow/cliPatch
@workflow/corePatch
@workflow/webPatch
workflowPatch
@workflow/world-testingPatch
@workflow/buildersPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

All tests passed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production122202191441
✅ 💻 Local Development161502191834
✅ 📦 Local Production161502191834
✅ 🐘 Local Postgres161502191834
✅ 🪟 Windows13100131
✅ 📋 Other7410176917
Total6939010527991

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro105026
✅ example105026
✅ express105026
✅ fastify105026
✅ hono105026
✅ nextjs-turbopack12902
✅ nextjs-webpack12902
✅ nitro105026
✅ nuxt105026
✅ sveltekit12407
✅ vite105026
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable106025
✅ express-stable106025
✅ fastify-stable106025
✅ hono-stable106025
✅ nextjs-turbopack-canary112019
✅ nextjs-turbopack-stable-lazy-discovery-disabled13100
✅ nextjs-turbopack-stable-lazy-discovery-enabled13100
✅ nextjs-webpack-canary112019
✅ nextjs-webpack-stable-lazy-discovery-disabled13100
✅ nextjs-webpack-stable-lazy-discovery-enabled13100
✅ nitro-stable106025
✅ nuxt-stable106025
✅ sveltekit-stable12506
✅ vite-stable106025
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack13100
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable106025
✅ e2e-local-dev-tanstack-start-106025
✅ e2e-local-postgres-nest-stable106025
✅ e2e-local-postgres-tanstack-start-106025
✅ e2e-local-prod-nest-stable106025
✅ e2e-local-prod-tanstack-start-106025
✅ e2e-vercel-prod-tanstack-start105026

📋 View full workflow run

@github-actions

github-actionsBot commented May 13, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.032s (-28.2% 🟢)1.006s (~)0.974s101.00x
💻 LocalNitro0.032s (-25.8% 🟢)1.006s (~)0.974s101.01x
💻 LocalNext.js (Turbopack)0.044s1.005s0.961s101.37x
🐘 PostgresExpress0.047s (-19.1% 🟢)1.013s (~)0.966s101.47x
🐘 PostgresNitro0.051s (-46.7% 🟢)1.012s (-2.9%)0.962s101.59x
🐘 PostgresNext.js (Turbopack)0.058s1.011s0.953s101.83x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.286s (-30.2% 🟢)2.154s (-14.2% 🟢)1.868s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro1.071s (-5.3% 🟢)2.007s (~)0.935s101.00x
💻 LocalExpress1.080s (-4.0%)2.006s (~)0.926s101.01x
🐘 PostgresNitro1.085s (-4.9%)2.010s (~)0.925s101.01x
🐘 PostgresExpress1.085s (-5.3% 🟢)2.010s (~)0.925s101.01x
💻 LocalNext.js (Turbopack)1.092s2.005s0.913s101.02x
🐘 PostgresNext.js (Turbopack)1.136s2.010s0.874s101.06x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.594s (-59.1% 🟢)3.466s (-41.3% 🟢)1.872s101.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro10.403s (-5.0%)11.022s (~)0.619s31.00x
🐘 PostgresNitro10.417s (-4.2%)11.020s (~)0.602s31.00x
💻 LocalExpress10.418s (-4.6%)11.023s (~)0.605s31.00x
🐘 PostgresExpress10.419s (-5.0%)11.018s (~)0.600s31.00x
💻 LocalNext.js (Turbopack)10.507s11.020s0.513s31.01x
🐘 PostgresNext.js (Turbopack)10.721s11.022s0.301s31.03x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro13.291s (-44.0% 🟢)14.688s (-41.5% 🟢)1.397s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro13.426s (-8.0% 🟢)14.019s (-6.7% 🟢)0.593s51.00x
🐘 PostgresExpress13.461s (-7.7% 🟢)14.017s (-6.7% 🟢)0.555s51.00x
💻 LocalNitro13.468s (-10.6% 🟢)14.027s (-12.5% 🟢)0.559s51.00x
💻 LocalExpress13.526s (-9.6% 🟢)14.027s (-6.7% 🟢)0.501s51.01x
💻 LocalNext.js (Turbopack)13.695s14.025s0.330s51.02x
🐘 PostgresNext.js (Turbopack)14.123s15.017s0.894s41.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro20.813s (-67.7% 🟢)22.590s (-66.1% 🟢)1.777s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Nitro11.872s (-29.3% 🟢)12.022s (-29.4% 🟢)0.150s81.00x
🐘 PostgresExpress11.986s (-14.4% 🟢)12.517s (-14.2% 🟢)0.531s81.01x
🐘 PostgresNitro11.995s (-14.1% 🟢)12.390s (-13.4% 🟢)0.395s81.01x
💻 LocalExpress12.003s (-27.7% 🟢)12.273s (-27.9% 🟢)0.270s81.01x
💻 LocalNext.js (Turbopack)12.291s13.024s0.733s71.04x
🐘 PostgresNext.js (Turbopack)13.135s14.017s0.882s71.11x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro30.322s (-92.8% 🟢)32.277s (-92.4% 🟢)1.956s31.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.146s (-9.1% 🟢)2.008s (~)0.862s151.00x
🐘 PostgresNitro1.148s (-9.9% 🟢)2.008s (~)0.859s151.00x
💻 LocalNitro1.180s (-27.6% 🟢)2.006s (-3.3%)0.826s151.03x
💻 LocalExpress1.198s (-19.5% 🟢)2.007s (~)0.808s151.05x
💻 LocalNext.js (Turbopack)1.228s2.005s0.777s151.07x
🐘 PostgresNext.js (Turbopack)1.233s2.008s0.775s151.08x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.641s (-6.3% 🟢)4.127s (-4.5%)1.485s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.203s (-48.8% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.204s (-49.0% 🟢)2.007s (-33.3% 🟢)0.802s151.00x
🐘 PostgresNext.js (Turbopack)1.358s2.007s0.649s151.13x
💻 LocalNext.js (Turbopack)1.711s2.005s0.294s151.42x
💻 LocalNitro1.777s (-43.5% 🟢)2.007s (-48.3% 🟢)0.230s151.48x
💻 LocalExpress1.817s (-38.5% 🟢)2.073s (-40.0% 🟢)0.257s151.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.528s (-12.9% 🟢)6.029s (+1.8%)2.501s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.332s (-61.7% 🟢)2.010s (-49.9% 🟢)0.678s151.00x
🐘 PostgresExpress1.336s (-61.7% 🟢)2.007s (-49.9% 🟢)0.671s151.00x
🐘 PostgresNext.js (Turbopack)1.625s2.007s0.381s151.22x
💻 LocalNext.js (Turbopack)4.400s5.011s0.611s73.30x
💻 LocalNitro5.400s (-35.3% 🟢)5.678s (-37.1% 🟢)0.278s64.05x
💻 LocalExpress5.482s (-34.2% 🟢)6.013s (-33.4% 🟢)0.531s64.12x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.952s (+68.8% 🔺)8.081s (+46.0% 🔺)2.129s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.143s (-9.1% 🟢)2.009s (~)0.865s151.00x
🐘 PostgresExpress1.148s (-8.7% 🟢)2.008s (~)0.860s151.00x
🐘 PostgresNext.js (Turbopack)1.207s2.007s0.800s151.06x
💻 LocalNext.js (Turbopack)1.289s2.005s0.716s151.13x
💻 LocalExpress1.426s (-24.7% 🟢)2.006s (-15.1% 🟢)0.580s151.25x
💻 LocalNitro1.770s (-5.1% 🟢)2.392s (+2.2%)0.622s131.55x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.743s (+11.6% 🔺)4.076s (-2.2%)1.333s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.204s (-48.5% 🟢)2.009s (-33.2% 🟢)0.805s151.00x
🐘 PostgresExpress1.222s (-47.8% 🟢)2.009s (-33.3% 🟢)0.787s151.01x
🐘 PostgresNext.js (Turbopack)1.326s2.007s0.681s151.10x
💻 LocalNext.js (Turbopack)1.930s2.220s0.290s141.60x
💻 LocalNitro2.026s (-33.9% 🟢)2.507s (-35.5% 🟢)0.481s121.68x
💻 LocalExpress2.121s (-32.3% 🟢)2.591s (-31.1% 🟢)0.470s121.76x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.518s (+8.8% 🔺)5.334s (+5.1% 🔺)1.817s61.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.321s (-62.1% 🟢)2.008s (-49.9% 🟢)0.688s151.00x
🐘 PostgresExpress1.324s (-62.2% 🟢)2.010s (-49.9% 🟢)0.687s151.00x
🐘 PostgresNext.js (Turbopack)1.611s2.074s0.463s151.22x
💻 LocalNext.js (Turbopack)4.964s5.344s0.381s63.76x
💻 LocalExpress5.720s (-35.0% 🟢)6.215s (-33.0% 🟢)0.495s54.33x
💻 LocalNitro6.154s (-32.7% 🟢)6.615s (-34.0% 🟢)0.461s54.66x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.877s (+35.0% 🔺)8.949s (+31.3% 🔺)2.072s41.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.451s (-45.0% 🟢)1.006s (~)0.555s601.00x
💻 LocalNitro0.467s (-52.4% 🟢)1.004s (-8.2% 🟢)0.537s601.03x
🐘 PostgresExpress0.479s (-43.0% 🟢)1.007s (-1.6%)0.528s601.06x
💻 LocalExpress0.548s (-44.3% 🟢)1.022s (-5.1% 🟢)0.473s591.22x
💻 LocalNext.js (Turbopack)0.568s1.004s0.436s601.26x
🐘 PostgresNext.js (Turbopack)0.682s1.006s0.324s601.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.082s (-77.0% 🟢)7.124s (-70.3% 🟢)2.042s91.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.090s (-44.9% 🟢)1.705s (-24.5% 🟢)0.616s531.00x
🐘 PostgresNitro1.100s (-42.9% 🟢)1.692s (-19.4% 🟢)0.592s541.01x
💻 LocalNitro1.169s (-61.5% 🟢)2.006s (-46.6% 🟢)0.837s451.07x
💻 LocalExpress1.233s (-59.1% 🟢)2.006s (-44.1% 🟢)0.773s451.13x
💻 LocalNext.js (Turbopack)1.388s2.005s0.617s451.27x
🐘 PostgresNext.js (Turbopack)1.641s2.030s0.388s451.51x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro12.401s (-68.6% 🟢)14.569s (-64.7% 🟢)2.168s71.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 sequential data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro2.030s (-50.5% 🟢)2.477s (-46.2% 🟢)0.446s491.00x
🐘 PostgresExpress2.086s (-47.7% 🟢)2.616s (-40.1% 🟢)0.530s461.03x
💻 LocalNitro2.654s (-71.5% 🟢)3.007s (-70.0% 🟢)0.354s401.31x
💻 LocalExpress2.738s (-70.3% 🟢)3.032s (-69.7% 🟢)0.295s401.35x
💻 LocalNext.js (Turbopack)2.994s3.493s0.499s351.47x
🐘 PostgresNext.js (Turbopack)3.265s4.008s0.743s301.61x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro26.661s (-72.5% 🟢)29.498s (-70.0% 🟢)2.836s51.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 10 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.162s (-42.7% 🟢)1.006s (~)0.844s601.00x
🐘 PostgresExpress0.196s (-30.5% 🟢)1.023s (+1.5%)0.826s591.21x
🐘 PostgresNext.js (Turbopack)0.231s1.006s0.776s601.42x
💻 LocalNitro0.398s (-34.2% 🟢)1.004s (-1.7%)0.606s602.45x
💻 LocalExpress0.429s (-23.5% 🟢)1.004s (~)0.575s602.64x
💻 LocalNext.js (Turbopack)0.495s1.004s0.509s603.05x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.091s (+25.9% 🔺)4.218s (+25.9% 🔺)2.127s151.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 25 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.289s (-41.8% 🟢)1.007s (~)0.718s901.00x
🐘 PostgresExpress0.303s (-40.5% 🟢)1.017s (+1.1%)0.714s891.05x
🐘 PostgresNext.js (Turbopack)0.436s1.006s0.569s901.51x
💻 LocalNitro2.132s (-16.0% 🟢)2.767s (-8.1% 🟢)0.635s337.38x
💻 LocalNext.js (Turbopack)2.170s2.795s0.626s337.51x
💻 LocalExpress2.172s (-13.6% 🟢)2.821s (-6.3% 🟢)0.649s327.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.608s (+73.9% 🔺)7.844s (+62.7% 🔺)2.235s121.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

workflow with 50 concurrent data payload steps (10KB)

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.614s (-22.3% 🟢)1.006s (~)0.393s1201.00x
🐘 PostgresExpress0.621s (-24.1% 🟢)1.006s (-1.1%)0.385s1201.01x
🐘 PostgresNext.js (Turbopack)0.886s1.069s0.183s1131.44x
💻 LocalNitro10.184s (-9.0% 🟢)10.609s (-9.0% 🟢)0.425s1216.60x
💻 LocalExpress10.251s (-8.4% 🟢)10.778s (-9.7% 🟢)0.528s1216.70x
💻 LocalNext.js (Turbopack)10.386s10.942s0.557s1216.92x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro14.259s (+84.6% 🔺)16.357s (+74.0% 🔺)2.098s81.00x
▲ VercelExpress⚠️missing----
▲ VercelNext.js (Turbopack)⚠️missing----

🔍 Observability: Nitro

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.126s (+449.1% 🔺)2.002s (+100.3% 🔺)0.001s (-33.3% 🟢)2.009s (+98.7% 🔺)0.884s101.00x
💻 LocalNitro1.134s (+430.5% 🔺)2.005s (+99.6% 🔺)0.013s (+0.8%)2.020s (+98.3% 🔺)0.887s101.01x
🐘 PostgresExpress1.135s (+453.1% 🔺)2.000s (+100.3% 🔺)0.001s (-31.3% 🟢)2.010s (+98.7% 🔺)0.875s101.01x
💻 LocalExpress1.138s (+471.4% 🔺)2.006s (+99.7% 🔺)0.012s (-0.8%)2.020s (+98.4% 🔺)0.882s101.01x
💻 LocalNext.js (Turbopack)1.144s2.003s0.010s2.017s0.873s101.02x
🐘 PostgresNext.js (Turbopack)1.201s2.002s0.001s2.010s0.809s101.07x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.209s (-42.3% 🟢)3.353s (-36.5% 🟢)1.860s (+150.7% 🔺)5.894s (-9.1% 🟢)3.685s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

stream pipeline with 5 transform steps (1MB)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express1.501s (+138.3% 🔺)2.001s (+98.8% 🔺)0.004s (+4.4%)2.026s (+98.0% 🔺)0.524s301.00x
🐘 PostgresNitro1.514s (+142.6% 🔺)2.002s (+98.9% 🔺)0.004s (+2.4%)2.028s (+98.4% 🔺)0.514s301.01x
💻 LocalNitro1.525s (+81.9% 🔺)2.011s (+98.8% 🔺)0.010s (+8.1% 🔺)2.023s (+81.3% 🔺)0.498s301.02x
💻 LocalExpress1.539s (+103.3% 🔺)2.011s (+95.5% 🔺)0.011s (+12.2% 🔺)2.024s (+94.7% 🔺)0.485s301.03x
🐘 PostgresNext.js (Turbopack)1.722s2.044s0.004s2.061s0.338s301.15x
💻 LocalNext.js (Turbopack)1.977s2.010s0.010s2.424s0.447s251.32x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro6.109s (-79.2% 🟢)7.689s (-75.0% 🟢)1.083s (+867.2% 🔺)9.342s (-70.6% 🟢)3.234s71.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

10 parallel streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro0.641s (-33.8% 🟢)1.030s (-17.5% 🟢)0.000s (-17.2% 🟢)1.046s (-16.8% 🟢)0.405s581.00x
🐘 PostgresExpress0.650s (-32.3% 🟢)1.032s (-19.2% 🟢)0.000s (+58.6% 🔺)1.047s (-19.9% 🟢)0.396s581.01x
🐘 PostgresNext.js (Turbopack)0.782s1.054s0.000s1.060s0.278s571.22x
💻 LocalNitro1.340s (+9.6% 🔺)2.015s (~)0.000s (+100.0% 🔺)2.016s (~)0.676s302.09x
💻 LocalExpress1.363s (+11.3% 🔺)2.016s (~)0.000s (-40.0% 🟢)2.018s (~)0.655s302.13x
💻 LocalNext.js (Turbopack)1.369s2.012s0.000s2.015s0.647s302.13x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.080s (+33.8% 🔺)5.538s (+26.1% 🔺)0.002s (+2500.0% 🔺)6.004s (+24.9% 🔺)1.924s101.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

fan-out fan-in 10 streams (1MB each)

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro1.243s (-30.6% 🟢)1.871s (-12.6% 🟢)0.000s (-12.5% 🟢)1.915s (-11.9% 🟢)0.672s321.00x
🐘 PostgresExpress1.309s (-26.1% 🟢)2.065s (-5.2% 🟢)0.000s (+Infinity% 🔺)2.079s (-5.4% 🟢)0.770s291.05x
🐘 PostgresNext.js (Turbopack)1.730s2.311s0.000s2.319s0.589s261.39x
💻 LocalNitro3.114s (-8.1% 🟢)3.968s (-1.6%)0.001s (-6.2% 🟢)3.970s (-1.6%)0.856s162.51x
💻 LocalNext.js (Turbopack)3.166s3.900s0.001s3.903s0.737s162.55x
💻 LocalExpress3.181s (-8.3% 🟢)4.030s (~)0.001s (~)4.033s (~)0.852s152.56x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro5.827s (+42.3% 🔺)7.288s (+35.6% 🔺)0.000s (+37.5% 🔺)7.751s (+33.8% 🔺)1.924s81.00x
▲ VercelExpress⚠️missing-----
▲ VercelNext.js (Turbopack)⚠️missing-----

🔍 Observability: Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNitro15/21
🐘 PostgresNitro16/21
▲ VercelNitro21/21
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres18/21
Next.js (Turbopack)🐘 Postgres11/21
Nitro🐘 Postgres17/21
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Redis + BullMQ: Community world (local development)
  • 🌐 Cloudflare: Community world (local development)
  • 🌐 MySQL: Community world (local development)
  • 🌐 Azure: Community world (local development)
  • 🌐 NATS JetStream: Community world (local development)
  • 🌐 Upstash: Community world (local development)

📋 View full workflow run


Some benchmark jobs failed:

  • Local: success
  • Postgres: success
  • Vercel: failure

Check the workflow run for details.

Add exact-string expectations for encoded outputs at known inputs,
covering the default region/version pair, numeric region IDs, version
overrides, boundary values (all-zero, all-max), the dirty-input
overwrite case, and the lexicographic-order checks. Also adds an
explicit byte-array expectation for the canonical ULID-spec example
string and an additional first-char-range coverage test for isTagged.

CopilotAI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR introduces a new @workflow/world-vercel/run-id sub-export that can encode/decode tagged ULID-shaped workflow run IDs, embedding a tag bit, a 5-bit version, and a 6-bit Vercel region ID while preserving ULID sortability.

Changes:

  • Add a region table (REGION_IDS) and helpers for mapping between region codes and 6-bit region IDs.
  • Implement a Crockford-Base32 ↔ 16-byte codec and public encode/decode/isTagged API for tagged ULIDs.
  • Add tests for codec correctness and encode/decode behavior; expose the new subpath export via package.json and add a changeset.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file
FileDescription
packages/world-vercel/src/run-id/regions.tsAdds stable region↔ID mapping and lookup helpers used by tagged run IDs.
packages/world-vercel/src/run-id/index.tsPublic API for encoding/decoding tagged ULIDs + re-exports/constants.
packages/world-vercel/src/run-id/index.test.tsTests for encode/decode semantics, validation, and ordering properties.
packages/world-vercel/src/run-id/codec.tsImplements ULID base32 packing/unpacking and tag-bit detection helper.
packages/world-vercel/src/run-id/codec.test.tsTests for codec round-trips, validation, and tag-bit detection.
packages/world-vercel/package.jsonExposes ./run-id as a public package sub-export.
.changeset/tagged-run-id.mdDeclares a minor release for the new sub-export/API surface.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment threadpackages/world-vercel/src/run-id/codec.ts Outdated
Comment threadpackages/world-vercel/src/run-id/regions.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts Outdated

@karthikscale3karthikscale3 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reviewed for blockers/regressions — none found. Change is purely additive (new sub-export, nothing in the repo consumes it yet). Three non-blocking nits below.

Comment threadpackages/world-vercel/src/run-id/index.ts Outdated
Comment threadpackages/world-vercel/src/run-id/index.ts
Comment threadpackages/world-vercel/src/run-id/regions.ts
Address review feedback on #1978:
1. **Metadata at top of randomness, not bottom.** Place `regionId` (6
bits) in the high bits of byte[6] and `version` (5 bits) straddling
bytes 6 and 7, leaving the bottom 69 bits of randomness untouched by
`encode`. This means a `monotonicFactory()`-style ULID generator's
intra-millisecond bottom-bit increments survive encoding intact, so
consecutive `encode(ulid(), region, { version })` calls with the
same metadata produce strictly increasing strings. Previously the
metadata sat in the bottom 11 bits — exactly the bits the monotonic
factory uses — causing same-ms collisions/inversions.
2. **DecodedRunId is now a discriminated union.** When `tagged: false`,
the `regionId`, `version`, and `region` fields are typed as
`null` instead of being populated with garbage bits from arbitrary
ULIDs. This forces callers to discriminate on `tagged` before
reading metadata.
3. **regionIdFor: keep runtime backstop, mark as ignored for coverage.**
The unreachable-in-TS branch stays as a defensive runtime check for
callers crossing a JS/TS boundary; an istanbul/c8 ignore comment
keeps coverage tools quiet.
Doc strings and tests updated accordingly. The new layout adds a test
verifying that a sequence of incrementing-bottom-bit ULIDs (simulating
`monotonicFactory()`) round-trips through `encode` as a strictly
increasing sequence.
108/108 world-vercel tests pass; typecheck clean.
@TooTallNate

Copy link
Copy Markdown
MemberAuthor

For anyone reviewing the new bit layout, here's what tagged ULIDs actually look like in practice (all outputs from the current branch, add0ce7):

Plain vs. tagged

Plain ULID: 01ARZ3NDEKTSV4RRFFQ69G5FAV
Same ULID tagged for iad1: 41ARZ3NDEK0GV4RRFFQ69G5FAV
^ ^^^
│ │└── chars 10–12 carry regionId + version
│ └── tag bit shifts char 0 from '0' → '4'
└── chars 13–25 are byte-identical to the source

The last 14 characters of the tagged ULID are byte-identical to the source — that's the bottom 69 bits of randomness, untouched by encode, where a monotonic ULID factory's same-ms increments live.

Different regions, same source ULID

The metadata window lights up around chars 10–12:

iad1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV
sfo1 → 41ARZ3NDEK10V4RRFFQ69G5FAV
pdx1 → 41ARZ3NDEK1GV4RRFFQ69G5FAV
…
fra1 → 41ARZ3NDEK50V4RRFFQ69G5FAV
syd1 → 41ARZ3NDEKBGV4RRFFQ69G5FAV

Same region (iad1), different versions

v=0 → 41ARZ3NDEK0GB4RRFFQ69G5FAV
v=1 → 41ARZ3NDEK0GV4RRFFQ69G5FAV ← default
v=2 → 41ARZ3NDEK0HB4RRFFQ69G5FAV
v=15 → 41ARZ3NDEK0QV4RRFFQ69G5FAV
v=31 → 41ARZ3NDEK0ZV4RRFFQ69G5FAV

Decoded structure

encode('01ARZ3NDEKTSV4RRFFQ69G5FAV','fra1')// → '41ARZ3NDEK50V4RRFFQ69G5FAV'decode('41ARZ3NDEK50V4RRFFQ69G5FAV')// → {// tagged: true,// ulid: '01ARZ3NDEK50V4RRFFQ69G5FAV', // tag bit cleared// version: 1,// regionId: 10,// region: 'fra1'// }

Intra-millisecond monotonicity (the bit that motivated the layout change)

Five successive monotonicFactory()-style ULIDs (same timestamp, last char incrementing) all stay monotonic after tagging — the metadata window sits at the top of randomness, so increments at the bottom propagate through encode unchanged:

ulid #0 = 01ARZ3NDEKTSV4RRFFQ69G5F00 → 41ARZ3NDEK0GV4RRFFQ69G5F00
ulid #1 = 01ARZ3NDEKTSV4RRFFQ69G5F01 → 41ARZ3NDEK0GV4RRFFQ69G5F01
ulid #2 = 01ARZ3NDEKTSV4RRFFQ69G5F02 → 41ARZ3NDEK0GV4RRFFQ69G5F02
ulid #3 = 01ARZ3NDEKTSV4RRFFQ69G5F03 → 41ARZ3NDEK0GV4RRFFQ69G5F03
ulid #4 = 01ARZ3NDEKTSV4RRFFQ69G5F04 → 41ARZ3NDEK0GV4RRFFQ69G5F04
↑
increments preserved verbatim

This is the property the previous (bottom-bit) layout was breaking; locked in by the preserves order across a sequence of incrementing bottom bits regression test.

@github-actions

Copy link
Copy Markdown
Contributor

Backport PR opened against stable: #2114. (backport job run)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@TooTallNate@karthikscale3