Skip to content

[core] Reduce runtime warnings to info logs, for logs that users can't act on - #1402

Merged
VaguelySerious merged 2 commits into
mainfrom
peter/downgrade-logs
Mar 16, 2026
Merged

[core] Reduce runtime warnings to info logs, for logs that users can't act on#1402
VaguelySerious merged 2 commits into
mainfrom
peter/downgrade-logs

Conversation

@VaguelySerious

Copy link
Copy Markdown
Member

No description provided.

Signed-off-by: Peter Wielander <mittgfu@gmail.com>
@VaguelySerious
VaguelySerious requested a review from a team as a code ownerMarch 16, 2026 19:04
@changeset-bot

changeset-botBot commented Mar 16, 2026

Copy link
Copy Markdown

🦋 Changeset detected

Latest commit: c3bffb0

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 16 packages
NameType
@workflow/corePatch
@workflow/buildersPatch
@workflow/cliPatch
@workflow/nextPatch
@workflow/nitroPatch
@workflow/vitestPatch
@workflow/web-sharedPatch
workflowPatch
@workflow/world-testingPatch
@workflow/astroPatch
@workflow/nestPatch
@workflow/rollupPatch
@workflow/sveltekitPatch
@workflow/vitePatch
@workflow/nuxtPatch
@workflow/aiPatch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@vercel

vercelBot commented Mar 16, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actionsBot commented Mar 16, 2026

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
❌ ▲ Vercel Production7001467781
✅ 💻 Local Development632078710
✅ 📦 Local Production632078710
❌ 🐘 Local Postgres631178710
✅ 🪟 Windows680371
❌ 🌍 Community Worlds1175415186
✅ 📋 Other186027213
Total2966693463381

❌ Failed Tests

▲ Vercel Production (14 failed)

nextjs-webpack (14 failed):

  • DurableAgent e2e core basic text response
  • DurableAgent e2e core single tool call
  • DurableAgent e2e core multiple sequential tool calls
  • DurableAgent e2e core tool error recovery
  • DurableAgent e2e onStepFinish fires constructor + stream callbacks in order with step data
  • DurableAgent e2e onFinish fires constructor + stream callbacks in order with event data
  • DurableAgent e2e instructions string instructions are passed to the model
  • DurableAgent e2e timeout completes within timeout
  • DurableAgent e2e experimental_onStart (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e experimental_onStepStart (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e experimental_onToolCallStart (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e experimental_onToolCallFinish (GAP) completes but callbacks are not called (GAP)
  • DurableAgent e2e prepareCall (GAP) completes but prepareCall is not applied (GAP)
  • DurableAgent e2e tool approval (GAP) completes but needsApproval is not checked (GAP)
🐘 Local Postgres (1 failed)

nextjs-turbopack-stable (1 failed):

  • webhookWorkflow
🌍 Community Worlds (54 failed)

mongodb (2 failed):

  • hookWorkflow is not resumable via public webhook endpoint
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously

redis (2 failed):

  • hookWorkflow is not resumable via public webhook endpoint
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously

turso (50 failed):

  • addTenWorkflow
  • addTenWorkflow
  • wellKnownAgentWorkflow (.well-known/agent)
  • should work with react rendering in step
  • promiseAllWorkflow
  • promiseRaceWorkflow
  • promiseAnyWorkflow
  • importedStepOnlyWorkflow
  • hookWorkflow
  • hookWorkflow is not resumable via public webhook endpoint
  • webhookWorkflow
  • sleepingWorkflow
  • parallelSleepWorkflow
  • nullByteWorkflow
  • workflowAndStepMetadataWorkflow
  • fetchWorkflow
  • promiseRaceStressTestWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling retry behavior RetryableError respects custom retryAfter delay
  • error handling retry behavior maxRetries=0 disables retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • concurrent hook token conflict - two workflows cannot use the same hook token simultaneously
  • hookDisposeTestWorkflow - hook token reuse after explicit disposal while workflow still running
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • closureVariableWorkflow - nested step functions with closure variables
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • health check (queue-based) - workflow and step endpoints respond to health check messages
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly
  • Calculator.calculate - static workflow method using static step methods from another class
  • AllInOneService.processNumber - static workflow method using sibling static step methods
  • ChainableService.processWithThis - static step methods using this to reference the class
  • thisSerializationWorkflow - step function invoked with .call() and .apply()
  • customSerializationWorkflow - custom class serialization with WORKFLOW_SERIALIZE/WORKFLOW_DESERIALIZE
  • instanceMethodStepWorkflow - instance methods with "use step" directive
  • crossContextSerdeWorkflow - classes defined in step code are deserializable in workflow context
  • stepFunctionAsStartArgWorkflow - step function reference passed as start() argument
  • cancelRun - cancelling a running workflow
  • cancelRun via CLI - cancelling a running workflow
  • pages router addTenWorkflow via pages router
  • pages router promiseAllWorkflow via pages router
  • pages router sleepingWorkflow via pages router
  • hookWithSleepWorkflow - hook payloads delivered correctly with concurrent sleep
  • sleepWithSequentialStepsWorkflow - sequential steps work with concurrent sleep (control)

Details by Category

❌ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro6407
✅ example6407
✅ express6407
✅ fastify6407
✅ hono6407
✅ nextjs-turbopack6902
❌ nextjs-webpack55142
✅ nitro6407
✅ nuxt6407
✅ sveltekit6407
✅ vite6407
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable6209
✅ express-stable6209
✅ fastify-stable6209
✅ hono-stable6209
✅ nextjs-turbopack-stable6803
✅ nextjs-webpack-stable6803
✅ nitro-stable6209
✅ nuxt-stable6209
✅ sveltekit-stable6209
✅ vite-stable6209
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable6209
✅ express-stable6209
✅ fastify-stable6209
✅ hono-stable6209
✅ nextjs-turbopack-stable6803
✅ nextjs-webpack-stable6803
✅ nitro-stable6209
✅ nuxt-stable6209
✅ sveltekit-stable6209
✅ vite-stable6209
❌ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable6209
✅ express-stable6209
✅ fastify-stable6209
✅ hono-stable6209
❌ nextjs-turbopack-stable6713
✅ nextjs-webpack-stable6803
✅ nitro-stable6209
✅ nuxt-stable6209
✅ sveltekit-stable6209
✅ vite-stable6209
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack6803
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev302
❌ mongodb5223
✅ redis-dev302
❌ redis5223
✅ turso-dev302
❌ turso4503
✅ 📋 Other
AppPassedFailedSkipped
✅ e2e-local-dev-nest-stable6209
✅ e2e-local-postgres-nest-stable6209
✅ e2e-local-prod-nest-stable6209

📋 View full workflow run


Some E2E test jobs failed:

  • Vercel Prod: failure
  • Local Dev: cancelled
  • Local Prod: cancelled
  • Local Postgres: failure
  • Windows: success

Check the workflow run for details.

@github-actions

github-actionsBot commented Mar 16, 2026

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Express0.041s (-3.1%)1.006s (~)0.965s101.00x
💻 LocalNitro0.041s (+1.0%)1.006s (~)0.965s101.00x
💻 LocalNext.js (Turbopack)0.049s (~)1.005s (~)0.956s101.20x
🌐 RedisNext.js (Turbopack)0.055s (+7.4% 🔺)1.005s (~)0.950s101.35x
🐘 PostgresNext.js (Turbopack)0.057s (-2.6%)1.011s (~)0.953s101.40x
🐘 PostgresNitro0.060s (+3.1%)1.011s (~)0.951s101.48x
🐘 PostgresExpress0.063s (-3.3%)1.011s (~)0.948s101.53x
🌐 MongoDBNext.js (Turbopack)0.077s (-15.5% 🟢)1.008s (~)0.931s101.88x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro0.423s (-8.6% 🟢)2.127s (+4.2%)1.704s101.00x
▲ VercelNext.js (Turbopack)0.478s (-0.8%)2.398s (-5.1% 🟢)1.920s101.13x
▲ VercelExpress0.489s (-16.4% 🟢)2.519s (-1.8%)2.030s101.16x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)1.111s (~)2.005s (~)0.894s101.00x
🌐 RedisNext.js (Turbopack)1.123s (~)2.007s (~)0.883s101.01x
💻 LocalNitro1.128s (~)2.005s (~)0.878s101.01x
💻 LocalExpress1.130s (~)2.006s (~)0.876s101.02x
🐘 PostgresNext.js (Turbopack)1.131s (-0.7%)2.012s (~)0.881s101.02x
🐘 PostgresExpress1.137s (~)2.013s (~)0.877s101.02x
🐘 PostgresNitro1.155s (+0.9%)2.013s (~)0.858s101.04x
🌐 MongoDBNext.js (Turbopack)1.306s (~)2.008s (~)0.703s101.17x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.967s (-3.6%)3.357s (-2.3%)1.391s101.00x
▲ VercelExpress2.005s (-3.6%)3.791s (+4.4%)1.787s101.02x
▲ VercelNext.js (Turbopack)2.175s (+7.0% 🔺)3.620s (-1.2%)1.446s101.11x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Redis🥇 Next.js (Turbopack)10.742s (~)11.023s (~)0.281s31.00x
💻 LocalNext.js (Turbopack)10.745s (-0.6%)11.025s (~)0.280s31.00x
💻 LocalExpress10.879s (~)11.023s (~)0.143s31.01x
💻 LocalNitro10.900s (~)11.023s (~)0.123s31.01x
🐘 PostgresNitro10.923s (~)11.046s (~)0.123s31.02x
🐘 PostgresNext.js (Turbopack)10.954s (+1.2%)11.040s (~)0.086s31.02x
🐘 PostgresExpress10.970s (+0.5%)11.042s (~)0.072s31.02x
🌐 MongoDBNext.js (Turbopack)12.268s (~)13.023s (~)0.755s31.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro16.628s (-9.8% 🟢)17.871s (-9.7% 🟢)1.243s21.00x
▲ VercelExpress16.966s (-0.8%)18.610s (~)1.644s21.02x
▲ VercelNext.js (Turbopack)17.087s (+0.7%)18.328s (-5.2% 🟢)1.241s21.03x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

workflow with 25 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Redis🥇 Next.js (Turbopack)26.768s (~)27.050s (~)0.282s31.00x
🐘 PostgresNext.js (Turbopack)26.942s (~)27.058s (-1.2%)0.116s31.01x
💻 LocalNext.js (Turbopack)26.979s (~)27.050s (-2.4%)0.071s31.01x
🐘 PostgresExpress27.254s (~)28.069s (+1.2%)0.816s31.02x
🐘 PostgresNitro27.255s (+0.5%)28.069s (~)0.814s31.02x
💻 LocalExpress27.401s (~)28.052s (~)0.651s31.02x
💻 LocalNitro27.476s (~)28.052s (~)0.576s31.03x
🌐 MongoDBNext.js (Turbopack)30.468s (~)31.038s (~)0.570s21.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express43.376s (-0.7%)44.820s (-1.3%)1.444s21.00x
▲ VercelNext.js (Turbopack)44.554s (-2.5%)46.176s (-2.5%)1.622s21.03x
▲ VercelNitro45.146s (+1.5%)46.514s (+1.3%)1.368s21.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 50 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Redis🥇 Next.js (Turbopack)53.346s (~)54.098s (~)0.753s21.00x
🐘 PostgresNext.js (Turbopack)53.905s (~)54.099s (-0.9%)0.194s21.01x
🐘 PostgresExpress54.285s (~)55.099s (~)0.813s21.02x
🐘 PostgresNitro54.307s (~)55.103s (~)0.796s21.02x
💻 LocalNext.js (Turbopack)55.569s (-0.9%)56.102s (-0.9%)0.533s21.04x
💻 LocalExpress56.432s (~)57.097s (~)0.665s21.06x
💻 LocalNitro56.732s (~)57.104s (~)0.372s21.06x
🌐 MongoDBNext.js (Turbopack)60.563s (~)61.042s (-0.9%)0.479s21.14x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express92.552s (~)94.191s (+0.6%)1.639s11.00x
▲ VercelNitro95.117s (+0.9%)96.923s (~)1.806s11.03x
▲ VercelNext.js (Turbopack)97.046s (+5.4% 🔺)99.712s (+5.9% 🔺)2.666s11.05x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Redis🥇 Next.js (Turbopack)1.309s (-3.7%)2.007s (~)0.697s151.00x
🐘 PostgresExpress1.405s (-0.6%)2.011s (~)0.606s151.07x
🐘 PostgresNext.js (Turbopack)1.435s (-4.9%)2.011s (~)0.576s151.10x
🐘 PostgresNitro1.436s (+2.4%)2.012s (~)0.577s151.10x
💻 LocalNitro1.473s (~)2.005s (~)0.532s151.12x
💻 LocalNext.js (Turbopack)1.489s (-2.0%)2.006s (~)0.517s151.14x
💻 LocalExpress1.508s (-0.9%)2.005s (~)0.497s151.15x
🌐 MongoDBNext.js (Turbopack)2.146s (-0.7%)3.009s (~)0.863s101.64x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.364s (-6.1% 🟢)3.550s (-7.6% 🟢)1.187s91.00x
▲ VercelExpress2.417s (-2.7%)3.896s (-2.0%)1.478s81.02x
▲ VercelNext.js (Turbopack)2.523s (+9.6% 🔺)3.934s (+7.1% 🔺)1.411s81.07x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Express2.569s (-1.1%)3.013s (~)0.444s101.00x
🐘 PostgresNitro2.579s (+2.1%)3.012s (~)0.434s101.00x
🌐 RedisNext.js (Turbopack)2.582s (+1.5%)3.008s (~)0.426s101.00x
🐘 PostgresNext.js (Turbopack)2.614s (-1.5%)3.012s (-3.2%)0.398s101.02x
💻 LocalNext.js (Turbopack)2.754s (-9.5% 🟢)3.108s (-17.4% 🟢)0.353s101.07x
💻 LocalExpress2.928s (+2.9%)3.308s (+10.0% 🔺)0.380s101.14x
💻 LocalNitro2.942s (~)3.564s (+11.1% 🔺)0.622s91.15x
🌐 MongoDBNext.js (Turbopack)4.734s (~)5.177s (~)0.443s61.84x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.495s (-2.0%)3.688s (-8.4% 🟢)1.193s91.00x
▲ VercelNitro2.718s (+17.6% 🔺)3.854s (+10.6% 🔺)1.135s81.09x
▲ VercelExpress3.079s (+22.6% 🔺)4.485s (+14.7% 🔺)1.406s71.23x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro3.967s (~)4.444s (+3.3%)0.477s71.00x
🐘 PostgresExpress4.043s (+1.6%)4.445s (-3.1%)0.402s71.02x
🌐 RedisNext.js (Turbopack)4.168s (+1.0%)4.868s (~)0.700s71.05x
🐘 PostgresNext.js (Turbopack)4.208s (-1.4%)5.015s (~)0.807s61.06x
💻 LocalNext.js (Turbopack)7.736s (+3.0%)8.267s (~)0.531s41.95x
💻 LocalExpress7.775s (-2.8%)8.017s (-5.9% 🟢)0.242s41.96x
💻 LocalNitro8.209s (+1.8%)9.021s (+5.9% 🔺)0.813s42.07x
🌐 MongoDBNext.js (Turbopack)9.988s (+2.6%)10.685s (+3.3%)0.697s32.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.973s (+1.4%)4.305s (+1.5%)1.332s81.00x
▲ VercelExpress3.082s (+9.1% 🔺)4.494s (+5.9% 🔺)1.412s71.04x
▲ VercelNext.js (Turbopack)4.176s (+35.1% 🔺)5.346s (+13.1% 🔺)1.170s61.40x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Redis🥇 Next.js (Turbopack)1.291s (+1.4%)2.007s (~)0.715s151.00x
🐘 PostgresExpress1.403s (~)2.010s (~)0.607s151.09x
🐘 PostgresNext.js (Turbopack)1.428s (-0.7%)2.012s (~)0.583s151.11x
🐘 PostgresNitro1.481s (+4.4%)2.011s (~)0.530s151.15x
💻 LocalNext.js (Turbopack)1.513s (~)2.006s (~)0.493s151.17x
💻 LocalExpress1.523s (+0.9%)2.005s (~)0.483s151.18x
💻 LocalNitro1.571s (+2.9%)2.006s (~)0.435s151.22x
🌐 MongoDBNext.js (Turbopack)2.178s (-1.2%)3.008s (~)0.830s101.69x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.249s (-1.9%)3.570s (-2.1%)1.320s91.00x
▲ VercelExpress2.264s (-2.4%)3.779s (-1.9%)1.515s81.01x
▲ VercelNext.js (Turbopack)2.268s (+1.8%)3.710s (-2.7%)1.442s91.01x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Redis🥇 Next.js (Turbopack)2.561s (~)3.009s (~)0.448s101.00x
🐘 PostgresNext.js (Turbopack)2.575s (~)3.012s (~)0.436s101.01x
🐘 PostgresExpress2.592s (-0.5%)3.012s (~)0.421s101.01x
🐘 PostgresNitro2.601s (~)3.013s (~)0.412s101.02x
💻 LocalExpress2.922s (-7.2% 🟢)3.452s (-11.1% 🟢)0.530s91.14x
💻 LocalNext.js (Turbopack)2.948s (+5.8% 🔺)3.208s (-4.0%)0.260s101.15x
💻 LocalNitro3.052s (-2.8%)4.011s (+3.2%)0.959s81.19x
🌐 MongoDBNext.js (Turbopack)4.716s (+1.3%)5.177s (~)0.461s61.84x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro2.407s (-5.9% 🟢)3.499s (-4.8%)1.093s91.00x
▲ VercelExpress2.545s (+6.8% 🔺)4.059s (+5.3% 🔺)1.514s81.06x
▲ VercelNext.js (Turbopack)2.597s (-1.2%)3.936s (-5.2% 🟢)1.340s81.08x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Promise.race with 50 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🐘 Postgres🥇 Nitro3.948s (-1.1%)4.445s (-3.1%)0.497s71.00x
🐘 PostgresExpress4.105s (~)4.588s (~)0.482s71.04x
🌐 RedisNext.js (Turbopack)4.219s (+2.1%)5.012s (~)0.793s61.07x
🐘 PostgresNext.js (Turbopack)4.277s (+2.2%)5.016s (~)0.740s61.08x
💻 LocalNext.js (Turbopack)7.913s (+3.2%)8.268s (~)0.355s42.00x
💻 LocalExpress8.268s (-2.5%)9.022s (~)0.754s42.09x
💻 LocalNitro8.934s (+1.9%)9.522s (+5.6% 🔺)0.588s42.26x
🌐 MongoDBNext.js (Turbopack)9.936s (-1.6%)10.682s (+3.2%)0.746s32.52x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express2.810s (-10.9% 🟢)4.011s (-14.9% 🟢)1.201s81.00x
▲ VercelNitro3.073s (-1.1%)4.315s (+4.9%)1.242s71.09x
▲ VercelNext.js (Turbopack)3.359s (+1.7%)5.016s (+6.0% 🔺)1.657s71.20x

🔍 Observability: Express | Nitro | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)0.168s (-7.1% 🟢)1.002s (~)0.011s (-4.5%)1.017s (~)0.849s101.00x
🌐 RedisNext.js (Turbopack)0.175s (+4.7%)1.000s (~)0.001s (-22.2% 🟢)1.007s (~)0.832s101.04x
💻 LocalExpress0.197s (+1.5%)1.003s (~)0.011s (+1.8%)1.017s (~)0.821s101.17x
💻 LocalNitro0.200s (+2.8%)1.003s (~)0.011s (~)1.018s (~)0.818s101.19x
🐘 PostgresNext.js (Turbopack)0.200s (~)1.001s (~)0.002s (-6.3% 🟢)1.013s (~)0.813s101.19x
🐘 PostgresNitro0.221s (~)0.996s (~)0.002s (-25.0% 🟢)1.013s (~)0.792s101.32x
🐘 PostgresExpress0.222s (+1.3%)0.994s (~)0.001s (-21.4% 🟢)1.012s (~)0.790s101.32x
🌐 MongoDBNext.js (Turbopack)0.501s (+3.1%)0.963s (~)0.002s (-11.1% 🟢)1.009s (~)0.509s102.99x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro1.665s (+8.2% 🔺)2.663s (+6.4% 🔺)0.004s (-12.0% 🟢)3.158s (+6.3% 🔺)1.493s101.00x
▲ VercelExpress1.707s (+9.6% 🔺)2.612s (+13.0% 🔺)0.005s (+6.5% 🔺)3.202s (+11.9% 🔺)1.495s101.03x
▲ VercelNext.js (Turbopack)1.814s (+9.3% 🔺)2.561s (+11.0% 🔺)0.015s (+198.0% 🔺)3.156s (+10.6% 🔺)1.341s101.09x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)9/12
🐘 PostgresNext.js (Turbopack)6/12
▲ VercelNitro8/12
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express🐘 Postgres5/12
Next.js (Turbopack)🌐 Redis7/12
Nitro🐘 Postgres5/12
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

Signed-off-by: Peter Wielander <mittgfu@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@VaguelySerious@pranaygp