Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Friendlier and actionable error messages by Schniz · Pull Request #706 · vercel/workflow · GitHub
Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Friendlier and actionable error messages by Schniz · Pull Request #706 · vercel/workflow · GitHub
Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Friendlier and actionable error messages by Schniz · Pull Request #706 · vercel/workflow · GitHub
Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' Friendlier and actionable error messages by Schniz · Pull Request #706 · vercel/workflow · GitHub
Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' Friendlier and actionable error messages by Schniz · Pull Request #706 · vercel/workflow · GitHub
Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); })(); Friendlier and actionable error messages by Schniz · Pull Request #706 · vercel/workflow · GitHub
Skip to content

Friendlier and actionable error messages - #706

Closed
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages
Closed

Friendlier and actionable error messages#706
Schniz wants to merge 29 commits into
mainfrom
schniz/rework-on-error-messages

Conversation

@Schniz

@SchnizSchniz commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

Description

This is, I hope, a beginning of a journey to have world class error messages. It's easy to think of the happy path when we build exciting things, but if not handled correctly and with care, the sad path is indeed sad and weird.

Example:

`getWorkflowMetadata()` can only be called inside a workflow or step function
╰▶ help: This function comes from Workflow DevKit, and requires to be used as a part of a workflow or a step,
As it has no meaning outside of the workflow context.
Read more: https://useworkflow.dev/docs/api-reference/workflow/get-workflow-metadata

The idea is to have structure based on Wix's blog post about the subject that encapsulates a good error into multiple requirements:

  • Say what happened
  • Provide reassurance (if needed)
  • Explain why it happened
  • Give a way out
  • Help fix it

I also added an ansi output helper to @workflow/errors so we can reuse it everywhere and provide structure to the errors so you know that a set of multiline strings are indeed related.

How did you test your changes?

with the hono example:

  • xh POST 'localhost:3000/.well-known/workflow/v1/step' x-vqs-queue-name:__wkf_step_step//my-file.ts//stepName x-vqs-message-id:msg_hello x-vqs-message-attempt:1 stepId=step_abc123 workflowName=mywf workflowRunId=wrun_123 workflowStartedAt:=$(Date_now)

PR Checklist - Required to merge

  • 📦 pnpm changeset was run to create a changelog for this PR
    • During beta, we only use "patch" mode for changes. Don't tag minor/major versions.
    • Use pnpm changeset --empty if you are changing documentation or workbench apps
  • 🔒 DCO sign-off passes (run git commit --signoff on your commits)

@SchnizSchniz self-assigned this Dec 30, 2025
@changeset-bot

changeset-botBot commented Dec 30, 2025

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: 73c9b33

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@vercel

vercelBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

The latest updates on your projects. Learn more about Vercel for GitHub.

ProjectDeploymentReviewUpdated (UTC)
example-nextjs-workflow-turbopackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-nextjs-workflow-webpackReadyReadyPreview, CommentJan 8, 2026 11:37pm
example-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-astro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-express-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-fastify-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-hono-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nitro-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-nuxt-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-sveltekit-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
workbench-vite-workflowReadyReadyPreview, CommentJan 8, 2026 11:37pm
1 Skipped Deployment
ProjectDeploymentReviewUpdated (UTC)
workflow-docsSkippedSkippedJan 8, 2026 11:37pm

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

📊 Benchmark Results

📈 Comparing against baseline from main branch. Green 🟢 = faster, Red 🔺 = slower.

workflow with no steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.037s (+3.1%)1.014s (~)0.977s101.00x
🌐 RedisNext.js (Turbopack)0.039s (-7.6% 🟢)1.016s (~)0.977s101.05x
💻 LocalNext.js (Turbopack)0.040s (+7.2% 🔺)1.015s (~)0.975s101.08x
💻 LocalNitro0.044s (+4.0%)1.006s (~)0.962s101.19x
💻 LocalExpress0.049s (+16.0% 🔺)1.008s (~)0.959s101.31x
🌐 TursoNext.js (Turbopack)0.093s (-9.5% 🟢)1.014s (~)0.921s102.50x
🌐 MongoDBNext.js (Turbopack)0.105s (+16.6% 🔺)1.015s (~)0.910s102.82x
🐘 PostgresNitro0.261s (+7.8% 🔺)1.020s (-1.7%)0.759s107.03x
🐘 PostgresExpress0.293s (-7.2% 🟢)1.014s (~)0.720s107.91x
🐘 PostgresNext.js (Turbopack)0.329s (+70.0% 🔺)1.023s (~)0.694s108.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Express0.602s (-20.0% 🟢)1.528s (-1.4%)0.925s101.00x
▲ VercelNext.js (Turbopack)0.622s (-18.7% 🟢)1.680s (+2.0%)1.058s101.03x
▲ VercelNitro0.628s (-43.8% 🟢)1.516s (-23.8% 🟢)0.888s101.04x

🔍 Observability: Express | Next.js (Turbopack) | Nitro

workflow with 1 step

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.087s (~)2.010s (~)0.923s101.00x
💻 LocalNext.js (Turbopack)1.095s (~)2.011s (~)0.917s101.01x
🌐 RedisNext.js (Turbopack)1.096s (-0.6%)2.013s (~)0.917s101.01x
💻 LocalNitro1.115s (+0.6%)2.006s (~)0.891s101.03x
💻 LocalExpress1.122s (+0.8%)2.007s (~)0.885s101.03x
🌐 TursoNext.js (Turbopack)1.314s (+0.7%)2.013s (~)0.698s101.21x
🌐 MongoDBNext.js (Turbopack)1.330s (+2.2%)2.013s (~)0.683s101.22x
🐘 PostgresNext.js (Turbopack)1.825s (-4.1%)2.017s (~)0.193s101.68x
🐘 PostgresNitro2.132s (-7.5% 🟢)3.013s (~)0.880s101.96x
🐘 PostgresExpress2.146s (-0.7%)3.014s (~)0.869s101.97x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.747s (-0.6%)3.785s (+3.3%)1.038s101.00x
▲ VercelNitro2.779s (+1.2%)3.606s (+1.1%)0.827s101.01x
▲ VercelExpress2.818s (-5.8% 🟢)3.742s (-1.7%)0.924s101.03x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

workflow with 10 sequential steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)10.596s (~)11.010s (~)0.414s51.00x
💻 LocalNext.js (Turbopack)10.650s (~)11.014s (~)0.364s51.01x
🌐 RedisNext.js (Turbopack)10.684s (~)11.015s (~)0.331s51.01x
💻 LocalNitro10.793s (~)11.012s (~)0.219s51.02x
💻 LocalExpress10.849s (+0.5%)11.015s (~)0.166s51.02x
🌐 TursoNext.js (Turbopack)12.186s (~)13.021s (~)0.836s51.15x
🌐 MongoDBNext.js (Turbopack)12.227s (~)13.025s (~)0.798s51.15x
🐘 PostgresNext.js (Turbopack)15.129s (-0.8%)16.041s (~)0.912s51.43x
🐘 PostgresExpress20.488s (~)21.030s (~)0.542s51.93x
🐘 PostgresNitro20.504s (+11.8% 🔺)21.026s (+10.4% 🔺)0.522s51.93x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)22.114s (-0.5%)22.937s (-1.3%)0.823s51.00x
▲ VercelExpress22.432s (-2.2%)23.161s (-1.8%)0.729s51.01x
▲ VercelNitro22.774s (~)23.368s (~)0.595s51.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.all with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.344s (~)2.008s (~)0.664s151.00x
🌐 RedisNext.js (Turbopack)1.355s (-0.7%)2.011s (~)0.656s151.01x
💻 LocalNext.js (Turbopack)1.383s (+2.2%)2.012s (~)0.628s151.03x
💻 LocalNitro1.414s (+1.1%)2.005s (~)0.592s151.05x
💻 LocalExpress1.438s (+1.4%)2.008s (~)0.570s151.07x
🐘 PostgresNext.js (Turbopack)1.782s (-4.9%)2.013s (-3.3%)0.231s151.33x
🌐 MongoDBNext.js (Turbopack)2.127s (-2.2%)3.014s (~)0.887s101.58x
🌐 TursoNext.js (Turbopack)2.219s (~)3.011s (~)0.792s101.65x
🐘 PostgresExpress2.415s (+1.3%)3.013s (~)0.598s101.80x
🐘 PostgresNitro2.514s (+33.7% 🔺)3.011s (+44.9% 🔺)0.498s101.87x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)3.179s (+4.6%)4.002s (+2.9%)0.823s81.00x
▲ VercelNitro3.322s (+20.3% 🔺)4.074s (-2.5%)0.752s81.04x
▲ VercelExpress3.482s (-2.7%)4.569s (~)1.087s71.10x

🔍 Observability: Next.js (Turbopack) | Nitro | Express

Promise.all with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.034s (+0.7%)2.832s (+1.4%)0.797s111.00x
💻 LocalNitro2.234s (+4.0%)3.188s (+2.5%)0.955s101.10x
💻 LocalExpress2.271s (+1.6%)3.224s (+1.3%)0.953s101.12x
🌐 StarterNext.js (Turbopack)2.457s (~)3.009s (~)0.552s101.21x
🌐 RedisNext.js (Turbopack)2.495s (-1.0%)3.013s (~)0.518s101.23x
🐘 PostgresExpress2.674s (-14.0% 🟢)3.114s (-17.4% 🟢)0.441s101.31x
🐘 PostgresNext.js (Turbopack)2.704s (+8.0% 🔺)3.028s (~)0.324s101.33x
🐘 PostgresNitro3.271s (+15.7% 🔺)4.013s (+33.2% 🔺)0.742s81.61x
🌐 TursoNext.js (Turbopack)4.614s (-1.2%)5.183s (~)0.569s62.27x
🌐 MongoDBNext.js (Turbopack)4.662s (-1.0%)5.185s (~)0.523s62.29x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro4.110s (-1.5%)5.059s (+3.8%)0.949s61.00x
▲ VercelNext.js (Turbopack)4.644s (+25.5% 🔺)5.459s (+23.7% 🔺)0.816s61.13x
▲ VercelExpress4.927s (+21.0% 🔺)5.989s (+26.8% 🔺)1.062s61.20x

🔍 Observability: Nitro | Next.js (Turbopack) | Express

Promise.race with 10 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)1.364s (+0.6%)2.008s (~)0.644s151.00x
💻 LocalNext.js (Turbopack)1.390s (-1.3%)2.012s (~)0.622s151.02x
🌐 RedisNext.js (Turbopack)1.397s (+1.0%)2.012s (~)0.615s151.02x
💻 LocalNitro1.415s (+1.2%)2.005s (~)0.590s151.04x
💻 LocalExpress1.443s (+1.4%)2.007s (~)0.564s151.06x
🐘 PostgresNext.js (Turbopack)1.632s (-5.2% 🟢)2.012s (~)0.380s151.20x
🐘 PostgresExpress1.649s (-20.1% 🟢)2.010s (-13.5% 🟢)0.361s151.21x
🐘 PostgresNitro2.048s (+19.9% 🔺)2.678s (+33.1% 🔺)0.630s121.50x
🌐 MongoDBNext.js (Turbopack)2.123s (~)3.013s (~)0.890s101.56x
🌐 TursoNext.js (Turbopack)2.217s (~)3.027s (+0.5%)0.810s101.63x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.736s (-4.4%)3.756s (-1.2%)1.021s81.00x
▲ VercelExpress2.895s (+1.1%)3.809s (+2.8%)0.914s81.06x
▲ VercelNitro4.625s (+69.0% 🔺)5.425s (+51.4% 🔺)0.800s61.69x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Promise.race with 25 concurrent steps

💻 Local Development

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
💻 Local🥇 Next.js (Turbopack)2.052s (-3.0%)2.971s (-2.0%)0.918s111.00x
💻 LocalNitro2.248s (+1.9%)3.178s (~)0.929s101.10x
💻 LocalExpress2.297s (+3.1%)3.222s (+1.4%)0.925s101.12x
🌐 RedisNext.js (Turbopack)2.469s (-1.6%)3.012s (~)0.543s101.20x
🌐 StarterNext.js (Turbopack)2.477s (+1.3%)3.042s (+1.1%)0.565s101.21x
🐘 PostgresNext.js (Turbopack)2.502s (-1.7%)3.024s (~)0.522s101.22x
🐘 PostgresExpress2.634s (+8.9% 🔺)3.039s (+0.9%)0.405s101.28x
🐘 PostgresNitro2.830s (-1.7%)3.369s (+11.9% 🔺)0.539s91.38x
🌐 TursoNext.js (Turbopack)4.700s (+1.2%)5.185s (~)0.485s62.29x
🌐 MongoDBNext.js (Turbopack)4.780s (+2.9%)5.181s (~)0.401s62.33x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Nitro3.378s (+1.1%)4.045s (+3.6%)0.666s81.00x
▲ VercelExpress3.421s (+5.7% 🔺)3.907s (+0.8%)0.486s81.01x
▲ VercelNext.js (Turbopack)3.512s (+2.4%)4.334s (+6.5% 🔺)0.822s71.04x

🔍 Observability: Nitro | Express | Next.js (Turbopack)

Stream Benchmarks(includes TTFB metrics)
workflow with stream

💻 Local Development

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
🌐 Starter🥇 Next.js (Turbopack)0.126s (+3.9%)1.005s (~)0.000s (+100.0% 🔺)1.012s (~)0.887s101.00x
💻 LocalNext.js (Turbopack)0.139s (+7.3% 🔺)1.003s (~)0.016s (+5.4% 🔺)1.026s (~)0.887s101.11x
🌐 RedisNext.js (Turbopack)0.146s (-6.9% 🟢)1.005s (~)0.000s (+Infinity% 🔺)1.013s (~)0.868s101.16x
💻 LocalNitro0.176s (+1.7%)0.992s (~)0.015s (-6.3% 🟢)1.021s (~)0.845s101.40x
💻 LocalExpress0.188s (+4.5%)0.992s (~)0.018s (+12.4% 🔺)1.026s (~)0.838s101.49x
🌐 MongoDBNext.js (Turbopack)0.449s (-11.1% 🟢)0.999s (+6.0% 🔺)0.000s (+Infinity% 🔺)1.013s (~)0.564s103.57x
🌐 TursoNext.js (Turbopack)0.502s (+9.0% 🔺)0.948s (-4.1%)0.000s (NaN%)1.013s (~)0.511s103.99x
🐘 PostgresNext.js (Turbopack)0.861s (-24.1% 🟢)0.705s (-64.1% 🟢)0.003s (+Infinity% 🔺)1.020s (-49.4% 🟢)0.159s106.86x
🐘 PostgresExpress2.339s (+1.2%)2.697s (-1.3%)0.000s (NaN%)3.014s (~)0.675s1018.63x
🐘 PostgresNitro2.380s (+68.2% 🔺)2.664s (+63.0% 🔺)0.000s (NaN%)3.013s (+49.6% 🔺)0.633s1018.95x

▲ Production (Vercel)

WorldFrameworkWorkflow TimeTTFBSlurpWall TimeOverheadSamplesvs Fastest
▲ Vercel🥇 Next.js (Turbopack)2.740s (~)3.288s (+1.6%)0.295s (-18.5% 🟢)4.023s (~)1.283s101.00x
▲ VercelExpress2.802s (+1.4%)3.231s (+2.7%)0.321s (-25.5% 🟢)4.023s (~)1.221s101.02x
▲ VercelNitro2.830s (+3.6%)3.189s (+3.2%)0.539s (+14.9% 🔺)4.195s (+5.7% 🔺)1.365s101.03x

🔍 Observability: Next.js (Turbopack) | Express | Nitro

Summary

Fastest Framework by World

Winner determined by most benchmark wins

World🥇 Fastest FrameworkWins
💻 LocalNext.js (Turbopack)8/8
🐘 PostgresNext.js (Turbopack)6/8
▲ VercelNext.js (Turbopack)5/8
Fastest World by Framework

Winner determined by most benchmark wins

Framework🥇 Fastest WorldWins
Express💻 Local8/8
Next.js (Turbopack)🌐 Starter6/8
Nitro💻 Local8/8
Column Definitions
  • Workflow Time: Runtime reported by workflow (completedAt - createdAt) - primary metric
  • TTFB: Time to First Byte - time from workflow start until first stream byte received (stream benchmarks only)
  • Slurp: Time from first byte to complete stream consumption (stream benchmarks only)
  • Wall Time: Total testbench time (trigger workflow + poll for result)
  • Overhead: Testbench overhead (Wall Time - Workflow Time)
  • Samples: Number of benchmark iterations run
  • vs Fastest: How much slower compared to the fastest configuration for this benchmark

Worlds:

  • 💻 Local: In-memory filesystem world (local development)
  • 🐘 Postgres: PostgreSQL database world (local development)
  • ▲ Vercel: Vercel production/preview deployment
  • 🌐 Starter: Community world (local development)
  • 🌐 Turso: Community world (local development)
  • 🌐 MongoDB: Community world (local development)
  • 🌐 Redis: Community world (local development)
  • 🌐 Jazz: Community world (local development)

📋 View full workflow run

@github-actions

github-actionsBot commented Dec 30, 2025

Copy link
Copy Markdown
Contributor

🧪 E2E Test Results

Some tests failed

Summary

PassedFailedSkippedTotal
✅ ▲ Vercel Production363011374
✅ 💻 Local Development33208340
✅ 📦 Local Production33208340
✅ 🐘 Local Postgres33208340
✅ 🪟 Windows340034
❌ 🌍 Community Worlds131170148
Total152417351576

❌ Failed Tests

🌍 Community Worlds (17 failed)

mongodb (1 failed):

  • webhookWorkflow

redis (1 failed):

  • webhookWorkflow

starter (14 failed):

  • addTenWorkflow
  • addTenWorkflow
  • error handling error propagation workflow errors nested function calls preserve message and stack trace
  • error handling error propagation workflow errors cross-file imports preserve message and stack trace
  • error handling error propagation step errors basic step error preserves message and stack trace
  • error handling error propagation step errors cross-file step error preserves message and function names in stack
  • error handling retry behavior regular Error retries until success
  • error handling retry behavior FatalError fails immediately without retries
  • error handling catchability FatalError can be caught and detected with FatalError.is()
  • hookCleanupTestWorkflow - hook token reuse after workflow completion
  • stepFunctionPassingWorkflow - step function references can be passed as arguments (without closure vars)
  • stepFunctionWithClosureWorkflow - step function with closure variables passed as argument
  • spawnWorkflowFromStepWorkflow - spawning a child workflow using start() inside a step
  • pathsAliasWorkflow - TypeScript path aliases resolve correctly

turso (1 failed):

  • webhookWorkflow

Details by Category

✅ ▲ Vercel Production
AppPassedFailedSkipped
✅ astro3301
✅ example3301
✅ express3301
✅ fastify3301
✅ hono3301
✅ nextjs-turbopack3301
✅ nextjs-webpack3301
✅ nitro3301
✅ nuxt3301
✅ sveltekit3301
✅ vite3301
✅ 💻 Local Development
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 📦 Local Production
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🐘 Local Postgres
AppPassedFailedSkipped
✅ astro-stable3301
✅ express-stable3301
✅ fastify-stable3301
✅ hono-stable3301
✅ nextjs-turbopack-stable3400
✅ nextjs-webpack-stable3400
✅ nitro-stable3301
✅ nuxt-stable3301
✅ sveltekit-stable3301
✅ vite-stable3301
✅ 🪟 Windows
AppPassedFailedSkipped
✅ nextjs-turbopack3400
❌ 🌍 Community Worlds
AppPassedFailedSkipped
✅ mongodb-dev300
❌ mongodb3310
✅ redis-dev300
❌ redis3310
✅ starter-dev300
❌ starter20140
✅ turso-dev300
❌ turso3310

📋 View full workflow run

vercel[bot]

This comment was marked as resolved.

Comment threadpackages/world/src/queue.ts Outdated
Schniz added 18 commits January 8, 2026 09:40
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
Signed-off-by: Gal Schlezinger <gal@spitfire.co.il>
@socket-security

socket-securityBot commented Jan 8, 2026

Copy link
Copy Markdown

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

DiffPackageSupply Chain
Security
VulnerabilityQualityMaintenanceLicense
Addednpm/​rimraf@​6.1.210010010085100

View full report

@pranaygp

pranaygp commented Apr 24, 2026

Copy link
Copy Markdown
Contributor

Superseded by #1831 + #1832 (sorry this went stale @Schniz - claude worked in all your changes)

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@Schniz@pranaygp@TooTallNate