Skip to content

fix(console): stream zen request bodies - #44429

Merged
thdxr merged 1 commit into
devfrom
stream-zen-bodies
Aug 23, 2026
Merged

fix(console): stream zen request bodies#44429
thdxr merged 1 commit into
devfrom
stream-zen-bodies

Conversation

@thdxr

Copy link
Copy Markdown
Member

Summary

  • stream Zen request bodies upstream after bounded prefix inspection
  • patch provider model without materializing the complete JSON body
  • remove provider retries and format conversion for the single-provider path
  • infer response streaming from upstream content type

Verification

  • bun run typecheck in packages/console/app
  • bun test test/requestBody.test.ts test/rateLimiter.test.ts
  • repository pre-push typecheck

Rollout

Cloudflare previously regressed with synthetic request streams, so monitor exceededMemory immediately after production deployment.

@thdxr
thdxr merged commit 32c3637 into devAug 23, 2026
10 checks passed
@thdxr
thdxr deleted the stream-zen-bodies branch August 23, 2026 15:18
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@thdxr