chore(deps): update dependency litellm to v1.84.0

[dev-mend-for-github-com]

ℹ️ Note

This PR body was truncated due to platform limits.

This PR contains the following updates:

Package	Type	Update	Change
litellm	dependencies	minor	1.17.9 → 1.84.0

By merging this PR, the below vulnerabilities will be automatically resolved:

Severity	CVSS Score	Vulnerability	Reachability
Critical	9.8	CVE-2024-4264
Critical	9.8	CVE-2024-5751
High	8.2	CVE-2026-59822
High	8.1	CVE-2025-0628
High	8.1	CVE-2026-59820
High	7.5	CVE-2024-10188
High	7.5	CVE-2024-8984
High	7.5	CVE-2024-9606
High	7.5	CVE-2025-0330
Medium	6.5	CVE-2024-4888
Medium	6.4	CVE-2024-5225
Medium	5.3	CVE-2024-5710
Medium	4.9	CVE-2024-4890
Medium	4.7	CVE-2026-59821
Low	2.7	CVE-2026-59819

By merging this PR, the below vulnerabilities will be automatically resolved:

Severity	CVSS Score	Vulnerability	Reachability
Critical	9.8	CVE-2024-4264
Critical	9.8	CVE-2024-5751
High	8.2	CVE-2026-59822
High	8.1	CVE-2025-0628
High	8.1	CVE-2026-59820
High	7.5	CVE-2024-10188
High	7.5	CVE-2024-8984
High	7.5	CVE-2024-9606
High	7.5	CVE-2025-0330
Medium	6.5	CVE-2024-4888
Medium	6.4	CVE-2024-5225
Medium	5.3	CVE-2024-5710
Medium	4.9	CVE-2024-4890
Medium	4.7	CVE-2026-59821
Low	2.7	CVE-2026-59819

---

Release Notes

BerriAI/litellm (litellm)

v1.84.0

⚠️Heads up — this release contains breaking changes.
Read the full release notes here: v1.84.0 release notes

---

Verify Docker Image Signature

All LiteLLM Docker images are signed with cosign. Every release is signed with the same key introduced in commit 0112e53.

Verify using the pinned commit hash (recommended):

A commit hash is cryptographically immutable, so this is the strongest way to ensure you are using the original signing key:

cosign verify \
--key https://raw.githubusercontent.com/BerriAI/litellm/0112e53046018d726492c814b3644b7d376029d0/cosign.pub \
ghcr.io/berriai/litellm:v1.84.0

Verify using the release tag (convenience):

Tags are protected in this repository and resolve to the same key. This option is easier to read but relies on tag protection rules:

cosign verify \
--key https://raw.githubusercontent.com/BerriAI/litellm/v1.84.0/cosign.pub \
ghcr.io/berriai/litellm:v1.84.0

Expected output:

The following checks were performed on each of these signatures:
- The cosign claims were validated
- The signatures were verified against the specified public key

---

What's Changed

• merge main by @​Sameerlite in #​25521
• merge litellm_internal_staging by @​Sameerlite in #​25949
• merge main by @​Sameerlite in #​26304
• merge main by @​Sameerlite in #​26379
• merge main by @​Sameerlite in #​26437
• fix(redis): cache GCP IAM token to prevent async event loop blocking by @​harish-berri in #​26441
• litellm oss branch by @​krrish-berri-2 in #​26386
• fix noma v2 deepcopy crashing in build scan payload - new PR by @​omriShukrun08 in #​26605
• fix(ui): use stored-credentials endpoint for tools fetch on MCP edit page by @​ryan-crabbe-berri in #​26002
• feat(proxy): add --timeout_worker_healthcheck flag for uvicorn worker triage by @​ryan-crabbe-berri in #​26622
• fix(ci): support CircleCI rerun failed tests for local_testing jobs by @​mateo-berri in #​26461
• docs: update pull_request_template to add Linear ticket mentioning by @​mateo-berri in #​26655
• fix(pricing): GPT-5.5 Pro Pricing by @​lmcdonald-godaddy in #​26651
• feat(proxy): Add cleanup job for expired LiteLLM dashboard session keys by @​milan-berri in #​26460
• fix(ui): move 'Store Prompts in Spend Logs' toggle to Admin Settings by @​ryan-crabbe-berri in #​26631
• fix(caching): preserve prompt_tokens_details through embedding cache round-trip by @​michelligabriele in #​26653
• feat(logging): add retry settings for generic API logger by @​milan-berri in #​26645
• fix(logging): backfill streaming hidden response cost by @​milan-berri in #​26606
• fix(vertex-ai): reuse anthropic messages config instances by @​Sameerlite in #​26099
• fix(vertex): preserve items on array branches in anyOf with null + de-flake test by @​yuneng-berri in #​26675
• fix(tests): replace deprecated Bedrock Claude 3.7 Sonnet model ID by @​ryan-crabbe-berri in #​26721
• [Fix] Cache LiteLLM_Config param reads in DualCache and batch by @​Michael-RZ-Berri in #​26469
• [Feat] Lazy-load optional feature routers on first request by @​Michael-RZ-Berri in #​26534
• [Fix] Unify cost calc in success_handler dict and typed branches by @​Michael-RZ-Berri in #​26629
• Revert "[Feat] Lazy-load optional feature routers on first request" by @​krrish-berri-2 in #​26727
• [Infra] Version Bump by @​yuneng-berri in #​26728
• [Infra] Promote Internal Staging to main by @​yuneng-berri in #​26731
• ci(release): accept PEP 440 tag forms in create-release workflow by @​yuneng-berri in #​26734
• [Feat] Add gpt-image-2 support (#​26644) by @​ishaan-berri in #​26705
• feat(provider): add AIHubMix as an OpenAI-compatible provider by @​xinrui-z in #​24294
• merge internal staging by @​Sameerlite in #​26737
• merge main by @​Sameerlite in #​26742
• merge mian by @​Sameerlite in #​26745
• fix(test): scope ERROR log assertion to LiteLLM logger in test_model_alias_map by @​mateo-berri in #​26741
• merge main by @​Sameerlite in #​26757
• fix(bedrock, anthropic): translate OpenAI file content on tool-result path by @​minznerjosh in #​26710
• remove /ui/chat page by @​ishaan-berri in #​26739
• fix: add optional TCP SO_KEEPALIVE support to aiohttp's TCPConnector by @​yassinkortam in #​26730
• feat(proxy): LiteLLM headers on Google native generateContent routes by @​Sameerlite in #​25500
• feat(vector-stores): support Bedrock retrievalConfiguration passthrough by @​Sameerlite in #​26685
• feat(mcp): opt-in short-ID tool prefix to keep MCP tool names under the 60-char limit by @​mateo-berri in #​26733
• fix(proxy): self-heal Prisma read paths + harden reconnect state machine by @​yuneng-berri in #​26756
• [Fix] Redact spend logs error message by @​Michael-RZ-Berri in #​26662
• [Feat]Add support for azure entra discovery endpoint by @​Sameerlite in #​26584
• [Fix] Proxy: reconnect Prisma DB without blocking the event loop by @​yuneng-berri in #​26225
• feat(proxy): durable agent workflow run tracking via /v1/workflows/runs by @​ishaan-berri in #​26793
• chore(auth): tighten clientside api_base handling by @​stuxf in #​26518
• fix: drop sensitive locals from re-raised error messages by @​ryan-crabbe-berri in #​26823
• test(vertex-batches): set is_redirect=False on mocked retrieve response by @​yuneng-berri in #​26844
• chore(vector-stores): redact credentials in list/info/update responses; gate update by per-store access by @​stuxf in #​26489
• chore(auth): substitute alias for master key on UserAPIKeyAuth by @​stuxf in #​26484
• fix(mcp): tighten public-route detection and OAuth2 fallback gating by @​stuxf in #​26463
• [Fix] Team member null budget fallback by @​Michael-RZ-Berri in #​26809
• fix(proxy): inherit caller identity in passthrough batch managed-object by @​ryan-crabbe-berri in #​26831
• fix(proxy/auth): tighten guardrail modification permission check by @​ryan-crabbe-berri in #​26821
• [Fix] CI/Tooling: Correct min-release-age value in .npmrc files by @​yuneng-berri in #​26850
• fix(bedrock): add 1-hour cache write pricing for Claude 4.5/4.6/4.7 (Global, US) by @​mateo-berri in #​26800
• feat(proxy): add team-level search provider credentials by @​Sameerlite in #​26691
• Litellm oss staging by @​Sameerlite in #​26759
• fix(proxy/batches): forward model to retrieve_batch for bedrock by @​sruthi-sixt-26 in #​26814
• fix(passthrough): track spend for interrupted Bedrock streams by @​mateo-berri in #​26719
• merge main by @​Sameerlite in #​26855
• Litellm oss staging by @​Sameerlite in #​26852
• chore(team): audit-log team-callback admin mutations by @​stuxf in #​26859
• chore(team): close authz bypass via the available-team check by @​stuxf in #​26854
• chore(auth): harden invite-link onboarding token flow by @​stuxf in #​26843
• chore(mcp): tighten OAuth root endpoint resolution by @​stuxf in #​26840
• fix: validate aws region name by @​yassin-berriai in #​26906
• fix: drop milvus dbName and partitionNames from MILVUS_OPTIONAL_PARAMS by @​yassin-berriai in #​26910
• [Feat / Fix] Lazy loaded imports, lazy loaded front page by @​Michael-RZ-Berri in #​26802
• chore(proxy): harden request control fields by @​stuxf in #​26862
• chore(proxy): block env callback refs in key metadata by @​stuxf in #​26851
• chore(mcp): encrypt user-scoped MCP credentials at rest by @​stuxf in #​26836
• chore(mcp): SSRF guard on OAuth metadata discovery follow-up fetches by @​stuxf in #​26849
• [Fix] Replace subprocess startup-import diff with static source scan by @​Michael-RZ-Berri in #​26934
• chore(passthrough): default auth=True and drop enterprise gate on the safe option by @​stuxf in #​26827
• chore(proxy): contain UI_LOGO_PATH / LITELLM_FAVICON_URL on unauthenticated asset endpoints by @​stuxf in #​26815
• chore(cli): tighten CLI SSO session flow by @​stuxf in #​26835
• [Test] Proxy E2E: Opt In To Client Mock Response For Model Access Tests by @​yuneng-berri in #​26941
• [Fix] Responses API: Omit Empty Body On DELETE by @​yuneng-berri in #​26949
• Run pre_call_hook on Google generateContent endpoints by @​Michael-RZ-Berri in #​26914
• [Fix] Refresh Redis TTL on counter writes, skip stale in-memory in Redis by @​Michael-RZ-Berri in #​26829
• Add pagination controls to model health status by @​shivamrawat1 in #​26826
• feat(vertex_ai): propagate metadata labels to embedding, Imagen, rerank by @​Sameerlite in #​25499
• fix(anthropic): json response_format + user tools non-streaming by @​Sameerlite in #​26222
• [Infra] Bump Versions by @​yuneng-berri in #​26961
• [Infra] Promote Internal Staging to main by @​yuneng-berri in #​26962
• [Infra] Promote internal staging to main by @​yuneng-berri in #​27245
• fix(proxy): point /metrics 401 at the opt-out flag by @​yuneng-berri in #​27505
• fix(proxy): bound budget reservation per request (backport of #​27509 to 1.84.0rc2) by @​yuneng-berri in #​27539
• build(packaging): relax core runtime pins to ranges (rc2 backport of #​27241) by @​yuneng-berri in #​27545
• build(packaging): raise jinja2 floor to 3.1.6 (rc2 backport of #​27552) by @​yuneng-berri in #​27554
• cherry-pick: OpenAPI MCP extra_headers (#​27383) onto litellm_1.84.0rc2 by @​milan-berri in #​27768
• fix(proxy): always merge caller-supplied tags into request metadata by @​yuneng-berri in #​27789
• cherry-pick: reject bare str at file-input sinks (#​27762) onto litellm_1.84.0rc2 by @​yuneng-berri in #​27794
• [Fix] Lazy feature loading under SERVER_ROOT_PATH returns 404 (backport of #​27812) by @​yuneng-berri in #​27818
• [Fix] Backport /key/regenerate ownership-rebind + premium-gate guards (#​27793) by @​yuneng-berri in #​27819
• fix(proxy): expose db status on public /health/readiness (backport #​27866) by @​yuneng-berri in #​27868
• fix(ui): fetch version + debug flag from /health/readiness/details (backport #​27896) by @​yuneng-berri in #​27899
• [Infra] Build UI by @​yuneng-berri in #​27901
• chore(proxy): backport #​27898 + #​27801 to 1.84.0rc2 by @​yuneng-berri in #​27902
• fix: backport #​27892 to litellm_1.84.0rc2 by @​yuneng-berri in #​27903
• fix: backport #​27878 to litellm_1.84.0rc2 by @​yuneng-berri in #​27904
• chore: backport #​27908 to litellm_1.84.0rc2 by @​yuneng-berri in #​27909

New Contributors

• @​omriShukrun08 made their first contribution in #​26605
• @​xinrui-z made their first contribution in #​24294
• @​minznerjosh made their first contribution in #​26710
• @​yassinkortam made their first contribution in #​26730
• @​sruthi-sixt-26 made their first contribution in #​26814

Full Changelog: BerriAI/litellm@v1.83.14-stable.patch.3...v1.84.0

v1.82.1

What's Changed

• fix(gemini): preserve $ref in JSON Schema for Gemini 2.0+ by @​Chesars in #​21597
• fix(transcription): move duration to _hidden_params to match OpenAI response spec by @​Chesars in #​22208
• fix(anthropic): map reasoning_effort to output_config for Claude 4.6 models by @​Chesars in #​22220
• feat(vertex): add gemini-3.1-flash-image-preview to model DB by @​emerzon in #​22223
• perf(spendlogs): optimize old spendlog deletion cron job by @​Harshit28j in #​21930
• Fix converse handling for parallel_tool_calls by @​Sameerlite in #​22267
• [Fix]Preserve forwarding server side called tools by @​Sameerlite in #​22260
• Fix free models working from UI by @​Sameerlite in #​22258
• Add v1 for anthropic responses transformation by @​Sameerlite in #​22087
• [Bug]Add ChatCompletionImageObject in OpenAIChatCompletionAssistantMessage by @​Sameerlite in #​22155
• Fix: poetry lock by @​Sameerlite in #​22293
• Enable local file support for OCR by @​noahnistler in #​22133
• fix(mcp): Strip stale mcp-session-id to prevent 400 errors across proxy workers by @​gavksingh in #​21417
• [Feature] Access group CRUD: Bidirectional team/key sync by @​yuneng-jiang in #​22253
• Add LLMClientCache regression tests for httpx client eviction safety by @​ryan-crabbe in #​22306
• fix(images): forward extra_headers on OpenAI code path in image_generation() by @​Chesars in #​22300
• feat(models): add gpt-audio-1.5 to model cost map by @​Chesars in #​22303
• feat(models): add gpt-realtime-1.5 to model cost map by @​Chesars in #​22304
• fix(images): pass model_info/metadata in image_edit for custom pricing by @​Chesars in #​22307
• fix(chatgpt): fix tool_calls streaming indexes by @​Chesars in #​21498
• fix(openai): correct supported_openai_params for GPT-5 model family by @​Chesars in #​21576
• fix(openai): correct supported params for gpt-5-search models by @​Chesars in #​21574
• fix(azure_ai): resolve api_base from env var in Document Intelligence OCR by @​Chesars in #​21581
• fix(models): function calling for PublicAI Apertus models by @​Chesars in #​21582
• fix(vertex_ai): pass through native Gemini imageConfig params for image generation by @​Chesars in #​21585
• fix(openrouter): use provider-reported usage in streaming without stream_options by @​Chesars in #​21592
• fix(moonshot): preserve image_url blocks in multimodal messages by @​Chesars in #​21595
• fix(types): remove StreamingChoices from ModelResponse, use ModelResponseStream by @​Chesars in #​21629
• fix(responses): use output_index for parallel tool call streaming indices by @​Chesars in #​21337
• Tests: add llmclientcache regression tests by @​ryan-crabbe in #​22313
• Add deprecation dates for xAI grok-2-vision-1212 and grok-3-mini models by @​Chesars in #​20102
• fix(containers): Fix Python 3.10 compatibility for OpenAIContainerConfig by @​Chesars in #​19786
• fix(count_tokens): include system and tools in token counting API requests by @​Chesars in #​22301
• fix(helicone): add Gemini and Vertex AI support to HeliconeLogger by @​Chesars in #​19288
• fix(register_model): handle openrouter models without '/' in name by @​Chesars in #​19792
• feat(model_prices): add OpenRouter native models to model cost map by @​Chesars in #​20520
• fix(adapter): double-stripping of model names with provider-matching prefixes by @​Chesars in #​20516
• docs: add OpenRouter Opus 4.6 to model map and update Claude Opus 4.6 docs by @​Chesars in #​20525
• [Fix] Include timestamps in /project/list response by @​yuneng-jiang in #​22323
• [Feature] UI - Projects: Add Projects page with list and create flows by @​yuneng-jiang in #​22315
• Fix/claude code plugin schema by @​rahulrd25 in #​22271
• Add Prometheus child_exit cleanup for gunicorn workers by @​ryan-crabbe in #​22324
• docs: update AssemblyAI docs with Universal-3 Pro, Speech Understanding, and LLM Gateway by @​dylan-duan-aai in #​21130
• feat: add in_flight_requests metric to /health/backlog + prometheus by @​ishaan-jaff in #​22319
• fix(test): update realtime guardrail test assertions for voice violation behavior by @​jquinter in #​22332
• fix(test): update Azure pass-through test after Responses API routing change by @​jquinter in #​22334
• fix(db): add missing migration for LiteLLM_ClaudeCodePluginTable by @​jquinter in #​22335
• fix(bedrock): restore parallel_tool_calls mapping in map_openai_params by @​jquinter in #​22333
• [Feat] Agent RBAC Permission Fix - Ensure Internal Users cannot create agents by @​ishaan-jaff in #​22329
• fix(mcp): update test mocks for renamed filter_server_ids_by_ip_with_info by @​jquinter in #​22327
• fix: Add PROXY_ADMIN role to system user for key rotation by @​milan-berri in #​21896
• fix: populate user_id and user_info for admin users in /user/info by @​milan-berri in #​22239
• fix(caching): store task references in LLMClientCache._remove_key by @​shivaaang in #​22143
• fix(image_generation): propagate extra_headers to Upstream by @​ZeroClover in #​22026
• [Fix] Pass MCP auth headers from request into tool fetch for /v1/responses and chat completions by @​shivamrawat1 in #​22291
• fix: shorten guardrail benchmark result filenames for Windows long path support by @​demoray in #​22039
• Remove Apache 2 license from SKILL.md by @​rasmi in #​22322
• fix(mcp): default available_on_public_internet to true by @​ishaan-jaff in #​22331
• fix(bedrock): filter internal json_tool_call when mixed with real tools by @​jquinter in #​21107
• fix(jwt): OIDC discovery URLs, roles array handling, dot-notation error hints by @​ishaan-jaff in #​22336
• perf: streaming latency improvements — 4 targeted hot-path fixes by @​ishaan-jaff in #​22346
• [Test] UI - CostTrackingSettings: Add comprehensive Vitest coverage by @​yuneng-jiang in #​22354
• [Feature] Key list endpoint: Add project_id and access_group_id filters by @​yuneng-jiang in #​22356
• [Feature] UI - Projects: Add Project Details Page by @​yuneng-jiang in #​22360
• [Feature] UI - Projects: Add project keys table and project dropdown to key create/edit by @​yuneng-jiang in #​22373
• Litellm health check tokens by @​Harshit28j in #​22299
• Doc: security vulnerability scan report to v1.81.14 release notes by @​Harshit28j in #​22385
• feat: ability to trace metrics datadog by @​Harshit28j in #​22103
• feat(ci): add duplicate issue detection and auto-close bot by @​jquinter in #​22034
• Litellm aws edge case by @​Harshit28j in #​22384
• Litellm presidio stream v3 by @​Harshit28j in #​22283
• fix: update_price_and_context_window workflow from running in forks by @​Chesars in #​18478
• fix(ci): remove duplicate env key in scan_duplicate_issues workflow by @​Chesars in #​22405
• fix(lint): suppress PLR0915 in complex transform methods by @​jquinter in #​22328
• fix: atomic RPM rate limiting in model rate limit check by @​jquinter in #​22002
• test(ci): add secret scan test and CI job by @​jquinter in #​22193
• fix(proxy): isolate get_config failures from model sync loop by @​jquinter in #​22224
• fix tts metrics issues by @​Harshit28j in #​20632
• [Release Fix] by @​ishaan-jaff in #​22411
• fix(ci): handle inline table in pyproject.toml for proxy-extras version check by @​ishaan-jaff in #​22414
• [Feature] UI - Projects: Add delete project action by @​yuneng-jiang in #​22412
• fix: bump litellm-proxy-extras to 0.4.50 and fix 3 failing tests by @​ishaan-jaff in #​22417
• [Fix] UI - resolve flaky tests from leaked @​tremor/react Tooltip timer by @​yuneng-jiang in #​22420
• [Feature] UI - Admin Settings: Projects Opt-In Toggle by @​yuneng-jiang in #​22416
• [Infra] Building UI for Release by @​yuneng-jiang in #​22423
• fix(mypy): fix 3 mypy/pyright errors in presidio.py and _health_endpoints.py by @​ishaan-jaff in #​22422
• bump: litellm-enterprise 0.1.32 → 0.1.33 + manual publish workflow by @​ishaan-jaff in #​22421
• fix(mcp): set LITELLM_MASTER_KEY env var in e2e tests by @​jquinter in #​22413
• fix(ci): replace default CodeQL with custom workflow to unblock CI by @​jquinter in #​22397
• Development environment setup by @​ishaan-jaff in #​22432
• fix(test): add spend data polling + graceful skip to Gemini e2e spend… by @​ishaan-jaff in #​22446
• [Fix] UI - Virtual Keys: Fix beforeunload listener memory leak by @​yuneng-jiang in #​22430
• Litellm stability fix v2 by @​ishaan-jaff in #​22452
• fix: resolve ruff PLR0915 and mypy type checking lint errors by @​anencore94 in #​22359
• Fix plaintext JWTs leaking in debug logs by @​ryan-crabbe in #​22424
• fix(anthropic): populate output_config when reasoning_effort is used on Claude 4.6 by @​giulio-leone in #​22410
• fix: add sync streaming fallback + fix 429 for all streaming paths by @​CSteigstra in #​22375
• fix(vertex_ai): Set anthropic-beta as HTTP header for Vertex AI rawPredict by @​castrapel in #​22321
• fix(types): normalize null top_logprobs to [] in ChatCompletionTokenLogprob by @​shivaaang in #​22245
• fix (model-map): gemini litellm_provider for gemini/gemini-2.5-flash-image by @​Dima-Mediator in #​22156
• fix(ui): Display newlines correctly in tool descriptions by @​RussellLuo in #​22363
• [UI QA] - Add all provider models + providers on ui by @​ishaan-jaff in #​22461
• Budget reset times and timezones by @​krrishdholakia in #​22428
• Add OCR guardrail_translation handler support by @​krrishdholakia in #​22145
• [Fix] Invite link allows multiple password resets by @​yuneng-jiang in #​22462
• [Docs] Project Management UI by @​yuneng-jiang in #​22472
• [Fix] UI - QueryClient: move to single root-level provider by @​yuneng-jiang in #​22463
• [Feat] Make UI login session duration configurable via LITELLM_UI_SESSION_DURATION by @​shivamrawat1 in #​22182
• Add observatory test workflow for RC/stable releases by @​jquinter in #​22508
• Fix invalid secrets context in test-linting workflow by @​jquinter in #​22517
• Fix observatory workflow checkout failing on commit hash by @​jquinter in #​22518
• Fix undefined kwargs in InFlightRequestsMiddleware by @​jquinter in #​22523
• Fix observatory tunnel DNS flakiness and PLR0915 lint by @​jquinter in #​22525
• Fix PLR0915 lint error in _completion_streaming_iterator by @​jquinter in #​22526
• fix(featherless_ai): use correct FEATHERLESS_AI_API_KEY env var name by @​giulio-leone in #​22497
• fix(bedrock): extract region and model ID from bedrock/{region}/{model} path format by @​Sameerlite in #​22546
• feat(vertex-ai): add VIDEO modality support in token usage tracking by @​Sameerlite in #​22550
• Litellm oss staging 02 28 2026 by @​krrishdholakia in #​22340
• fix(openrouter): pattern-based fix for native model double-stripping by @​tombii in #​22320
• Revert "fix(adapter): double-stripping of model names with provider-matching prefixes" by @​Chesars in #​22593
• docs: add fallback setup for virtual key with Loom video by @​mubashir1osmani in #​22600
• [Feat] Make MCP timeouts configurable via environment variables by @​shivamrawat1 in #​22287
• feat: add missing Mistral models and update pricing by @​Chesars in [#​22601](https://redirect.github.com/

✂ Note

PR body was truncated to here.