fleets

Here is 1 public repository matching this topic...

goutamadwant / kvfleet

KV-cache-aware intelligent routing for self-hosted and hybrid LLM fleets. Route requests using model quality, latency, cost, policy, and live GPU state.

multi-armed-bandit routing-controllers mlops fleets kv-cache openai-api pii-redaction llm llmops vllm ai-gateway semantic-routing llm-gateway llm-routing self-hosted-llm

Updated Mar 20, 2026
Python

Improve this page

Add a description, image, and links to the fleets topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the fleets topic, visit your repo's landing page and select "manage topics."

Learn more