Skip to content

Folders and files

NameName
Last commit message
Last commit date

Latest commit

History

5,889 Commits

Repository files navigation

Manifest

AI Agents that don't break

manifest-gh

Deploy on RenderDeploy on RailwayDeploy on AWSDeploy on GCP

GitHub starsDocker pullsDocker image sizeCI statusCodecovlicenseDiscord

mnfst%2Fmanifest | Trendshift

What is Manifest?

Manifest is an open-source LLM gateway for AI agents and apps. Connect your API keys, subscriptions, and local models to one OpenAI-compatible endpoint, and each query goes to the right model. No single-provider lock-in.

  • 🔀 Custom Routing: API keys, Subscriptions, Local models, Custom providers
  • 💾 Full Body Logs for Success and Error Messages
  • 📊 Track every single dollar, setup notifications and limits
  • 🚑 Fallback on different models when queries fails, Self-heals your bad requests

Quick start

Cloud version

Go to app.manifest.build and follow the guide.

Self-hosted

Manifest ships as a Docker image. One command:

bash <(curl -sSL https://raw.githubusercontent.com/mnfst/manifest/main/docker/install.sh)

Open http://localhost:2099 and sign up — the first account you create becomes the admin. Full self-hosting guide: docker/DOCKER_README.md.

Deploy with one click

PlatformNotes
RailwayBest path. Template includes Manifest and PostgreSQL.
RenderBlueprint includes Manifest and Render PostgreSQL.
DigitalOceanApp Platform button includes Manifest and a Dev PostgreSQL database.
AWSCloudFormation quick-create for ECS, RDS, and Secrets Manager.
GCPCloud Shell guided deploy for Cloud Run, Cloud SQL, and Secret Manager.

Full deployment guides: Railway, Render, DigitalOcean, AWS, GCP, Fly.io, Coolify, Easypanel, Heroku, and Koyeb.

The old npm-based self-hosting path is no longer supported. Use the Docker image or one of the deployment guides above.

Providers

Manifest connects to 300+ models through 32 built-in provider connections plus any custom OpenAI/Anthropic-compatible endpoint. Bring your own API key, reuse one of 18 subscription flows, or run models locally. Everything is routed through the same OpenAI-compatible endpoint — send "model": "auto" and Manifest picks the model.

Provider catalogs are discovered dynamically when credentials are connected. The examples below are representative, not exhaustive.

ProviderAPI key / localSubscriptionModel catalog
OpenAI✅ ChatGPT Plus / Pro / TeamGPT-5.6 (Sol / Terra / Luna), GPT-5.5, GPT-5.4, Codex, o-series
Anthropic✅ Claude Max / ProClaude Opus 5, Sonnet 5, Fable 5, Haiku 4.5
Google✅ Sign in with GoogleGemini 3.6 Flash, 3.5 Flash, 3.1 Pro, Gemini 2.5
xAI✅ Grok subscriptionGrok 4.5, Grok 4.3, Grok Build, Grok 4.20
AWS BedrockClaude, GPT, Kimi, MiniMax, Nemotron, Nova via Bedrock
Alibaba Cloud / Qwen✅ Qwen Token PlanQwen 3.7 Max / Plus / Flash, DeepSeek, Kimi, GLM
DeepSeekDeepSeek V4 Pro, V4 Flash, V3.2, R1
Mistral✅ Mistral VibeMistral Large, Medium 3.5, Devstral, Codestral
Moonshot (Kimi)✅ Kimi Coding PlanKimi K3, K2.7 Code, Kimi for Coding
MiniMax✅ MiniMax Coding PlanMiniMax M3, M2.7, M2.5
Xiaomi MiMo✅ MiMo Token PlanMiMo V2.5 Pro, V2.5, Flash
Z.ai✅ GLM Coding PlanGLM 5.2, GLM 5.1, GLM 5 Turbo
BytePlus✅ ModelArk Coding PlanArk Code, Seed Code, GLM, Kimi, DeepSeek, GPT-OSS
GitHub Copilot✅ Copilot subscriptionClaude, GPT, Gemini, Grok via Copilot
Kiro✅ Kiro subscriptionkiro/auto, Claude, DeepSeek, MiniMax, GLM, Qwen
Command Code✅ Command Code subscriptionClaude, DeepSeek V4, Qwen 3.7, Gemini, Kimi
ClinePass✅ ClinePass subscriptioncline-pass/glm-5.2, Kimi, DeepSeek, MiMo, MiniMax, Qwen
NousResearch✅ NousResearch subscriptionNousResearch Portal model catalog
OpenCode Go✅ OpenCode GoDeepSeek V4, Qwen 3.7, GLM, Kimi, MiMo
Ollama / Ollama Cloud🖥️ Local✅ Ollama CloudLocal tags: Llama, Qwen, Gemma. Cloud: DeepSeek V4, GLM, Kimi
LM Studio🖥️ LocalLocal GGUF models, port 1234
llama.cpp🖥️ LocalLocal GGUF models, port 8080
OpenRouter300+ models across labs
OpenCode ZenCurated Claude, GPT, DeepSeek, MiMo, Nemotron
KiloKilo Gateway catalog
CerebrasGPT-OSS, GLM, Gemma on Cerebras inference
Fireworks AIDeepSeek V4, Kimi K2.7, Qwen 3.7, Nemotron
GroqLlama 4, Qwen 3.6, GPT-OSS, Gemma
Hugging FaceOpen models through Hugging Face Inference Providers
NVIDIA NIMNemotron 3, GLM, Kimi, MiniMax, Qwen
PioneerOpenAI-compatible and fine-tuned Pioneer models
CustomAny /v1/chat/completions or /v1/messages endpoint

Quick links

License

MIT

Releases

Used by

Contributors

Languages