Intentee

Pinned Loading

1. paddlerpaddlerPublic

   Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simpl…

   Rust 1.7k 97

2. llmops-handbookllmops-handbookPublic

   Practical and advanced guide to LLMOps. It provides a solid understanding of large language models’ general concepts, deployment techniques, and software engineering practices. (work in progress)

   CSS 85 7