Pinned Loading

1. ome-projects/omeome-projects/omePublic

   Open Model Engine (OME) — Kubernetes operator for LLM serving, GPU scheduling, and model lifecycle management. Works with SGLang, vLLM, TensorRT-LLM, and Triton

   Go 487 89

2. dynamodynamoPublic

   Forked from ai-dynamo/dynamo

   A Datacenter Scale Distributed Inference Serving Framework

   Rust

3. lwslwsPublic

   Forked from kubernetes-sigs/lws

   LeaderWorkerSet: An API for deploying a group of pods as a unit of replication

   Go

4. MooncakeMooncakePublic

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

5. sglangsglangPublic

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

6. torchadatorchadaPublic

   Forked from MooreThreads/torchada

   Adapter package for torch_musa to act exactly like PyTorch CUDA

   Python