Pinned Loading

1. kvcache-ai/ktransformerskvcache-ai/ktransformersPublic

   A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

   Python 19.3k 1.5k

2. PaddlePaddle/PaddlePaddlePaddle/PaddlePublic

   PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

   C++ 24.1k 6k

3. sgl-project/sglangsgl-project/sglangPublic

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 32.9k 8.4k

4. kvcache-ai/Mooncakekvcache-ai/MooncakePublic

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++ 6.4k 1.1k