Pinned Loading

1. sgl-project/sglangsgl-project/sglangPublic

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 32.2k 8.1k

2. vllm-project/vllmvllm-project/vllmPublic

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 89.7k 21k

3. unslothai/unslothunslothai/unslothPublic

   Local UI to run and train LLMs and diffusion models, including Qwen3.8, Kimi K3, MiniMax-H3, Gemma 4, DeepSeek-V4, FLUX and more.

   Python 74.3k 6.7k

4. deepspeedai/DeepSpeeddeepspeedai/DeepSpeedPublic

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 43k 4.9k

5. apache/tvmapache/tvmPublic

   Open Machine Learning Compiler Framework

   Python 13.7k 4k

6. huggingface/optimum-habanahuggingface/optimum-habanaPublic

   Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)

   Python 212 273