Popular repositories Loading

1. xDiT xDiTPublic

   Forked from xdit-project/xDiT

   xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism

   Python

2. flashinfer flashinferPublic

   Forked from AMD-Ecosystem/flashinfer

   Fork of FlashInfer+ROCm: ROCm port of FlashInfer

   Cuda

3. vllm vllmPublic

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. ray rayPublic

   Forked from ray-project/ray

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python

5. AngelSlim AngelSlimPublic

   Forked from Tencent/AngelSlim

   Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

   Python

6. recipes recipesPublic

   Forked from vllm-project/recipes

   Common recipes to run vLLM

   JavaScript