Pinned Loading

1. vllm-project/vllmvllm-project/vllmPublic

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 90k 21.2k

2. ai-dynamo/dynamoai-dynamo/dynamoPublic

   A Datacenter Scale Distributed Inference Serving Framework

   Rust 7.9k 1.5k

3. llm-d/llm-d-kv-cachellm-d/llm-d-kv-cachePublic

   Distributed KV cache scheduling & offloading libraries

   Go 172 154

4. ornladios/ADIOS2ornladios/ADIOS2Public

   Next generation of ADIOS developed in the Exascale Computing Program

   C++ 326 151