LLMServe

Popular repositories Loading

1. DistServe DistServePublic

   Disaggregated serving system for Large Language Models (LLMs).

   Jupyter Notebook 828 99

2. SwiftTransformer SwiftTransformerPublic

   High performance Transformer implementation in C++.

   C++ 155 18

3. dLoRA-artifact dLoRA-artifactPublic

   Jupyter Notebook 32 8

4. FastServe FastServePublic

   Jupyter Notebook 30 4

5. hydraserve hydraservePublic

   Python 20 4

6. WarmServe WarmServePublic

   WarmServe is a multi-LLM serving system that prewarms models according to workload predictions.

   Python 4