GPUStack

Pinned Loading

1. gpustackgpustackPublic

   A GPU cluster manager for high-performance AI model serving (vLLM, SGLang) and on-demand SSH-accessible GPU instances.

   Python 5.4k 606

2. runnerrunnerPublic

   Collection of Dockerfiles to build images for various inference services across different accelerated backends.

   Dockerfile 15 15

3. runtimeruntimePublic

   Provides a unified interface to detect GPU resources and manages GPU workloads.

   Python 15 22

4. gguf-parser-gogguf-parser-goPublic

   Review/Check GGUF files and estimate the memory usage and maximum tokens per second.

   Go 284 28

5. vox-boxvox-boxPublic

   A text-to-speech and speech-to-text server compatible with the OpenAI API, supporting Whisper, FunASR, Bark, and CosyVoice backends.

   Python 214 36

6. gpustack-operatorgpustack-operatorPublic

   Provides a fantastic way to manage accelerator resources in Kubernetes.

   Go 2 1