cuda-checkpoint

Here is 1 public repository matching this topic...

gbram1 / embers

Serverless-GPU LLM serving: scale-to-zero with fast GPU snapshot/restore (cuda-checkpoint), multi-tenant packing, and an OpenAI-compatible API — built on vLLM.

serverless gpu cuda lora autoscaling scale-to-zero openai-api llm-serving vllm llm-inference snapshot-restore cuda-checkpoint

Updated Jul 5, 2026
Python

Improve this page

Add a description, image, and links to the cuda-checkpoint topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the cuda-checkpoint topic, visit your repo's landing page and select "manage topics."

Learn more