Pinned Loading

1. llm-d/llm-dllm-d/llm-dPublic

   Achieve state of the art inference performance with modern accelerators on Kubernetes

   Shell 4k 662

2. project-codeflare/codeflareproject-codeflare/codeflarePublic

   Simplifying the definition and execution, scaling and deployment of pipelines on the cloud.

   Jupyter Notebook 236 37

3. llm-d/llm-d-routerllm-d/llm-d-routerPublic

   llm-d Router: The intelligent entry point for inference requests

   Go 282 300

4. llm-d/llm-d-benchmarkllm-d/llm-d-benchmarkPublic

   llm-d benchmark scripts and tooling

   Python 64 122

5. foundation-model-stack/multi-nic-cnifoundation-model-stack/multi-nic-cniPublic

   Go 40 11