bubble-time

Here is 1 public repository matching this topic...

JohnScheuer / pipeline-parallel-kv-bench

Analytical benchmark connecting pipeline parallelism and KV cache management: bubble-time overlap for disaggregation, prefix reuse tax of PP stages, and tiering speedup across NVLink, InfiniBand, and PCIe

performance-engineering benchmark simulation inference systems infiniband disaggregation pcie nvlink analytical-model tiering pipeline-parallelism kv-cache llm llm-serving machine-learning-infrastructure prefix-sharing kv-cache-management bubble-time

Updated Jul 26, 2026
Python

Add this topic to your repo

To associate your repository with the bubble-time topic, visit your repo's landing page and select "manage topics."

Learn more