torch-distributed

Here is 1 public repository matching this topic...

JohnScheuer / distributed-inference-engine

Simulated Multi-GPU inference engine implementing Megatron-style Tensor Parallelism, GPipe Pipeline Parallelism, and KV Cache Sharding from scratch. Features bit-identical fidelity validation on Qwen2-0.5B weights and analytical communication cost modeling.

distributed-systems hpc distributed-computing pytorch scaling multi-gpu inference-optimization gpipe pipeline-parallelism kv-cache megatron-lm tensor-parallelism llm qwen2 torch-distributed

Updated Jul 29, 2026
Python

Add this topic to your repo

To associate your repository with the torch-distributed topic, visit your repo's landing page and select "manage topics."

Learn more