From-scratch RDMA-based PyTorch backend in C++; trained a char-level GPT on TinyShakespeare via DDP through code I wrote.
-
Updated
May 1, 2026 - C++
#
c10d
Here are 3 public repositories matching this topic...
UCX-based torch.distributed backend with MPI-style tag-matched send/recv (NCCL ignores tags) and collectives on CPU & CUDA.
-
Updated
Jul 5, 2026 - C++
Implement GPU collective communication using a custom PyTorch c10d backend built on libibverbs and softRoCE for distributed model training.
-
Updated
Sep 7, 2026 - C++
Add this topic to your repo
To associate your repository with the c10d topic, visit your repo's landing page and select "manage topics."