marin

Here is 1 public repository matching this topic...

thefirehacker / ddp-training

PyTorch DDP and multi-GPU LLM training — from a minimal distributed example to NanoGPT speedruns, Muon, H100 profiling, and modded-nanogpt. FBA LAB https://bubblnet.com

training gpu modal pytorch ddp pytorch-tutorial gpt-2 distributed-data-parallel marin nanogpt llm-training h100 qwen deepseek olmo llm-systems muon-optimizer modded-nanogpt

Updated Aug 20, 2026
Python

Improve this page

Add a description, image, and links to the marin topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the marin topic, visit your repo's landing page and select "manage topics."

Learn more