Pinned Loading

1. learning-at-home/hivemindlearning-at-home/hivemindPublic

   Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

   Python 2.5k 233

2. bigscience-workshop/petalsbigscience-workshop/petalsPublic

   🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

   Python 10.5k 638

3. efficient-dl-systemsefficient-dl-systemsPublic

   Efficient Deep Learning Systems course materials

   Jupyter Notebook 1k 148

4. FMInference/FlexLLMGenFMInference/FlexLLMGenPublic archive

   Running large language models on a single GPU for throughput-oriented scenarios.

   Python 9.4k 590

5. yandex-research/DeDLOCyandex-research/DeDLOCPublic

   Official code for "Distributed Deep Learning in Open Collaborations" (NeurIPS 2021)

   Jupyter Notebook 119 7

6. learning-at-homelearning-at-homePublic

   "Towards Crowdsourced Training of Large Neural Networks using Decentralized Mixture-of-Experts" (NeurIPS 2020), original PyTorch implementation

   Jupyter Notebook 56 1