Popular repositories Loading

1. data-scraping data-scrapingPublic

2. TransformerEngine TransformerEnginePublic

   Forked from NVIDIA/TransformerEngine

   A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory…

   Python

3. torchtitan torchtitanPublic

   Forked from pytorch/torchtitan

   A PyTorch native platform for training generative AI models

   Python

4. ms-swift ms-swiftPublic

   Forked from modelscope/ms-swift

   Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, GLM4.5, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, InternVL3.5, Ovis2.5, Llava, GLM4v…

   Python

5. Megatron-LM Megatron-LMPublic

   Forked from NVIDIA/Megatron-LM

   Ongoing research training transformer models at scale

   Python

6. pytorch pytorchPublic

   Forked from pytorch/pytorch

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python