Popular repositories Loading

1. NeMo NeMoPublic

   Forked from NVIDIA-NeMo/Speech

   NeMo: a toolkit for conversational AI

   Python

2. apex apexPublic

   Forked from NVIDIA/apex

   A PyTorch Extension: Tools for easy mixed precision and distributed training in Pytorch

   Python

3. NeMo-Megatron-Launcher NeMo-Megatron-LauncherPublic

   Forked from NVIDIA/NeMo-Framework-Launcher

   NeMo Megatron launcher and tools

   Python

4. flash-attention flash-attentionPublic

   Forked from Dao-AILab/flash-attention

   Fast and memory-efficient exact attention

   Python

5. collective_matmul collective_matmulPublic

   Python

6. TransformerEngine TransformerEnginePublic

   Forked from NVIDIA/TransformerEngine

   A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper GPUs, to provide better performance with lower memory utilization in bot…

   Python