Foundation Model Stack

Pinned Loading

1. foundation-model-stackfoundation-model-stackPublic

   🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.

   Python 232 107

2. fms-fsdpfms-fsdpPublic

   🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash attention v2.

   Python 288 47

3. fms-hf-tuningfms-hf-tuningPublic

   🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.

   Python 58 66

4. fms-accelerationfms-accelerationPublic

   🚀 Collection of libraries used with fms-hf-tuning to accelerate fine-tuning and training of large models.

   Python 14 19

5. fms-guardrails-orchestratorfms-guardrails-orchestratorPublic

   🚀 Guardrails orchestration server for application of various detections on text generation input and output.

   Rust 35 44

6. bambabambaPublic

   Train, tune, and infer Bamba model

   Python 139 16