zero3

Here are 2 public repositories matching this topic...

InternLM / InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.

pytorch multi-modal gemma pipeline-parallelism transformers-models tensor-parallelism llava llm-training internlm flash-attention zero3 llm-framework sequence-parallelism internlm2 ring-attention deepspeed-ulysses llama3 910b

Updated Aug 21, 2025
Python

Sarkar-AGI / Core-1

Star

Core-1: A High-Performance Distributed AGI Framework built for Trillion-Parameter Scalability, featuring Unified Cognitive Memory, MCTS Planning, and Continuous Meta-Learning in C++.

cpp cuda agi high-performance-computing libtorch llm-training zero3 fused-kernels

Updated Jun 27, 2026
C++

Improve this page

Add a description, image, and links to the zero3 topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the zero3 topic, visit your repo's landing page and select "manage topics."

Learn more