olmo

Here are 9 public repositories matching this topic...

RayoHQ / attention-binding-a11y

TMLR 2026 | Mechanistic interpretability: attention-head binding (EB*) as a marker of concept emergence. 7 models, 5 architectures (Pythia 160M–2.8B, OLMo-1B, CRFM GPT-2, SmolLM3-3B, Qwen2.5-1.5B), 41 terms.

nlp accessibility transformers language-models pythia interpretability few-shot-learning training-dynamics attention-heads mechanistic-interpretability qwen tmlr olmo smollm3 tmlr-2026 concept-emergence crfm

Updated Jun 9, 2026
Python

thefirehacker / ddp-training

Star

PyTorch DDP and multi-GPU LLM training — from a minimal distributed example to NanoGPT speedruns, Muon, H100 profiling, and modded-nanogpt. FBA LAB https://bubblnet.com

training gpu modal pytorch ddp pytorch-tutorial gpt-2 distributed-data-parallel marin nanogpt llm-training h100 qwen deepseek olmo llm-systems muon-optimizer modded-nanogpt

Updated Aug 20, 2026
Python

gudu616 / omtr

Star

OMTR — can LLM memorization be separated from predictability? Preregistered causal probing (activation patching) in Pythia & OLMo on consumer hardware; three honest non-separations, full corrections history

reproducible-research language-models reproducibility pythia memorization interpretability preregistration llm mechanistic-interpretability activation-patching olmo logit-lens

Updated Aug 22, 2026
Python

Abu-Sameer-66 / NegTox-LLM

Star

First open-source descriptor-augmented LLM for Neglected Tropical Disease drug discovery | OLMo-7B + QLoRA + DeepChem | Bioactivity & Toxicity prediction for Leishmaniasis, Chagas, Malaria, TB

open-source bioinformatics cheminformatics drug-discovery rdkit smiles deepchem toxicity-prediction leishmaniasis llm qlora olmo molecular-ai neglected-tropical-diseases