EleutherAI

Mapping out the "memory" of neural nets with data attribution

Keeping language models honest by directly eliciting knowledge encoded in their activations.

Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models know themselves through automated interpretability.

Sparsify transformers with SAEs and transcoders

Generating, validating and running exploitable verifiable coding problems

Data and experimental YAMLs for empirical metasmoothness

New website for EleutherAI based on Hugo static site generator

A framework for few-shot evaluation of language models.

Data processing system for polyglot

MIDI tokenizers and pre-processing utils.