sample-efficient-learning

Here is 1 public repository matching this topic...

inovdwouw / Sample-Efficient-Language-Modelling

This repository contains the training and evaluation code accompanying the thesis "Learning with Less: Contrastive Weight Tying on the BabyLM Challenge" (Ino van de Wouw, VU Amsterdam, 2025). The project studies headless language models, models pretrained with Contrastive Weight Tying (CWT) (Godey et al., 2024) instead of a standard cross-entropy

glue slurm pytorch transformer computational-linguistics gpt bert blimp huggingface pretrained-language-model pytorch-lightning contrastive-learning sample-efficient-rl llm babylm sample-efficient-ml contrastive-weight-tying headless-language-models sample-efficient-learning

Updated Jul 26, 2026
Python

Improve this page

Add a description, image, and links to the sample-efficient-learning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the sample-efficient-learning topic, visit your repo's landing page and select "manage topics."

Learn more