Skip to content

Pull requests: huggingface/trl

New pull request New
173 Open 4,325 Closed
173 Open 4,325 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Redirect the KTO liger loss through the distributed wrapper under DDP
#7247 opened Sep 16, 2026 by qgallouedec Member Loading…
2 of 3 tasks
4
Move DPO to chunked log probabilities
#7243 opened Sep 16, 2026 by kashif Collaborator Loading…
5 of 8 tasks
5
Add reward-variance top-p/top-k filtering to GRPOTrainer
#7242 opened Sep 16, 2026 by ZihanWang314 Contributor Loading…
4 of 8 tasks
5
Prepare the dataset once per node when the datasets cache is node-local
#7241 opened Sep 16, 2026 by qgallouedec Member Loading…
1
5
Skip the dtype check when the reference is not a safetensors repo 🔧 maintenance CI, tooling, tests, or repo upkeep
#7238 opened Sep 16, 2026 by albertvillanova Member Loading…
2
Validate dataset mixture fractions before loading
#7237 opened Sep 16, 2026 by lindicaphxag-tech Loading…
4 of 8 tasks
Align tiny OPT config with facebook/opt-1.3b 🔧 maintenance CI, tooling, tests, or repo upkeep
#7233 opened Sep 16, 2026 by albertvillanova Member • 2/2 Loading…
1
Pass ffn_dim instead of intermediate_size in the tiny OPT generator 🔧 maintenance CI, tooling, tests, or repo upkeep
#7232 opened Sep 16, 2026 by albertvillanova Member • 1/2 Loading…
3
Align tiny Gemma2 config with google/gemma-2-2b-it 🔧 maintenance CI, tooling, tests, or repo upkeep
#7228 opened Sep 16, 2026 by albertvillanova Member • 2/2 Loading…
3
Document that AsyncGRPO tools must be module-level functions 📚 documentation Improvements or additions to documentation
#7226 opened Sep 16, 2026 by albertvillanova Member Loading…
2
Add an opt-in timeout for VLLMClient metadata requests
#7219 opened Sep 15, 2026 by 030611 Loading…
5 of 8 tasks
Implement MOPD for the DistillationTrainer
#7215 opened Sep 15, 2026 by cmpatino Collaborator Loading…
5 of 7 tasks
15
Add TailSFT example
#7212 opened Sep 15, 2026 by kashif Collaborator Loading…
4 of 8 tasks
20
Reset the vLLM encoder cache after weight sync
#7200 opened Sep 13, 2026 by rmaguado Loading…
4 of 8 tasks
1
Reduce connection-pool warnings in the vLLM client
#7199 opened Sep 13, 2026 by vladbataev Loading…
5 of 7 tasks
5
[MFU] Use device peak flops instead of hardcoded H100's
#7197 opened Sep 13, 2026 by dwarez Loading…
4 of 8 tasks
12
Add selective activation checkpointing (SAC) to SFT
#7194 opened Sep 12, 2026 by kashif Collaborator Loading…
5 of 8 tasks
3
docs: fix the clip explanation in the GRPO trainer page
#7190 opened Sep 12, 2026 by JiangLLM Loading…
4 of 8 tasks
[GRPO] Multiply the KL term by the per-token importance sampling ratio
#7188 opened Sep 11, 2026 by Alexander230 Loading…
4 of 6 tasks
1
[Exploratory] Drop accelerate launch: the CLI, docs and examples launch with torchrun
#7180 opened Sep 10, 2026 by qgallouedec Member • Draft
AsyncGRPO: cancel stale in-flight rollouts and survive generation fai… ✨ enhancement New feature or request
#7176 opened Sep 10, 2026 by AmineDiro Member Loading…
8
[AsyncGRPO] Run sync tools on a thread pool and support async tools
#7175 opened Sep 10, 2026 by AmineDiro Member Loading…
11
Reject use_liger_kernel in GMPOTrainer
#7163 opened Sep 10, 2026 by YeonwooSung Contributor Loading…
5 of 8 tasks
1
Restore generation unwrap state if generate() raises
#7162 opened Sep 10, 2026 by YeonwooSung Contributor Loading…
4 of 8 tasks
1
Fail fast when GRPO combines Liger with the MoE auxiliary loss
#7161 opened Sep 10, 2026 by YeonwooSung Contributor Loading…
4 of 8 tasks
1
ProTip! What’s not been updated in a month: updated:<2026-08-16.