Skip to content

Pull requests: mlfoundations/evalchemy

New pull requestNew
14 Open 110 Closed
14 Open 110 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Assigned to nobodyLoading
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

Update eval_instruct.py
#156 opened Feb 24, 2026 by neginraoofCollaboratorLoading…
1
2
Improved logging to support lm-eval>=0.4.8
#154 opened Jan 4, 2026 by hjenryinLoading…
4
Fix vLLM crash when max_gen_toks exceeds model context window
#153 opened Jan 3, 2026 by Ali-ElganzoryLoading…
4 tasks done
1
5
[FEATURE] Allow command-line control of namespace when using launch_simple
#151 opened Dec 24, 2025 by penfeverContributorLoading…
Penfever patch 1
#138 opened Jul 6, 2025 by penfeverContributorLoading…
Register OpenLM models at startup
#133 opened Jun 27, 2025 by reinhardhCollaboratorLoading…
LCB official scorer instead of skythoughts
#130 opened Jun 13, 2025 by slimfrkhaLoading…
1
Optimize Evaluation Workflow for Better Batching and Model Reuse For benchmarks with n_repeat > 1
#125 opened May 27, 2025 by ihebchaaLoading…
3
update lm-eval-harness version
#124 opened May 12, 2025 by jannaluluLoading…
1
Fix: truncate model identifier in case model name is too long
#120 opened May 2, 2025 by younesbelkadaLoading…
1
Jean/update curator
#115 opened Apr 15, 2025 by jmercatCollaboratorLoading…
Support for Big Bench Extra Hard (General-purpose reasoning eval)
#92 opened Mar 8, 2025 by HritikbansalCollaboratorLoading…
Adding Arena Hard Auto
#65 opened Jan 28, 2025 by asuvarna31Loading…
4
Multi-node
#29 opened Nov 22, 2024 by jmercatCollaboratorLoading…
2
ProTip! Follow long discussions with comments:>50.