Skip to content

Pull requests: eval-protocol/python-sdk

New pull requestNew
42 Open 416 Closed
42 Open 416 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Assigned to nobodyLoading
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

Fix typo "mdoel" -> "model" in dump_mdoel_for_chat_completion_request
#456 opened Jun 28, 2026 by rosaboyleLoading…
Add Runloop rollout processor integration
#454 opened Jun 2, 2026 by tode-rl • Draft
5
feat: preserve token IDs on messages
#448 opened Apr 28, 2026 by Hecate0821Loading…
Fix duplicate CLI shorthand flag registration
#441 opened Mar 31, 2026 by benjibcContributorLoading…
Harden /evaluate error handling and remove mutable kwargs default
#438 opened Mar 20, 2026 by bezzchenLoading…
4
fix: resolve argparse conflict for --credentials-secret in nested configs
#437 opened Mar 16, 2026 by heathrielLoading…
Fix argparse conflict for duplicate TypedDict field short aliases
#433 opened Mar 9, 2026 by wirjoLoading…
4 tasks done
temp hot fix
#423 opened Jan 26, 2026 by xzrderekContributorLoading…
2
Fix bug in preprocess_fn codepath
#420 opened Jan 24, 2026 by RNHTTR • Draft
Add IFEval
#414 opened Jan 16, 2026 by SandyYuanCollaboratorLoading…
13
perf: Add server-side filtering for ep logs to improve performance
#408 opened Jan 11, 2026 by benjibcContributorLoading…
4
Verify Fireworks API key once for CLI flows codex
#407 opened Jan 10, 2026 by benjibcContributorLoading…
Record rollout start time and show rollout latency in UI codex
#398 opened Jan 7, 2026 by benjibcContributorLoading…
2
enforce single evaluator upload per command
#387 opened Dec 24, 2025 by benjibcContributorLoading…
3
updated tests
#382 opened Dec 18, 2025 by shreymodi1ContributorLoading…
1
support extra headers
#373 opened Dec 15, 2025 by benjibcContributorLoading…
4
warn if large datasets + force 1 run
#365 opened Dec 12, 2025 by xzrderekContributorLoading…
Shrey/modelquality
#353 opened Dec 2, 2025 by shreymodi1ContributorLoading…
18 tasks
1
support for tokenids logprobs
#350 opened Nov 26, 2025 by shreymodi1ContributorLoading…
18 tasks
calibration evaluator
#345 opened Nov 24, 2025 by benjibcContributor • Draft
18 tasks
adding response quality validation for retry
#344 opened Nov 24, 2025 by morgendaveCollaboratorLoading…
10 tasks
6
tests fix
#341 opened Nov 21, 2025 by shreymodi1ContributorLoading…
18 tasks
5
Shrey/trl
#335 opened Nov 17, 2025 by shreymodi1ContributorLoading…
18 tasks
1
Update Klavis MCP use case
#330 opened Nov 14, 2025 by LLiuZhengContributorLoading…
1
Text to SQL RFT example
#324 opened Nov 10, 2025 by benjibcContributorLoading…
6
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.