Skip to content

Pull requests: MedARC-AI/medmarks

New pull requestNew
18 Open 85 Closed
18 Open 85 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviewsReview requiredApproved reviewChanges requested
Assignee
Filter by who’s assigned
Assigned to nobodyLoading
Sort
Sort by
NewestOldestMost commentedLeast commentedRecently updatedLeast recently updatedBest match
Most reactions
👍👎😄🎉😕❤️🚀👀

Pull requests list

Add MedFact-Bench zero-shot evaluation environment
#137 opened Jul 11, 2026 by KouateMuhamedLoading…
Add Bedrock Converse client with --provider flag and worker subproces…
#135 opened Jun 22, 2026 by PidemLoading…
1
Add gemini 3.1 flash lite both as model-to-be-evaluated and LLM judge.
#133 opened Jun 12, 2026 by daanschouten-kaikoLoading…
1
Improve HealthBench parity with openai/simple-evals
#132 opened May 14, 2026 by bofenghuangContributorLoading…
Patch thinking-model grader bugs
#128 opened Apr 13, 2026 by HonyantLoading…
2 tasks done
1
feat: add MedReason environment and environment validation tests
#119 opened Feb 16, 2026 by Rakshitha-IreddiLoading…
1
Add RL training configs, scripts, and environment updates
#113 opened Jan 29, 2026 by nikhilk7153ContributorLoading…
1
Parsed Model Answer logging+ MCQ Answer analysis
#110 opened Jan 26, 2026 by mnishant2ContributorLoading…
Add NLG metrics to aci_bench
#107 opened Jan 22, 2026 by jbdelContributorLoading…
Add BioASQ
#105 opened Jan 22, 2026 by Ash-29Loading…
1
Add open-i-summarization environment for radiology report summarization
#102 opened Jan 22, 2026 by jbdelContributorLoading…
3
Casereportbench environment
#99 opened Jan 20, 2026 by ss8319ContributorLoading…
2
Add MedSafetyBench environment
#97 opened Jan 18, 2026 by anas-zafarLoading…
4
Added paper citations to environments
#86 opened Dec 24, 2025 by mkieffer1107ContributorLoading…
Feat/medexqa judges
#67 opened Nov 3, 2025 by mnishant2Contributor • Draft
Add MedHALT evaluation environment
#65 opened Oct 30, 2025 by geetuaContributorLoading…
3
K-QA #45 added
#52 opened Oct 13, 2025 by Manishram-aiContributorLoading…
6
Mebullets changes
#26 opened Oct 3, 2025 by mkieffer1107ContributorLoading…
2
ProTip! Exclude everything labeled bug with -label:bug.