Workflow runs · ProgramBench/submissions · GitHub

Actions

All workflows
Actions
Loading...
Loading

Showing runs from all workflows

62 workflow runs

62 workflow runs

Add Jarvi3 Themis-G strict two-solve cleanroom submission Validate #69: Pull request #27 opened by kyal102

Action requiredkyal102:add-20260824_dtl-supermath-2solve-cleanroom-v2

kyal102:add-20260824_dtl-supermath-2solve-cleanroom-v2

Action required

Add submission: 20260815_mini-v2.4.2_gemini-3-7-flash (#26) Validate #68: Commit 0f2a7c7 pushed by john-b-yang

28s main

28s

Add submission: 20260815_mini-v2.4.2_gemini-3-7-flash Validate #67: Pull request #26 opened by john-b-yang

34s add-20260815_mini-v2.4.2_gemini-3-7-flash

add-20260815_mini-v2.4.2_gemini-3-7-flash

34s

Add submission: 20260731_mini-v2.4.2_gemini-3-6-flash (#21) Validate #65: Commit 5e4ffaa pushed by john-b-yang

28s main

28s

Add submission: 20260802_mini-v2.4.2_gpt-5-6-sol-xhigh (#24) Validate #64: Commit 3d8d046 pushed by john-b-yang

27s main

27s

Add submission: 20260730_mini-v2.2.8_gpt-5-6-sol (#23) Validate #63: Commit d94706d pushed by john-b-yang

24s main

24s

Add submission: 20260731_mini-v2.4.2_opus-5-xhigh (#22) Validate #62: Commit 02f2dd8 pushed by john-b-yang

21s main

21s

Add submission: 20260729_mini-v2.2.8_gemini-3-5-flash (#20) Validate #61: Commit 5289b7a pushed by john-b-yang

31s main

31s

Add submission: 20260802_mini-v2.4.2_gpt-5-6-sol-xhigh Validate #60: Pull request #24 opened by john-b-yang

19s add-20260802_mini-v2.4.2_gpt-5-6-sol-xhigh

add-20260802_mini-v2.4.2_gpt-5-6-sol-xhigh

19s

Add submission: 20260730_mini-v2.2.8_gpt-5-6-sol Validate #59: Pull request #23 opened by john-b-yang

20s add-20260730_mini-v2.2.8_gpt-5-6-sol

add-20260730_mini-v2.2.8_gpt-5-6-sol

20s

Add submission: 20260731_mini-v2.4.2_opus-5-xhigh Validate #58: Pull request #22 opened by john-b-yang

21s add-20260731_mini-v2.4.2_opus-5-xhigh

add-20260731_mini-v2.4.2_opus-5-xhigh

21s

Add submission: 20260731_mini-v2.4.2_gemini-3-6-flash Validate #57: Pull request #21 opened by john-b-yang

19s add-20260731_mini-v2.4.2_gemini-3-6-flash

add-20260731_mini-v2.4.2_gemini-3-6-flash

19s

Add submission: 20260729_mini-v2.2.8_gemini-3-5-flash Validate #56: Pull request #20 opened by john-b-yang

25s add-20260729_mini-v2.2.8_gemini-3-5-flash

add-20260729_mini-v2.2.8_gemini-3-5-flash

25s

Add token count info Validate #55: Commit ebe7eeb pushed by john-b-yang

22s main

22s

Add cost info for two models Validate #54: Commit 925f91d pushed by john-b-yang

22s main

22s

Minor Opus 4.8 name update Validate #53: Commit cf05729 pushed by john-b-yang

14s main

14s

Add submission: 20260717_mini-v2.4.5_opus-4.8-xhigh (#19) Validate #52: Commit 91a69a5 pushed by john-b-yang

17s main

17s

Add submission: 20260717_mini-v2.4.5_glm-5.2 (#18) Validate #51: Commit 38d9a9c pushed by john-b-yang

18s main

18s

Update leaderboard compilation Validate #50: Commit 378ffae pushed by john-b-yang

15s main

15s

Add submission: 20260717_mini-v2.4.5_opus-4.8-xhigh Validate #49: Pull request #19 opened by john-b-yang

14s add-20260717_mini-v2.4.5_opus-4.8-xhigh

add-20260717_mini-v2.4.5_opus-4.8-xhigh

14s

Add submission: 20260717_mini-v2.4.5_glm-5.2 Validate #48: Pull request #18 opened by john-b-yang

14s add-20260717_mini-v2.4.5_glm-5.2

add-20260717_mini-v2.4.5_glm-5.2

14s

Leaderboard: mean_score over the full benchmark (200), not attempted Validate #41: Commit bde5ebd pushed by john-b-yang

16s main

16s

Add manual paper-baseline entry: Claude Opus 4.7 (xhigh reasoning) Validate #40: Commit 8d765ee pushed by john-b-yang

16s main

16s

Add submission: 20260508_mini-v2.2.6_gpt-5-5-xhigh (#12) Validate #39: Commit d0fc9d4 pushed by john-b-yang

19s main

19s

Add submission: 20260507_mini-v2.2.6_gpt-5-5-high (#11) Validate #38: Commit 0204653 pushed by john-b-yang

20s main

20s