Skip to content

[exam] Add UW Madison CS537 Fall 2021 Exam - #55

Merged
tareknaser merged 7 commits into
refactor_course_exam_benchfrom
cs537-exam/add-fall-2021-final
Jan 12, 2026
Merged

[exam] Add UW Madison CS537 Fall 2021 Exam#55
tareknaser merged 7 commits into
refactor_course_exam_benchfrom
cs537-exam/add-fall-2021-final

Conversation

@qimcis

@qimcisqimcis commented Jan 8, 2026

Copy link
Copy Markdown
Collaborator

Description

Added cs537 fall 2021 final, find the original exam here

Testing

Ran benchmarks/courseexam_bench/tests/test_data_schema.py

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

@tareknaser
tareknaser self-requested a review January 8, 2026 16:55
tareknaser
tareknaser requested changes Jan 8, 2026
View reviewed changes

@tareknasertareknaser left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for putting this together! I left a few comments but it's in good shape overall

Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md Outdated
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md Outdated
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md Outdated
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md
@qimcis
qimcis requested a review from tareknaserJanuary 9, 2026 01:51
@tareknaser

tareknaser commented Jan 10, 2026

Copy link
Copy Markdown
Collaborator

If #61 gets merged first, we’ll need some small updates to ExactMatch questions
mainly adding the options in the JSON for the LLM to choose from

@qimcis

qimcis commented Jan 10, 2026

Copy link
Copy Markdown
CollaboratorAuthor

If #61 gets merged first, we’ll need some small updates to ExactMatch questions mainly adding the options in the JSON for the LLM to choose from

added! should be good to go once #61 is merged

tareknaser
tareknaser approved these changes Jan 12, 2026
View reviewed changes

@tareknasertareknaser left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!
I added a few minor comments but all the previous comments have been addressed and I’ve approved this PR

Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/cs537-21-fall-final.pdf Outdated
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md Outdated
Comment threadbenchmarks/courseexam_bench/data/cs537_fall_2021_final/exam.md Outdated
@tareknaser
avoid extra restrictions on LLM output
1602217
Signed-off-by: Tarek <tareknaser360@gmail.com>
@tareknaser
tareknaser merged commit 1ba10f8 into refactor_course_exam_benchJan 12, 2026
tareknaser added a commit that referenced this pull request Jan 13, 2026
@qimcis@tareknaser
[exam] Add UW Madison CS537 Fall 2021 Exam (#55)
731af86
* add cs537 fall 2021 final exam
* add institution
* fix
* add solutions
* update metadata
* add choice array
* avoid extra restrictions on LLM output
Signed-off-by: Tarek <tareknaser360@gmail.com>
---------
Signed-off-by: Tarek <tareknaser360@gmail.com>
Co-authored-by: Tarek <tareknaser360@gmail.com>
@tareknaser
tareknaser deleted the cs537-exam/add-fall-2021-final branch January 15, 2026 16:56
tareknaser added a commit that referenced this pull request Feb 5, 2026
@qimcis@tareknaser
[exam] Add UW Madison CS537 Fall 2021 Exam (#55)
4b504df
* add cs537 fall 2021 final exam
* add institution
* fix
* add solutions
* update metadata
* add choice array
* avoid extra restrictions on LLM output
Signed-off-by: Tarek <tareknaser360@gmail.com>
---------
Signed-off-by: Tarek <tareknaser360@gmail.com>
Co-authored-by: Tarek <tareknaser360@gmail.com>
Couen pushed a commit to Couen/system-intelligence-benchmark that referenced this pull request Feb 25, 2026
@qimcis@tareknaser
[exam] Add UW Madison CS537 Fall 2021 Exam (sys-intelligence#55)
01a2cfe
* add cs537 fall 2021 final exam
* add institution
* fix
* add solutions
* update metadata
* add choice array
* avoid extra restrictions on LLM output
Signed-off-by: Tarek <tareknaser360@gmail.com>
---------
Signed-off-by: Tarek <tareknaser360@gmail.com>
Co-authored-by: Tarek <tareknaser360@gmail.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@xuafengxuafengxuafeng left review comments
@tareknasertareknasertareknaser approved these changes
@paizhangliupaizhangliuAwaiting requested review from paizhangliu

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@qimcis@tareknaser@xuafeng