Skip to content

Stanford cs107 fall 2023 final - #53

Merged
tareknaser merged 5 commits into
refactor_course_exam_benchfrom
stanford_cs107_exams
Jan 9, 2026
Merged

Stanford cs107 fall 2023 final#53
tareknaser merged 5 commits into
refactor_course_exam_benchfrom
stanford_cs107_exams

Conversation

@jq-huang

@jq-huangjq-huang commented Jan 8, 2026•
edited
Loading

Copy link
Copy Markdown
Collaborator

Description

Added final exam of cs107 in fall 2023, modified the regular expression match when extracting json metadata of exams, as current one can't deal with situations where answer field of a question's metadata contains code block with '`'

Changes

  • Added cs107 fall 2023 exam
  • Modified regular expressions match in prepare_dataset.py

Testing

Ran benchmarks/courseexam_bench/tests/test_data_schema.py

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

@tareknaser
tareknaser self-requested a review January 8, 2026 16:55
@tareknaser

tareknaser commented Jan 8, 2026

Copy link
Copy Markdown
Collaborator

Could you also share the original exam?

@xuafeng
xuafeng requested a review from qimcisJanuary 8, 2026 18:17
@jq-huang

jq-huang commented Jan 8, 2026

Copy link
Copy Markdown
CollaboratorAuthor

@tareknaser Would you like me to upload the pdf to the same directory of exam.md or not?

@tareknaser

tareknaser commented Jan 8, 2026

Copy link
Copy Markdown
Collaborator

Would you like me to upload the pdf to the same directory of exam.md or not?

Yes please

@jq-huang

jq-huang commented Jan 8, 2026

Copy link
Copy Markdown
CollaboratorAuthor

@tareknaser it's done

tareknaser
tareknaser reviewed Jan 8, 2026
View reviewed changes

@tareknasertareknaser left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! I reviewed this and everything makes sense. it’s clear that it’s well thought out. I have minor comments and a couple of questions but I think this is very close to be merged

Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md Outdated
Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md Outdated
Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md
Comment threadbenchmarks/courseexam_bench/data/cs107_computer_organization_&_systems_fall_2023_final/exam.md
@jq-huang

jq-huang commented Jan 8, 2026

Copy link
Copy Markdown
CollaboratorAuthor

@tareknaser a new commit dealing with the comments above is pushed

tareknaser
tareknaser approved these changes Jan 8, 2026
View reviewed changes

@tareknasertareknaser left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the nice work

@tareknaser
tareknaser merged commit dba91ed into refactor_course_exam_benchJan 9, 2026
1 check passed
tareknaser pushed a commit that referenced this pull request Jan 9, 2026
@jq-huang@tareknaser
Stanford cs107 fall 2023 final (#53)
76d676a
* modified the regular expression match
* added cs107_fall_2023_final
* updated one wrong tag
* Added pdf of the paper
* solved all the comments
@tareknaser
tareknaser deleted the stanford_cs107_exams branch January 15, 2026 16:56
Couen pushed a commit to Couen/system-intelligence-benchmark that referenced this pull request Jan 22, 2026
@jq-huang@tareknaser
Stanford cs107 fall 2023 final (sys-intelligence#53)
bd29681
* modified the regular expression match
* added cs107_fall_2023_final
* updated one wrong tag
* Added pdf of the paper
* solved all the comments
tareknaser pushed a commit that referenced this pull request Feb 5, 2026
@jq-huang@tareknaser
Stanford cs107 fall 2023 final (#53)
757a58d
* modified the regular expression match
* added cs107_fall_2023_final
* updated one wrong tag
* Added pdf of the paper
* solved all the comments
Couen pushed a commit to Couen/system-intelligence-benchmark that referenced this pull request Feb 25, 2026
@jq-huang@tareknaser
Stanford cs107 fall 2023 final (sys-intelligence#53)
e6bbcad
* modified the regular expression match
* added cs107_fall_2023_final
* updated one wrong tag
* Added pdf of the paper
* solved all the comments
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tareknasertareknasertareknaser approved these changes
@qimcisqimcisqimcis approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@jq-huang@tareknaser@qimcis