Uh oh!
There was an error while loading. Please reload this page.
updates for leaderboard! - #100
Conversation
…is.py - Add baseline_file param to override default baseline path - Add eval_results_dir param to override default runs directory - Add output_file param to write results as JSON - Return results dict from analyze_greedy_eval() - All changes backward compatible (existing usage unchanged)
153e0cb to
87ba3c2Comparepythonomar22
commented
Dec 31, 2025
this has just sort of become a PR that contains all the changes needed to work with the external leaderboard repo. a couple things here:
|
simonguozirui
commented
Dec 31, 2025
LGTM, tysm for the thoughtful PR @pythonomar22
|
* Add optional path parameters and JSON output to benchmark_eval_analysis.py - Add baseline_file param to override default baseline path - Add eval_results_dir param to override default runs directory - Add output_file param to write results as JSON - Return results dict from analyze_greedy_eval() - All changes backward compatible (existing usage unchanged) * h100 modal timing, and some changes * lgtm; nit small annotation --------- Co-authored-by: Simon Guo <simonguo@stanford.edu>
* Add optional path parameters and JSON output to benchmark_eval_analysis.py - Add baseline_file param to override default baseline path - Add eval_results_dir param to override default runs directory - Add output_file param to write results as JSON - Return results dict from analyze_greedy_eval() - All changes backward compatible (existing usage unchanged) * h100 modal timing, and some changes * lgtm; nit small annotation --------- Co-authored-by: Simon Guo <simonguo@stanford.edu>
No description provided.