Skip to content

feat: add Malay BFCL benchmark dashboard - #1

Merged
farhan-helmy merged 1 commit into
mainfrom
feat/benchmark-pages
Aug 19, 2026
Merged

feat: add Malay BFCL benchmark dashboard#1
farhan-helmy merged 1 commit into
mainfrom
feat/benchmark-pages

Conversation

@farhan-helmy

Copy link
Copy Markdown
Contributor

Summary

PixelSpaceAI now has a public dashboard for the Malay BFCL benchmark. It turns the canonical comparison JSON into a responsive leaderboard, category views, and exact score tables without duplicating benchmark data.

The dashboard build rejects malformed or inconsistent scores before deployment. Pull requests run the same build and headless-browser smoke test, while only main can publish to GitHub Pages.

Validation

  • 10 site build and browser tests pass.
  • 49 benchmark harness tests pass.
  • The built page was opened in headless Chrome at desktop and narrow mobile widths.
  • Canonical scores, category selection, and the failed-data error state were verified.
  • JavaScript syntax, Python compilation, the production build, and git diff --check pass.

Code review: complete (run_id: 20260819-125300-292cb4aa). All four validated findings were fixed before commit.

Post-Deploy Monitoring & Validation

  • Check the Deploy benchmark dashboard workflow for successful build, artifact upload, and Pages deployment jobs.
  • Open https://pixelspaceai.github.io/benchmark/ and confirm HTTP 200, 76.54%, ILMU Mini v3.3, and category controls render.
  • Healthy signal: the live page uses the current canonical comparison JSON and category links update without console errors.
  • Failure signal: a 404, a visible data-load error, stale scores, or a failed Pages job. Re-run the workflow for transient failures; revert the merge if the built artifact is invalid.
  • Validation window and owner: immediate post-merge verification by the PixelSpaceAI maintainer.

Compound Engineering

@farhan-helmy
farhan-helmy merged commit b69f181 into mainAug 19, 2026
2 checks passed
@farhan-helmy
farhan-helmy deleted the feat/benchmark-pages branch August 19, 2026 05:13
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@farhan-helmy