Skip to content

fix(deps): bump protocol for the merged simulation overall_score - #976

Merged
u9g merged 1 commit into
mainfrom
jason/overall-score
Sep 16, 2026
Merged

u9g merged 1 commit into
mainfrom
jason/overall-score

Conversation

@u9g

@u9g u9g commented Sep 14, 2026

Copy link
Copy Markdown
Contributor

Picks up livekit/protocol#1800, which replaces accuracy_score and experience_score on SimulationRun.JobMetrics and RunMetrics with a single overall_score. The CLI never reads those fields by name: lk agent simulate --json marshals the whole run message, so its output drops the two old keys and gains overallScore once the worker ships (https://github.com/livekit/agents-private/pull/456). No code change.

The generated OpenAPI client in pkg/public/oapi/oapi.gen.go still names the old fields; it regenerates from the deployed API spec, so that is a follow-up once the API is live.

The pin now points at the merged protocol commit livekit/protocol@3c0fcdb (v1.51.1-0.20260915182407-3c0fcdbd25df).

SimulationRun.JobMetrics and RunMetrics now carry overall_score in place
of accuracy_score and experience_score (livekit/protocol#1800, merged as
3c0fcdbd). The CLI marshals the whole message for --json output, so the
field follows the protocol with no code change.

Also drop the stale commented-out local protocol replace directive.
@u9g
u9g force-pushed the jason/overall-score branch from 444bae1 to 18bc0db Compare September 15, 2026 18:27
@u9g
u9g marked this pull request as ready for review September 15, 2026 18:28
@u9g
u9g merged commit 89ab3e1 into main Sep 16, 2026
25 checks passed
@u9g
u9g deleted the jason/overall-score branch September 16, 2026 12:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants