Skip to content

[don't merge] testing only - Preserve unknown dispatcher abstentions - #2894

Draft
Dominic Nguyen (datduyng) wants to merge 3 commits into
mainfrom
domnguyen/tb-synthesis-quality-gates
Draft

[don't merge] testing only - Preserve unknown dispatcher abstentions#2894
Dominic Nguyen (datduyng) wants to merge 3 commits into
mainfrom
domnguyen/tb-synthesis-quality-gates

Conversation

@datduyng

@datduyngDominic Nguyen (datduyng) commented Aug 17, 2026

Copy link
Copy Markdown
Contributor

UnknownAction is a valid abstention result. Keep it in the dispatcher schema and return its schema name without throwing when sibling results are collected. This lets empty-gold scoring see the unknown result and filter it normally.

@datduyng
Dominic Nguyen (datduyng) changed the base branch from domnguyen/tb-policy-allowlist to mainAugust 17, 2026 23:20
@datduyngDominic Nguyen (datduyng) changed the title Add synthesis quality gates for translation benchmarksPreserve unknown dispatcher abstentionsAug 17, 2026
@datduyngDominic Nguyen (datduyng) changed the title Preserve unknown dispatcher abstentions[don't merge] testing only - Preserve unknown dispatcher abstentionsAug 20, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@datduyng