feat(ISSUE-263): W5-C1 golden set 标定 (#286) - #84
Merged
Conversation
golden set 建设（W5-C1 .github#286 / AC-8）： - pipeline/adversary/golden_set.py：golden set 加载、盲化注入（剥来源元数据同批混排）、 全量重放、回归断言（native 模式确定性，免 LLM；llm 模式可选） - pipeline/adversary/calibrate.py：criteria 变更检测 + SHA 强一致校验 + 标定记录落盘 （标定 SHA / golden 版本 / 定标时间机器可查；criteria 变更未重标定 = fail-closed 判红） - pipeline/adversary/fixtures/golden/samples/：已知不合格样本（构造独立于判定脚本： 全零聚合分 / 边界 0.69 vs 0.7 / token 账 void / 非 golden 随机低分反特判） - pipeline/adversary/holdout_registry.py：holdout 注册 / sealed_sha256 hash 校验 （复用 ADR-0068 揭封公式）/ PR 引用一致性 / 验证者 APP 身份校验 （W2-C4 .github#276；verifier_app.id=null 时降级留痕，代码先实现） - pipeline/adversary/tests/：golden_set 14 例 + holdout_registry 11 例，全绿 Closes Cloudbird-Software/.github#286 Relates to Cloudbird-Software/.github#276
This was referenced Aug 23, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
（剥 id/source/type/expected_verdict 元数据，与正常样本同批混排）；每次 run 全量重放
（SHA 强一致，标定记录留档）。
PR 引用 hash 与注册一致性；验证者 APP 身份校验（verifier_app.id=null 时降级留痕，
代码先实现，IFACE-01 时序约束）。
Test plan
python -m pytest pipeline/adversary/tests/test_golden_set.py— 14 passedpython -m pytest pipeline/adversary/tests/test_holdout_registry.py— 11 passedpython pipeline/adversary/golden_set.py regress --mode native— 4/4 回归通过python pipeline/adversary/calibrate.py run/verify— SHA 强一致校验通过python pipeline/adversary/holdout_registry.py verify-hash/check-pr/register—tamper 检测 / 未知 id 拦截 / 非验证者 403 全命中
Closes Cloudbird-Software/.github#286
Relates to Cloudbird-Software/.github#276