Skip to content

[P1] Fake tests 无阻断机制:同义反复测试可绕过质量门禁 #34

Description

@randypanding

问题描述

测试政策 T-10 mutation testing 为 weekly 运行,score<60% 标记为 fake_tests 风险。但无机制检测 builder 生成同义反复测试(test 和实现用同一方法),也无机制强制阻断 fake tests。Mutation 结果无人分析,weekly 频率在快速迭代中不够及时。

影响范围

  • governance/policy/testing.yaml: T-10 mutation
  • agent.schema.yaml: guardrails

严重度

P1 — Fake tests 可绕过质量门禁

改进建议

  1. 增加测试独立性检查(LLM 检测 test 和实现的相似度)
  2. Mutation 结果纳入 gate(非 weekly)
  3. 增加 test-author 独立审查步骤

红队演练来源

2026-08-19 红队演练:CI 与供应链

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1P1 级重要问题gateGate 工作流相关red-team红队演练发现

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions