Skip to content

Mutation-testing findings and the hand-verification protocol - #377

Merged
IanFrelinger merged 1 commit into
masterfrom
claude/mutation-notes
Aug 23, 2026
Merged

Mutation-testing findings and the hand-verification protocol#377
IanFrelinger merged 1 commit into
masterfrom
claude/mutation-notes

Conversation

@IanFrelinger

Copy link
Copy Markdown
Owner

Closes gold plan step 5. Both Stryker modes produced false survivors — verified by hand-applying the two scariest mutants (15 and 7 test failures). By hand-verification AdmissionGate is 35/35 mutation-killed. Checked-in accurate-mode config for manual per-release runs; deliberately not a CI gate until the false-survivor cause is understood — a gate that cries wolf trains people to ignore gates.

🤖 Generated with Claude Code

…nfig, and the protocol

Step 5 of the gold plan closed. The headline is about the TOOL, not the code: both
Stryker modes produced false survivors (verified by hand-applying the two scariest
mutants — 15 and 7 test failures respectively). By hand-verification AdmissionGate
is 35/35 mutation-killed. The run still earned its keep: four survivor clusters
were real test-inventory gaps, killed by six tests in #376.

stryker-config.json is checked in pinning accurate mode for manual per-release
runs; mutation testing is deliberately NOT wired as a CI gate until the
false-survivor cause is understood — a gate that cries wolf trains people to
ignore gates, which is the one lesson this product cannot afford to teach.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@IanFrelinger
IanFrelinger merged commit 8250aca into master Aug 23, 2026
7 checks passed
@IanFrelinger
IanFrelinger deleted the claude/mutation-notes branch August 23, 2026 19:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants