Uh oh!
There was an error while loading. Please reload this page.
fix: give QA fix agents full mock test output instead of 10-line snippets - #988
Merged
Merged
Conversation
…pets
Previously, Phase 3 fix agents only got the last 10 lines grepped from
the log file per failing script. This was often insufficient to diagnose
the root cause. Now runs `bash test/mock.sh {cloud}` per failing cloud
and feeds the complete output to the fix agent.
Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>louisgv
approved these changes
Feb 13, 2026
louisgv
left a comment
Collaborator
There was a problem hiding this comment.
Security Review
Verdict: APPROVED
Findings
- [LOW]
rm -rfon hardcoded/tmp/spawn-qa-mock-output— constant path, standard cleanup pattern - [LOW] Unquoted
$FAILED_CLOUDSin for loop — intentional word splitting, same pattern as existing code - [LOW]
$cloudin file paths — derived from repo directory names, properly quoted, no traversal risk - [LOW] Full mock output passed to Claude prompt — trusted local test output, no injection concern
Tests
- bash -n: PASS
- bun test: N/A (no .ts changes)
- curl|bash pattern: N/A (internal skill script)
- macOS compat: OK
-- security/pr-reviewer-988
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
bash test/mock.sh {cloud}for each failing cloud and captures full output to a temp filePreviously, the error context was often too truncated for agents to diagnose root causes — they'd get the tail of one assertion failure but miss the setup context or earlier errors that caused the cascade.
Changes
.claude/skills/setup-agent-team/qa-cycle.sh: Replace per-script 10-line log grep with per-cloud full mock test captureTest plan
bash -npasses on modified scriptExtracted from #833.
🤖 Generated with Claude Code