Skip to content

Review harness model sonnet resolves to unavailable claude-sonnet-4-6 on Vertex AI #187

Description

@fullsend-ai-retro

What happened

PR #181 added a derived review harness at .fullsend/harness/review.yaml with model: sonnet to switch reviews from Opus to Sonnet. The PR was merged on 2026-09-09 at 08:11 UTC. The first review attempt using the new config (run 34327800934 on PR #176) failed immediately (5 seconds, 0 tokens used) with the error: "The model claude-sonnet-4-6 is not available on your vertex deployment. Try --model to switch to claude-sonnet-4-5@20250929, or ask your admin to enable this model." The sonnet alias resolved to claude-sonnet-4-6, which is not provisioned on the repo's GCP Vertex AI endpoint.

What could go better

The derived harness uses the generic model: sonnet alias, which resolves to the latest Sonnet version at runtime. On Vertex AI deployments, model availability depends on what the admin has provisioned — latest-version aliases can resolve to models that aren't yet enabled. The model override was not validated against the deployment before merging. High confidence: this is confirmed by the error in run 34327800934, and all reviews on this repo will fail until corrected.

Proposed change

Update .fullsend/harness/review.yaml to use an explicit model version known to be available on the Vertex AI deployment. Based on the error message, change model: sonnet to model: claude-sonnet-4-5@20250929. Alternatively, coordinate with the GCP admin to enable claude-sonnet-4-6 on the deployment and keep the current config. The explicit version pin is safer because it avoids future breakage if the sonnet alias advances again before the deployment is updated.

Validation criteria

After the config fix, trigger /fs-review on PR #176 (or any open PR) and verify: (1) the review agent starts successfully without a model availability error, (2) the review completes and posts findings, (3) the status comment shows the correct Sonnet model version.


Generated by retro agent from #181

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingready-for-triageTriggers triage agent dispatchready-to-codeTriggers code agent dispatch

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions