Skip to content

Agent metrics weekly summary #330

Open
Open
Agent metrics weekly summary#330
Labels
tracker:durablePermanently-open tracker; excluded from open-issue backlog counts

Description

@agents-workflows-bot
agents-workflows-bot
bot
opened on Apr 27, 2026

Tracking issue for weekly agent workflow metrics.

Agent Metrics Summary

Generated: 2026-04-27T06:48:32Z
Records: 49 (keepalive 40, autofix 0, verifier 3, terminal dispositions 3, verifier follow-up ledgers 3, codex CLI freshness 0, autopilot 0, unknown 0)
Parse errors: 0
Range: 2026-04-27T03:27:59.967000Z to 2026-04-27T06:30:51.992000Z

Keepalive

  • Runs: 40
  • PRs: 5
  • Avg iterations: 0.0
  • Stop reasons: missing-agent-label (20), autofix disabled for this pull request (7), upstream Gate succeeded (7), missing workflow_run payload (6)
  • Actions: wait (20)
  • Gate conclusions: cancelled (9), success (7)
  • Tasks complete rate: 0.0% (0/40)

Autofix

  • Attempts: 0
  • PRs: 0
  • Fixes applied: n/a
  • Trigger reasons: n/a
  • Gate results after: n/a

Verifier

  • Runs: 3
  • PRs: 3
  • Verdicts: CONCERNS (2), concerns (2), PASS (1), pass (1)
  • Issues created: 0
  • Avg acceptance criteria: 7.3
  • Terminal disposition records: 3
  • Terminal dispositions: needs-human (2), verified-pass (1)
  • Terminal disposition sources: pull-request:324 (1), pull-request:326 (1), pull-request:328 (1)
  • Terminal artifact families: review-thread-terminal-disposition: missing (0/0), verifier-terminal-disposition: selected (3/3)
  • Missing terminal artifact families: review-thread-terminal-disposition
  • Verifier follow-up ledger records: 3
  • Verifier follow-up ledger dispositions: needs-human (2), merge (1)
  • Verifier follow-up ledger PRs: 3
  • Verifier follow-up issues linked: 0
  • Verifier follow-up needs-human records: 2
  • Verifier follow-up avg chain depth: 0.0
  • Verifier follow-up max chain depth: 0
  • Verifier follow-up policy records: 3
  • Verifier follow-up policy actions: needs-human (2), no-op (1)
  • Verifier follow-up policy triggers: verifier-concerns (2), verifier-pass (1)
  • Verifier follow-up depth-limit records: 0
  • Verifier models: gpt-5.5 (6)
  • Verifier CLI versions: codex-cli 0.125.0 (6)
  • Unsupported verifier models: n/a
  • Unsupported model dispositions: n/a
  • Missing verifier model metadata: n/a
  • Legacy missing verifier model metadata: n/a
  • Model selection reasons: default (6)
  • Verifier modes: compare (6)

Codex CLI Freshness

  • Records: 0
  • Statuses: n/a
  • Packages: n/a
  • Pinned versions: n/a
  • Latest versions: n/a
  • Outdated records: 0
  • Latest unavailable records: 0
  • Max version delta: major 0, minor 0, patch 0
  • Update targets: n/a

Weekly Metrics Artifact Selection

  • Schema: workflows-weekly-metrics-artifact-selection/v1
  • Status: pass
  • Lookback days: 14
  • Scan cap: 5 pages x 100 artifacts
  • Priority producer scan cap: 10 runs per source workflow
  • Download cap: 80 total, 20 per family
  • Scanned artifacts: 500
  • Candidate artifacts: 228
  • Selected artifacts: 46
  • Missing priority families: codex-cli-freshness, review-thread-terminal-disposition, bot-comment-auth-coverage-wrapper, bot-comment-auth-coverage-reusable, pr-source-context
  • Ignored: 0 old, 0 expired, 272 non-metrics, 182 over family cap, 0 over total cap
Artifact family Candidates Selected
agents-autofix-metrics 111 20
agents-verifier-metrics 3 3
keepalive-metrics 111 20
verifier-terminal-disposition 3 3
Priority family Status Candidates Selected artifact
codex-cli-freshness missing 0 none
verifier-terminal-disposition selected 3 verifier-terminal-disposition-24979936966
review-thread-terminal-disposition missing 0 none
bot-comment-auth-coverage-wrapper missing 0 none
bot-comment-auth-coverage-reusable missing 0 none
pr-source-context missing 0 none

Weekly Metrics Artifact Downloads

  • Schema: workflows-weekly-metrics-artifact-download-manifest/v1
  • Status: pass
  • Selected artifacts: 46
  • Downloads: 46 passed, 0 failed
  • Unzip: 46 passed, 0 failed, 0 skipped
Artifact ID Download Unzip Path
verifier-terminal-disposition-24979936966 6654492945 pass pass artifacts/verifier-terminal-disposition-24979936966/6654492945
keepalive-metrics 6654665073 pass pass artifacts/keepalive-metrics/6654665073
agents-autofix-metrics 6654664048 pass pass artifacts/agents-autofix-metrics/6654664048
keepalive-metrics 6654645019 pass pass artifacts/keepalive-metrics/6654645019
agents-autofix-metrics 6654626589 pass pass artifacts/agents-autofix-metrics/6654626589
keepalive-metrics 6654612993 pass pass artifacts/keepalive-metrics/6654612993
agents-autofix-metrics 6654608653 pass pass artifacts/agents-autofix-metrics/6654608653
agents-verifier-metrics 6654493083 pass pass artifacts/agents-verifier-metrics/6654493083
keepalive-metrics 6654472102 pass pass artifacts/keepalive-metrics/6654472102
agents-autofix-metrics 6654470443 pass pass artifacts/agents-autofix-metrics/6654470443
keepalive-metrics 6654459796 pass pass artifacts/keepalive-metrics/6654459796
agents-autofix-metrics 6654459548 pass pass artifacts/agents-autofix-metrics/6654459548
keepalive-metrics 6653829842 pass pass artifacts/keepalive-metrics/6653829842
agents-autofix-metrics 6653828564 pass pass artifacts/agents-autofix-metrics/6653828564
keepalive-metrics 6653820949 pass pass artifacts/keepalive-metrics/6653820949
agents-autofix-metrics 6653816949 pass pass artifacts/agents-autofix-metrics/6653816949
agents-autofix-metrics 6653795242 pass pass artifacts/agents-autofix-metrics/6653795242
keepalive-metrics 6653793251 pass pass artifacts/keepalive-metrics/6653793251
keepalive-metrics 6653298534 pass pass artifacts/keepalive-metrics/6653298534
agents-autofix-metrics 6653297263 pass pass artifacts/agents-autofix-metrics/6653297263
agents-autofix-metrics 6653294137 pass pass artifacts/agents-autofix-metrics/6653294137
keepalive-metrics 6653288409 pass pass artifacts/keepalive-metrics/6653288409
agents-autofix-metrics 6653279262 pass pass artifacts/agents-autofix-metrics/6653279262
keepalive-metrics 6653278896 pass pass artifacts/keepalive-metrics/6653278896
agents-autofix-metrics 6653266557 pass pass artifacts/agents-autofix-metrics/6653266557
keepalive-metrics 6653266458 pass pass artifacts/keepalive-metrics/6653266458
agents-verifier-metrics 6653185280 pass pass artifacts/agents-verifier-metrics/6653185280
verifier-terminal-disposition-24976147044 6653185167 pass pass artifacts/verifier-terminal-disposition-24976147044/6653185167
keepalive-metrics 6653167012 pass pass artifacts/keepalive-metrics/6653167012
agents-autofix-metrics 6653165792 pass pass artifacts/agents-autofix-metrics/6653165792
keepalive-metrics 6653158304 pass pass artifacts/keepalive-metrics/6653158304
agents-autofix-metrics 6653158173 pass pass artifacts/agents-autofix-metrics/6653158173
keepalive-metrics 6653134489 pass pass artifacts/keepalive-metrics/6653134489
agents-autofix-metrics 6653130389 pass pass artifacts/agents-autofix-metrics/6653130389
keepalive-metrics 6653125054 pass pass artifacts/keepalive-metrics/6653125054
agents-autofix-metrics 6653124566 pass pass artifacts/agents-autofix-metrics/6653124566
agents-autofix-metrics 6653116087 pass pass artifacts/agents-autofix-metrics/6653116087
keepalive-metrics 6653114957 pass pass artifacts/keepalive-metrics/6653114957
agents-autofix-metrics 6653103847 pass pass artifacts/agents-autofix-metrics/6653103847
keepalive-metrics 6653103556 pass pass artifacts/keepalive-metrics/6653103556
keepalive-metrics 6652909442 pass pass artifacts/keepalive-metrics/6652909442
agents-autofix-metrics 6652908761 pass pass artifacts/agents-autofix-metrics/6652908761
agents-autofix-metrics 6652901832 pass pass artifacts/agents-autofix-metrics/6652901832
keepalive-metrics 6652895092 pass pass artifacts/keepalive-metrics/6652895092
agents-verifier-metrics 6652842403 pass pass artifacts/agents-verifier-metrics/6652842403
verifier-terminal-disposition-24975035866 6652842337 pass pass artifacts/verifier-terminal-disposition-24975035866/6652842337

Terminal Disposition Coverage Preflight

  • Mode: warning-only (does not block merges or automation)
  • Requested mode: warning-only
  • Status: pass
  • Coverage status: pass
  • Hard block eligible: true
  • Hard block active: false
  • Input files: 3
  • Scanned records: 3
  • Terminal disposition records: 3
  • Non-terminal records: 0
  • Observed sources: 3
  • Expected review-thread sources: 0
  • Missing review-thread sources: 0
  • Parse errors: 0
  • Artifact selector status: pass
  • Terminal artifacts selected: 3
  • Terminal artifacts candidates: 3
  • Missing terminal artifact families: review-thread-terminal-disposition
  • Verifier model compatibility: pass
  • Unsupported verifier model records: 0
  • Missing verifier model metadata records: 0
  • Missing verifier model metadata records with unknown mode: 0
  • Legacy missing verifier model metadata records: 0
  • Unsupported verifier models: gpt-5.2-codex
Observed source Records Dispositions PRs
pull-request:324 1 verified-pass (1) #324
pull-request:326 1 needs-human (1) #326
pull-request:328 1 needs-human (1) #328
Terminal artifact family Status Candidates Selected Latest artifact
review-thread-terminal-disposition missing 0 0 n/a
verifier-terminal-disposition selected 3 3 verifier-terminal-disposition-24979936966

Bot Comment App Auth Coverage

  • Schema: workflows-bot-comment-auth-coverage-summary/v1
  • Status: no-data
  • Coverage status: no-data
  • Mode: warning-only
  • Hard block eligible: false
  • Hard block active: false
  • Input files: 0
  • Parsed JSON files: 0
  • Auth records: 0
  • Non-auth records: 0
  • Parse errors: 0
  • Read errors: 0
  • Artifact selection status: pass
  • Selected auth artifacts: 0
  • Required organic events: pull_request, workflow_run
  • Organic evidence status: no-data
  • Missing organic requirements: agents-bot-comment-handler-wrapper/pull_request, agents-bot-comment-handler-wrapper/workflow_run, reusable-bot-comment-handler/pull_request, reusable-bot-comment-handler/workflow_run
  • Blockers: missing-organic-agents-bot-comment-handler-wrapper-pull_request, missing-organic-agents-bot-comment-handler-wrapper-workflow_run, missing-organic-reusable-bot-comment-handler-pull_request, missing-organic-reusable-bot-comment-handler-workflow_run
Component Latest mode Records Expected Allowed Blockers
agents-bot-comment-handler-wrapper missing 0 client-id client-id missing-agents-bot-comment-handler-wrapper
reusable-bot-comment-handler missing 0 any client-id, none missing-reusable-bot-comment-handler

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    tracker:durablePermanently-open tracker; excluded from open-issue backlog counts

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions