chore: sync workflow templates by stranske · Pull Request #599 · stranske/Template

stranske · 2026-04-26T04:58:36Z

Sync Summary

Files Updated

agents-bot-comment-handler.yml: Bot comment handler - dispatches agents to address bot review comments (deprecated; replaced by agents-80-pr-event-hub.yml, removal no earlier than 2026-02-15)
aggregate_agent_metrics.py: Aggregates downloaded weekly agent metrics - required by agents-weekly-metrics.yml
terminal_disposition.js: Machine-readable terminal disposition records and source summaries
terminal_disposition_coverage.js: Warning-only terminal disposition source coverage preflight
bot_comment_auth_coverage.js: Warning-only bot-comment App auth coverage preflight
coverage_monitor_summary.js: Machine-readable weekly coverage monitor checkpoint
weekly_metrics_artifacts.js: Bounded weekly metrics artifact selection contract

Files Skipped

pr-00-gate.yml: File exists and sync_mode is create_only
ci.yml: File exists and sync_mode is create_only
dependabot.yml: File exists and sync_mode is create_only
llm_slots.json: None

Review Checklist

CI passes with updated workflows
No repo-specific customizations were overwritten

Source: stranske/Workflows
Manifest: .github/sync-manifest.yml

Automated sync from stranske/Workflows Template hash: f2ff566b326e Changes synced from sync-manifest.yml

agents-workflows-bot · 2026-04-26T04:58:51Z

⚠️ Action Required: Unable to determine source issue for PR #599. The PR title, branch name, or body must contain the issue number (e.g. #123, branch: issue-123, or the hidden marker ).

stranske-keepalive · 2026-04-26T05:00:20Z

🤖 Keepalive Loop Status

PR #599 | Agent: Codex | Iteration 0/5

Current State

Metric	Value
Iteration progress	[----------] 0/5
Action	wait (missing-agent-label)
Disposition	skipped (transient)
Gate	success
Tasks	0/11 complete
Timeout	45 min (default)
Timeout usage	5m elapsed (13%, 40m remaining)
Keepalive	❌ disabled
Autofix	❌ disabled

🔍 Failure Classification

stranske-keepalive · 2026-04-26T05:00:21Z

Keepalive Work Log (click to expand)

Time (UTC)	Agent	Action	Result	Files	Progress	Commit	Gate
2026-04-26 05:00:20	Codex	wait (missing-agent-label-transient)	skipped	—	0/11	—	cancelled
2026-04-26 05:01:25	Codex	wait (missing-agent-label-transient)	skipped	—	0/11	—	cancelled
2026-04-26 05:04:24	Codex	wait (missing-agent-label-transient)	skipped	—	0/11	—	success

Copilot

Pull request overview

This PR syncs workflow-template changes from stranske/Workflows, extending weekly metrics/coverage telemetry and adding additional terminal-disposition and bot-comment-auth coverage reporting details.

Changes:

Extend weekly verifier metrics aggregation to include model, model-selection reasons, and verifier mode counts.
Add wrapper terminal-disposition artifact emission to agents-bot-comment-handler.yml and enrich artifact-selection reporting (missing priority families / statuses).
Introduce a new coverage_monitor_summary.js contract to summarize weekly coverage monitor checkpoints.

Reviewed changes

Copilot reviewed 7 out of 7 changed files in this pull request and generated 3 comments.

Show a summary per file

File	Description
`scripts/aggregate_agent_metrics.py`	Adds verifier model / selection-reason / mode rollups to the weekly metrics summary output.
`.github/workflows/agents-bot-comment-handler.yml`	Emits wrapper terminal-disposition artifacts and propagates skip reasons for clearer telemetry.
`.github/scripts/weekly_metrics_artifacts.js`	Adds “missing priority families” and per-family status reporting to artifact selection output/markdown.
`.github/scripts/terminal_disposition_coverage.js`	Expands artifact-selection normalization and markdown reporting for terminal coverage preflight.
`.github/scripts/terminal_disposition.js`	Extends terminal-disposition schema normalization to include LLM metadata fields.
`.github/scripts/coverage_monitor_summary.js`	New script to build a machine-readable weekly coverage monitor summary and markdown output.
`.github/scripts/bot_comment_auth_coverage.js`	Enhances organic-evidence reporting with skipped/missing requirement details (esp. wrapper vs reusable expectations).

Copilot · 2026-04-26T05:05:32Z

+      - name: Upload wrapper terminal disposition
+        if: always()
+        uses: actions/upload-artifact@v7
+        with:
+          name: review-thread-terminal-disposition-${{ github.run_id }}
+          path: |
+            agent-metrics/review-thread-terminal-disposition.ndjson
+            terminal-disposition-summary.md
+          if-no-files-found: error


actions/upload-artifact is referenced via the floating @v7 tag here, while the rest of the repo pins third-party actions to full commit SHAs. Please pin this action to a specific SHA (with the inline major-version comment) to avoid supply-chain risk and unexpected breakages.

Copilot · 2026-04-26T05:05:32Z

+      - name: Write wrapper terminal disposition
+        if: always()
+        env:
+          RESOLVED_PR_NUMBER: ${{ steps.resolve.outputs.pr_number }}
+          REUSABLE_INVOCATION_EXPECTED: ${{ steps.resolve.outputs.should_run }}
+          SKIP_REASON: ${{ steps.resolve.outputs.skip_reason }}
+        run: |
+          mkdir -p agent-metrics
+          node <<'NODE'


The new wrapper step executes node directly, but this workflow/job never sets up a specific Node version (no actions/setup-node). For consistency with other workflows and to avoid runner-image drift, add a pinned actions/setup-node step (Node 20) before running setup-api-client/Node scripts in this job.

Copilot · 2026-04-26T05:05:32Z

+
+function overallStatus(monitors) {
+  if (monitors.some((monitor) => monitor.should_fail || monitor.status === 'fail')) return 'fail';
+  if (monitors.some((monitor) => ['missing', 'parse-error', 'warning'].includes(monitor.status))) {


overallStatus() doesn’t treat monitor status === 'unknown' as a warning/missing state. If a report parses but has a missing/invalid status (so normalizeStatus() returns 'unknown'), the overall result can incorrectly be pass. Consider including 'unknown' in the warning set (or mapping it to 'parse-error').

Suggested change

if (monitors.some((monitor) => ['missing', 'parse-error', 'warning'].includes(monitor.status))) {

if (monitors.some((monitor) => ['missing', 'parse-error', 'warning', 'unknown'].includes(monitor.status))) {

chore: sync workflow templates from Workflows repo

a1aa1ee

Automated sync from stranske/Workflows Template hash: f2ff566b326e Changes synced from sync-manifest.yml

stranske added sync Automated sync from Workflows automated Automated sync from Workflows labels Apr 26, 2026

Copilot AI review requested due to automatic review settings April 26, 2026 04:58

stranske added sync Automated sync from Workflows automated Automated sync from Workflows labels Apr 26, 2026

stranske temporarily deployed to agent-standard April 26, 2026 04:58 — with GitHub Actions Inactive

stranske temporarily deployed to agent-standard April 26, 2026 04:59 — with GitHub Actions Inactive

Copilot started reviewing on behalf of stranske April 26, 2026 05:00 View session

Copilot AI reviewed Apr 26, 2026

View reviewed changes

agents-workflows-bot Bot mentioned this pull request Apr 26, 2026

fix: align weekly metrics review contracts stranske/Workflows#1883

Merged

This was referenced Apr 26, 2026

fix: harden verifier metrics and artifact downloads stranske/Workflows#1893

Merged

Fix sync campaign issue reuse and marker size stranske/Workflows#1896

Merged

stranske closed this Apr 29, 2026

agents-workflows-bot Bot deleted the sync/workflows-f2ff566b326e branch May 14, 2026 19:31

Navigation Menu

chore: sync workflow templates - #599

chore: sync workflow templates#599
stranske wants to merge 1 commit into
mainfrom
sync/workflows-f2ff566b326e

stranske commented Apr 26, 2026

Uh oh!

agents-workflows-bot Bot commented Apr 26, 2026

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 •

edited

Loading

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

	if (monitors.some((monitor) => ['missing', 'parse-error', 'warning'].includes(monitor.status))) {
	if (monitors.some((monitor) => ['missing', 'parse-error', 'warning', 'unknown'].includes(monitor.status))) {

Conversation

stranske commented Apr 26, 2026

Sync Summary

Files Updated

Files Skipped

Review Checklist

Uh oh!

agents-workflows-bot Bot commented Apr 26, 2026

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🤖 Keepalive Loop Status

Current State

🔍 Failure Classification

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

stranske-keepalive Bot commented Apr 26, 2026 •

edited

Loading

stranske-keepalive Bot commented Apr 26, 2026 •

edited

Loading