chore: sync workflow templates by stranske · Pull Request #288 · stranske/Inv-Man-Intake

stranske · 2026-04-26T09:40:26Z

Sync Summary

Files Updated

agents-81-gate-followups.yml: Gate followups hub - consolidates keepalive and autofix followups
agents-bot-comment-handler.yml: Bot comment handler - dispatches agents to address bot review comments (deprecated; replaced by agents-80-pr-event-hub.yml, removal no earlier than 2026-02-15)
agents-weekly-metrics.yml: Weekly metrics - aggregates auto-pilot, keepalive, autofix and verifier metrics into summary reports
aggregate_agent_metrics.py: Aggregates downloaded weekly agent metrics - required by agents-weekly-metrics.yml
terminal_disposition.js: Machine-readable terminal disposition records and source summaries
terminal_disposition_coverage.js: Warning-only terminal disposition source coverage preflight
bot_comment_auth_coverage.js: Warning-only bot-comment App auth coverage preflight
coverage_monitor_summary.js: Machine-readable weekly coverage monitor checkpoint
weekly_metrics_artifacts.js: Bounded weekly metrics artifact selection contract
weekly_metrics_download_manifest.js: Weekly metrics artifact download and extraction manifest contract
agents_pr_meta_update_body.js: Updates PR body with agent metadata

Files Skipped

pr-00-gate.yml: File exists and sync_mode is create_only
ci.yml: File exists and sync_mode is create_only
dependabot.yml: File exists and sync_mode is create_only
llm_slots.json: None

Review Checklist

CI passes with updated workflows
No repo-specific customizations were overwritten

Source: stranske/Workflows
Manifest: .github/sync-manifest.yml

Automated sync from stranske/Workflows Template hash: 2e01e11c7edc Changes synced from sync-manifest.yml

stranske-keepalive · 2026-04-26T09:43:45Z

🤖 Keepalive Loop Status

PR #288 | Agent: Codex | Iteration 0/5

Current State

Metric	Value
Iteration progress	[----------] 0/5
Action	wait (missing-agent-label)
Disposition	skipped (transient)
Gate	success
Tasks	0/15 complete
Timeout	45 min (default)
Timeout usage	5m elapsed (13%, 40m remaining)
Keepalive	❌ disabled
Autofix	❌ disabled

🔍 Failure Classification

stranske-keepalive · 2026-04-26T09:43:45Z

Keepalive Work Log (click to expand)

Time (UTC)	Agent	Action	Result	Files	Progress	Commit	Gate
2026-04-26 09:43:45	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	cancelled
2026-04-26 09:45:26	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	cancelled
2026-04-26 09:46:13	Codex	wait (missing-agent-label-transient)	skipped	—	0/15	—	success

Copilot

Pull request overview

Syncs workflow templates and supporting scripts from stranske/Workflows to expand weekly metrics reporting, add artifact download manifest tracking, and enhance coverage/telemetry contracts for terminal dispositions and bot-comment auth.

Changes:

Add artifact download manifest generation (metric-artifact-download-manifest.{json,md}) and include it in weekly metrics artifacts and outputs.
Extend weekly metrics aggregation to emit a machine-readable JSON summary contract alongside the markdown summary.
Enhance terminal-disposition and bot-comment auth coverage contracts/markdown with priority-family visibility and verifier model compatibility metadata.

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 6 comments.

Show a summary per file

File	Description
`scripts/aggregate_agent_metrics.py`	Enriches parsed metrics with source metadata, adds parse-error detail tracking, emits JSON summary contract, and reads optional download manifest contract.
`.github/workflows/agents-weekly-metrics.yml`	Initializes/records/finalizes the artifact download manifest during artifact fetch; uploads new JSON outputs and manifest artifacts.
`.github/workflows/agents-bot-comment-handler.yml`	Adds `skip_reason` output and writes/uploads a wrapper terminal-disposition artifact for traceability.
`.github/workflows/agents-81-gate-followups.yml`	Switches `jq` invocation to compact output (`-cn`) for emitted metrics JSON.
`.github/scripts/weekly_metrics_download_manifest.js`	New script to maintain the download/unzip manifest contract + markdown summary.
`.github/scripts/weekly_metrics_artifacts.js`	Adds priority-family status reporting (missing families + per-family availability/selection metadata).
`.github/scripts/terminal_disposition_coverage.js`	Adds verifier model compatibility checks and integrates priority-family statuses into the coverage report/markdown.
`.github/scripts/terminal_disposition.js`	Extends normalized terminal disposition records with `llm_model`, `model_selection_reason`, and `verifier_mode`.
`.github/scripts/coverage_monitor_summary.js`	New weekly “coverage monitor” summary contract combining terminal + bot-auth monitor outputs.
`.github/scripts/bot_comment_auth_coverage.js`	Improves organic evidence reporting with “skipped/missing requirements” and wrapper/reusable decision fields.
`.github/scripts/agents_pr_meta_update_body.js`	Adds embedded issue metadata marker and `Closes #…` line to the PR preamble when a source issue exists.

Copilot · 2026-04-26T09:47:51Z

+  return (manifest.artifacts || []).find((artifact) => {
+    if (cleanId && cleanString(artifact.id) === cleanId) return true;
+    return cleanName && cleanString(artifact.name) === cleanName;
+  });


findArtifact() falls back to matching by name even when an id is provided but doesn’t match. If artifact names are reused across runs, a bad/changed ID could silently update the wrong entry. Consider: when id is present, match by id only; only fall back to name matching when id is not provided.

Suggested change

return (manifest.artifacts || []).find((artifact) => {

if (cleanId && cleanString(artifact.id) === cleanId) return true;

return cleanName && cleanString(artifact.name) === cleanName;

});

const artifacts = manifest.artifacts || [];

if (cleanId) {

return artifacts.find((artifact) => cleanString(artifact.id) === cleanId);

}

if (cleanName) {

return artifacts.find((artifact) => cleanString(artifact.name) === cleanName);

}

return undefined;

Copilot · 2026-04-26T09:47:52Z

                raw = line.strip()
                if not raw:
                    continue
+                raw_lines.append(raw)


In _read_ndjson, raw_lines is populated for every non-empty line (even when parsing succeeds). For large NDJSON inputs this can significantly increase memory usage. Consider only buffering lines when you actually need the whole-file fallback (e.g., only while file_entries is still empty, or by rereading the file when fallback is triggered).

Suggested change

raw_lines.append(raw)

if not file_entries:

raw_lines.append(raw)

Copilot · 2026-04-26T09:47:52Z

+def _attach_metric_source(entry: dict[str, Any], path: Path) -> dict[str, Any]:
+    source = _metric_source(path)
+    enriched = dict(entry)
+    enriched.setdefault("artifact_name", source.artifact)
+    enriched.setdefault("artifact_family", source.artifact_family)


_attach_metric_source recomputes _metric_source(path) for every parsed entry, but the source is constant per file. For high-volume metrics files this adds avoidable overhead. Consider computing the MetricSource once per path inside _read_ndjson and passing it into the attach/enrich helper.

Copilot · 2026-04-26T09:47:52Z

+                unsupported_model_dispositions[str(disposition)] += 1
+        elif is_verifier_terminal:
+            verifier_mode = str(entry.get("verifier_mode") or "").strip().lower()
+            if verifier_mode != "evaluate":


When verifier_mode is missing/empty, verifier_mode != "evaluate" evaluates true and the entry is counted as missing model metadata. This makes empty/unknown modes look like they require model metadata, which can inflate the warning counters. Consider requiring an explicit non-empty verifier_mode before treating the model field as mandatory (or handling an empty mode as unknown/evaluate).

Suggested change

if verifier_mode != "evaluate":

if verifier_mode and verifier_mode != "evaluate":

Copilot · 2026-04-26T09:47:52Z

+        "count": len(parse_error_details),
+        "by_artifact_family": dict(sorted(family_counts.items())),
+        "by_artifact": dict(sorted(artifact_counts.items())),
+        "by_reason": dict(sorted(reason_counts.items())),
+        "details": [detail.as_dict() for detail in parse_error_details],


The JSON contract includes parse_errors.details for every parse failure with no size cap. If an input artifact is corrupted, this list can become extremely large and bloat the JSON output/artifact. Consider capping the stored details (and adding an omitted_count), similar to the markdown table cap.

Copilot · 2026-04-26T09:47:53Z

+
+function overallStatus(monitors) {
+  if (monitors.some((monitor) => monitor.should_fail || monitor.status === 'fail')) return 'fail';
+  if (monitors.some((monitor) => ['missing', 'parse-error', 'warning'].includes(monitor.status))) {


overallStatus() treats only missing, parse-error, and warning monitor statuses as warning, but normalizeStatus() can return unknown. If a monitor report is malformed and yields unknown, the overall status can incorrectly become pass. Consider treating unknown as a warning (or mapping it to warning) so invalid monitor reports don’t look healthy.

Suggested change

if (monitors.some((monitor) => ['missing', 'parse-error', 'warning'].includes(monitor.status))) {

if (monitors.some((monitor) => ['missing', 'parse-error', 'warning', 'unknown'].includes(monitor.status))) {

chore: sync workflow templates from Workflows repo

94717ae

Automated sync from stranske/Workflows Template hash: 2e01e11c7edc Changes synced from sync-manifest.yml

Copilot AI review requested due to automatic review settings April 26, 2026 09:40

stranske added sync Automated sync from Workflows automated Automated sync from Workflows labels Apr 26, 2026

stranske temporarily deployed to agent-standard April 26, 2026 09:40 — with GitHub Actions Inactive

stranske temporarily deployed to agent-standard April 26, 2026 09:41 — with GitHub Actions Inactive

Copilot started reviewing on behalf of stranske April 26, 2026 09:42 View session

Copilot AI reviewed Apr 26, 2026

View reviewed changes

stranske mentioned this pull request Apr 26, 2026

Sync/Dependency campaign queue stranske/Workflows#1836

Open

This was referenced Apr 26, 2026

fix: harden verifier metrics and artifact downloads stranske/Workflows#1893

Merged

Fix sync campaign issue reuse and marker size stranske/Workflows#1896

Merged

stranske closed this Apr 29, 2026

agents-workflows-bot Bot deleted the sync/workflows-2e01e11c7edc branch May 14, 2026 19:34

Navigation Menu

chore: sync workflow templates - #288

chore: sync workflow templates#288
stranske wants to merge 1 commit into
mainfrom
sync/workflows-2e01e11c7edc

stranske commented Apr 26, 2026

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Copilot AI Apr 26, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

-  return (manifest.artifacts || []).find((artifact) => {
-    if (cleanId && cleanString(artifact.id) === cleanId) return true;
-    return cleanName && cleanString(artifact.name) === cleanName;
-  });
+  const artifacts = manifest.artifacts || [];
+  if (cleanId) {
+    return artifacts.find((artifact) => cleanString(artifact.id) === cleanId);
+  }
+  if (cleanName) {
+    return artifacts.find((artifact) => cleanString(artifact.name) === cleanName);
+  }
+  return undefined;

	raw_lines.append(raw)
	if not file_entries:
	raw_lines.append(raw)

	if verifier_mode != "evaluate":
	if verifier_mode and verifier_mode != "evaluate":

	if (monitors.some((monitor) => ['missing', 'parse-error', 'warning'].includes(monitor.status))) {
	if (monitors.some((monitor) => ['missing', 'parse-error', 'warning', 'unknown'].includes(monitor.status))) {

Conversation

stranske commented Apr 26, 2026

Sync Summary

Files Updated

Files Skipped

Review Checklist

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 • edited by agents-workflows-bot Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🤖 Keepalive Loop Status

Current State

🔍 Failure Classification

Uh oh!

stranske-keepalive Bot commented Apr 26, 2026 • edited by agents-workflows-bot Bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Apr 26, 2026

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading

stranske-keepalive Bot commented Apr 26, 2026 •

edited by agents-workflows-bot Bot

Loading