Skip to content

Report cumulative Autoloop metric improvement - #70

Draft
mrjf with Copilot wants to merge 2 commits into
mainfrom
copilot/add-cumulative-performance-reporting
Draft

Report cumulative Autoloop metric improvement#70
mrjf with Copilot wants to merge 2 commits into
mainfrom
copilot/add-cumulative-performance-reporting

Conversation

CopilotAI commented May 12, 2026

Copy link
Copy Markdown
Contributor

✨ Enhancement

Autoloop only surfaced the current best metric, leaving PRs/issues/state files without the starting baseline or total progress. CI-measured pending-ci fitness values also lacked a documented path back into visible state.

  • State schema

    • Adds Initial Metric to the Machine State table.
    • Defines it as the first accepted metric, set once and never overwritten.
    • Documents legacy backfill behavior when older state files lack a baseline.
  • Visible progress reporting

    • Updates PR body guidance to show cumulative fitness:
      Fitness: {best_metric} (started at {initial_metric}, {absolute_delta} / {improvement_pct}% improvement)
    • Adds initial metric and total improvement to the program issue status comment.
    • Adds total improvement to per-iteration comments and iteration history.
  • Pending CI fitness reconciliation

    • Documents pending-ci as a tracked state.
    • Requires the next iteration to read CI-measured fitness from prior runs before proposing new work.
    • Refreshes Initial Metric, Best Metric, PR body, and issue status after CI fitness is resolved.
  • Regression coverage

    • Adds prose/schema tests for initial metric tracking, cumulative improvement visibility, and pending-CI reconciliation.

Co-authored-by: mrjf <180956+mrjf@users.noreply.github.com>
CopilotAI changed the title [WIP] Add cumulative performance improvement reporting to autoloopReport cumulative Autoloop metric improvementMay 12, 2026
CopilotAI requested a review from mrjfMay 12, 2026 06:49
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Autoloop PR/issue should report cumulative performance improvement

2 participants

@mrjf