Skip to content

[EVIDENCE-011] Run fixture-backed Web API pilot - #3580

Merged
ootakazuhiko merged 2 commits into
mainfrom
feat/3572-web-api-pilot
Jul 1, 2026
Merged

ootakazuhiko merged 2 commits into
mainfrom
feat/3572-web-api-pilot

Conversation

@ootakazuhiko

Copy link
Copy Markdown
Collaborator

Summary

Closes #3572. Parent epic: #3567.

This PR runs EVIDENCE-011 as a deterministic, fixture-backed Web API pilot because #3572 did not specify a live runtime API target. It applies the existing web-api-bff domain preset and records the evidence chain needed for a later case study.

Changes

  • Add docs/product/EVIDENCE-SPRINT-WEB-API-PILOT-2026-07-01.md as the Web API pilot report and scope memo.
  • Add Web API pilot fixtures under fixtures/evidence-sprint/web-api-pilot/:
    • API contract evidence for GET /internal/evidence-sprint/pilots/{pilotId} as a report-only fixture.
    • Rendered domain-assurance-preset-report/v1 JSON/Markdown from templates/domain-presets/web-api-bff/preset.json.
    • ExecPlan v2 fixture.
    • Evidence Sprint measurement report fixture.
    • PR assurance review preview.
    • Verification evidence surface.
  • Register the new schema-backed fixtures in scripts/ci/validate-json.mjs.
  • Link the fixture-backed Web API pilot from README.md and docs/README.md while preserving the report-only / unsupported-claim boundary.

Acceptance coverage

  • Required inputs, starting command, expected artifacts, and escalation rule are recorded in the rendered domain preset report and pilot report.
  • API contract evidence is visible in api-contract.md, the pilot report, and the PR assurance review preview.
  • Metrics follow EVIDENCE-002 via schema/evidence-sprint-measurement-report.schema.json.
  • The result can feed a later case study through the checked-in pilot report and docs navigation.

Boundaries

  • No runtime API endpoint is added.
  • No live external agent APIs or external repository pilot calls are made.
  • The synthetic timing metric supports instrumentation readiness only; it is not review-speed, implementation-speed, safety, quality, adoption, live API behavior, or agent/vendor evidence.
  • Report-only artifacts do not approve, waive, merge, or promote policy-gate enforcement.

Validation

  • node scripts/domain-presets/render-preset.mjs --preset templates/domain-presets/web-api-bff/preset.json --generated-at 2026-07-01T00:00:00.000Z --output-json fixtures/evidence-sprint/web-api-pilot/domain-preset-report.json --output-md fixtures/evidence-sprint/web-api-pilot/domain-preset-report.md
  • node scripts/exec-plan/validate-v2.mjs --file fixtures/evidence-sprint/web-api-pilot/exec-plan.v2.json --no-write
  • node scripts/ci/validate-json.mjs
  • pnpm -s run check:schemas
  • pnpm -s run check:doc-consistency
  • pnpm -s run docs:lint
  • pnpm -s run types:check
  • pnpm -s run context-pack:validate
  • pnpm -s run context-pack:verify-boundary-map
  • pnpm -s run verify:lite
  • git diff --check
  • git diff --cached --check

verify:lite completed with the repository's existing lint baseline in warn-only mode.

Rollback

Revert this PR to remove the #3572 docs/fixtures/navigation updates and the validate-json fixture registrations. No runtime state, migration, or policy enforcement rollback is required.

Copilot AI review requested due to automatic review settings July 1, 2026 10:33
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

❓ Code Generation Drift Detection

Status:
Regeneration needed: No


Automated by AE-Framework Codegen

@github-actions github-actions Bot added the risk:low Expected low implementation risk label Jul 1, 2026
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Generate Artifacts Preview

Generated at: 2026-07-01T10:47:40.733Z

  • tests/api/generated: clean
  • artifacts/codex: clean
  • artifacts/spec: clean

@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

KvOnce Trace Validation

  • OTLP: ✅ Success (Issues: 0)
  • NDJSON: ✅ Success (Issues: 0)

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a deterministic, fixture-backed Web API pilot (EVIDENCE-011) for Issue #3572 using the existing web-api-bff domain preset, and checks in the full evidence chain (contract fixture, rendered preset report, ExecPlan v2, measurement report, and reviewer-facing surfaces) without introducing any runtime API endpoint.

Changes:

  • Added a new Web API pilot report and a complete set of schema-backed pilot fixtures under fixtures/evidence-sprint/web-api-pilot/.
  • Registered the new ExecPlan v2 / measurement report / domain preset report fixtures in the JSON validation harness.
  • Updated root/docs READMEs to include the pilot in the “product evidence route” while preserving report-only boundaries.

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated no comments.

Show a summary per file
File Description
scripts/ci/validate-json.mjs Registers the new Web API pilot JSON fixtures for schema validation.
README.md Updates the product-evidence route and pointers to include the fixture-backed Web API pilot.
docs/README.md Links the new pilot report from the documentation index and updates the recommended evidence route.
docs/product/EVIDENCE-SPRINT-WEB-API-PILOT-2026-07-01.md Adds the pilot report/scope memo documenting boundaries, evidence path, metrics snapshot, and verification plan.
fixtures/evidence-sprint/web-api-pilot/api-contract.md Adds the report-only API contract fixture (GET /internal/evidence-sprint/pilots/{pilotId}) used for reviewer-visible contract evidence.
fixtures/evidence-sprint/web-api-pilot/domain-preset-report.json Adds rendered domain-assurance-preset-report/v1 JSON for the web-api-bff preset.
fixtures/evidence-sprint/web-api-pilot/domain-preset-report.md Adds rendered Markdown version of the domain preset report for human review.
fixtures/evidence-sprint/web-api-pilot/exec-plan.v2.json Adds the ExecPlan v2 fixture connecting issue intent, tasks, evidence requirements, verification, and closeout boundaries.
fixtures/evidence-sprint/web-api-pilot/measurement-report.json Adds the schema-backed Evidence Sprint measurement report fixture for the pilot.
fixtures/evidence-sprint/web-api-pilot/pr-assurance-review.md Adds the reviewer-facing traceability preview/checklist for the pilot evidence chain.
fixtures/evidence-sprint/web-api-pilot/verification-evidence.md Adds the deterministic verification command set and recorded pre-publication local verification status.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 1cf9c6145f

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread fixtures/evidence-sprint/web-api-pilot/api-contract.md Outdated
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

❓ Code Generation Drift Detection

Status:
Regeneration needed: No


Automated by AE-Framework Codegen

@ootakazuhiko
ootakazuhiko force-pushed the feat/3572-web-api-pilot branch from d13d453 to 05aea47 Compare July 1, 2026 10:47
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

❓ Code Generation Drift Detection

Status:
Regeneration needed: No


Automated by AE-Framework Codegen

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

risk:low Expected low implementation risk

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[EVIDENCE-011] Run Web API pilot using domain preset

2 participants