[EVIDENCE-012] Run fixture-backed event-driven pilot - #3581
Conversation
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
Generate Artifacts PreviewGenerated at: 2026-07-01T11:29:41.588Z
|
KvOnce Trace Validation
|
There was a problem hiding this comment.
Pull request overview
Runs EVIDENCE-012 as a deterministic, fixture-backed event-driven / conformance pilot using the existing event-driven-domain preset, and checks in the resulting evidence chain (report, fixtures, ExecPlan v2, measurement report) so the pilot is reviewable/replayable without introducing a live event processor.
Changes:
- Added a new product report documenting scope, boundaries, evidence path, and follow-ups for the event-driven pilot.
- Added fixture-backed pilot artifacts (invariant assumptions, conformance evidence, rendered domain preset report, ExecPlan v2, measurement report, PR assurance review preview).
- Registered new JSON fixtures in
scripts/ci/validate-json.mjsand updated README navigation to include the new pilot.
Reviewed changes
Copilot reviewed 11 out of 11 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| scripts/ci/validate-json.mjs | Registers the new event-driven pilot fixtures for schema validation in CI/local checks. |
| README.md | Updates the primary “evidence route” and doc pointers to include the event-driven pilot while preserving report-only boundaries. |
| docs/README.md | Extends docs index/navigation routes to include the event-driven pilot report alongside existing evidence sprint materials. |
| docs/product/EVIDENCE-SPRINT-EVENT-DRIVEN-PILOT-2026-07-01.md | Adds the pilot report/scope memo capturing the full report-only evidence chain and boundaries. |
| fixtures/evidence-sprint/event-driven-pilot/pr-assurance-review.md | Adds a reviewer-facing traceability preview/checklist for the pilot PR surface. |
| fixtures/evidence-sprint/event-driven-pilot/measurement-report.json | Adds a schema-backed Evidence Sprint measurement report fixture for the pilot. |
| fixtures/evidence-sprint/event-driven-pilot/invariant-assumptions.md | Adds explicit ordering/invariant assumptions and escalation rule for the chosen trace fixture. |
| fixtures/evidence-sprint/event-driven-pilot/exec-plan.v2.json | Adds an ExecPlan v2 fixture connecting issue intent, tasks, evidence requirements, stop rules, and rollback. |
| fixtures/evidence-sprint/event-driven-pilot/domain-preset-report.md | Adds the rendered Markdown domain preset report for human review. |
| fixtures/evidence-sprint/event-driven-pilot/domain-preset-report.json | Adds the rendered JSON domain preset report for schema validation and tooling. |
| fixtures/evidence-sprint/event-driven-pilot/conformance-evidence.md | Adds a report-only conformance/trace-validation evidence summary and its limitations. |
💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.
There was a problem hiding this comment.
💡 Codex Review
Here are some automated review suggestions for this pull request.
Reviewed commit: 2541b25bb0
ℹ️ About Codex in GitHub
Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you
- Open a pull request for review
- Mark a draft as ready
- Comment "@codex review".
If Codex has suggestions, it will comment; otherwise it will react with 👍.
Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
5d5d4e1 to
2186548
Compare
❓ Code Generation Drift DetectionStatus: Automated by AE-Framework Codegen |
Summary
Closes #3573. Parent epic: #3567.
This PR runs EVIDENCE-012 as a deterministic, fixture-backed event-driven / conformance pilot because #3573 did not specify a live event processor or workflow target. It applies the existing
event-driven-domainpreset and records the evidence chain needed for later case-study/release material.Changes
docs/product/EVIDENCE-SPRINT-EVENT-DRIVEN-PILOT-2026-07-01.mdas the event-driven pilot report and scope memo.fixtures/evidence-sprint/event-driven-pilot/:domain-assurance-preset-report/v1JSON/Markdown fromtemplates/domain-presets/event-driven-domain/preset.json.scripts/ci/validate-json.mjs.README.mdanddocs/README.mdwhile preserving the report-only / unsupported-claim boundary.Acceptance coverage
invariant-assumptions.mdand summarized in the pilot report/review surface.schema/evidence-sprint-measurement-report.schema.json.Boundaries
Validation
node scripts/domain-presets/render-preset.mjs --preset templates/domain-presets/event-driven-domain/preset.json --generated-at 2026-07-01T00:00:00.000Z --output-json fixtures/evidence-sprint/event-driven-pilot/domain-preset-report.json --output-md fixtures/evidence-sprint/event-driven-pilot/domain-preset-report.mdnode scripts/formal/trace-validate.mjs samples/conformance/sample-traces.jsonpnpm -s run conformance:verify:sample(exit 0, report-onlyoverall = failsample findings recorded)node scripts/exec-plan/validate-v2.mjs --file fixtures/evidence-sprint/event-driven-pilot/exec-plan.v2.json --no-writenode scripts/ci/validate-json.mjspnpm -s run check:schemaspnpm -s run check:doc-consistencypnpm -s run docs:lintpnpm -s run types:checkpnpm -s run context-pack:validatepnpm -s run context-pack:verify-boundary-mappnpm -s run verify:litegit diff --checkgit diff --cached --checkverify:litecompleted with the repository's existing lint baseline in warn-only mode. It also surfaced the generated local conformance report as report-only failing evidence because the pilot intentionally ran the existing conformance sample before cleanup.Rollback
Revert this PR to remove the #3573 docs/fixtures/navigation updates and the validate-json fixture registrations. No runtime state, migration, queue/broker state, or policy enforcement rollback is required.