Uh oh!
There was an error while loading. Please reload this page.
feat(runtime): validate provider request traces - #1464
Conversation
45d3b5c to
0a2a07fCompare
Astro-Han
left a comment
There was a problem hiding this comment.
Requesting changes for the P1 trace-completeness issue noted inline.
Non-blocking suggestion: the attempt parser requires integer timestamps, but AiSdkBackendInput.now, ProviderRequestAttemptRecord, and the AgentRun codec allow any finite number. A fractional monotonic clock produces a valid attempt that the reader rejects as invalid_attempt. Either accept finite non-negative values or normalize the timestamps at the Runtime producer. Keeping the decoder next to the Runtime record type would also prevent the two contracts from drifting again.
Uh oh!
There was an error while loading. Please reload this page.
Nyvo-io
commented
Jul 26, 2026
All requested changes are addressed and the inline thread is resolved. d62b136 fails closed on trace write/corruption sentinels and accepts the Runtime finite timestamp contract; 3e2c222 normalizes equivalent cross-protocol request evidence; 370c437 validates same-session continuation executions. The focused regressions, full workspace suite, and GitHub typecheck/test/e2e checks all pass. @Astro-Han, please re-review when convenient. |
Uh oh!
There was an error while loading. Please reload this page.
370c437 to
ab70f7fCompareNyvo-io
commented
Jul 26, 2026
Latest P1 is addressed in af6079f and ab70f7f, with the requested real FileAgentRunStore export/read/assert regression chain plus torn-tail fail-closed coverage. The branch is rebased onto current main; npm test, typecheck, lint, format:check, diff --check, and the completed independent review all pass. @Astro-Han, please re-review when convenient. |
Astro-Han
left a comment
There was a problem hiding this comment.
The earlier trace-latch and torn-tail failures are fixed. I found two other ways the trace can still pass when the experiment is not comparable or complete; details inline.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
ab70f7f to
c1917e8CompareNyvo-io
commented
Jul 27, 2026
All four inline findings are addressed and resolved at
The branch is clean, rebased onto current |
Astro-Han
left a comment
There was a problem hiding this comment.
I did not find a P0 or P1 issue, so I am approving this PR. The earlier trace-integrity findings are fixed. I found these follow-ups:
- [P2] A failed attempt append can still be missed if the first header-latch write also fails and later terminal writes recover.
- [P2] Autonomous attempts from different sessions are exported into one file, but the reader treats the second session as
mixed_identity. - [P2] Semantic-compaction provider calls bypass the request tracker.
- [P2] Child-agent runs are outside the exported run set, so their provider calls are absent without a missing-evidence diagnostic.
- [P3] Request-shape normalization repeats provider-option and output-limit rules owned by Runtime.
- [P3] Headless still maintains a separate decoder for Runtime-owned attempt records.
These affect compound I/O failures, optional execution modes, or benchmark evidence rather than production state.
Please push back if provider-request traces intentionally exclude compaction or child-agent dispatches. If that is the intended boundary, narrowing the public contract may be enough. There is no need to accept a code change solely to clear the comment.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Nyvo-io
commented
Jul 28, 2026
Addressed the latest review in
Focused tests, full Runtime/Headless suites, typecheck, lint, format, diff checks, and independent reviews pass. GitHub |
Uh oh!
There was an error while loading. Please reload this page.
Astro-Han
commented
Jul 28, 2026
Reviewed The last commit fixes trace-write error latching and multi-session identity handling. The scope for compaction and child-agent calls is now explicit instead of being counted as complete provider accounting. I tested the merge with the then-current main; 544 focused tests passed. No new P0–P3. |
Summary
The exported artifact is intentionally scoped to top-level Harbor invocations. Semantic-compaction and child-agent provider dispatches are outside this contract; the Runtime normalization and attempt-codec ownership cleanups are deferred to the broader Runtime refactor rather than duplicated here.
This is the second flat split requested in #1451 and addresses the request-trace evidence findings on that PR.
Refs #1269
Verification
Not run: the paid Kimi/Harbor benchmark. That belongs to the separate stacked benchmark PR.