Complete Azure DevOps live-published test results - #11142
Amaury Levé (Evangelink) merged 3 commits into
Conversation
Publish terminal result state alongside outcome so Azure DevOps does not leave individual results pending after the run completes. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Assert that both initial POST and rerun PATCH requests preserve the completed result state. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
There was a problem hiding this comment.
Copilot review overview
🟢 Approval recommended
The fix and regression coverage are complete, with no unresolved issues.
Review tier: Balanced
Findings: None
What changed in this PR
Fixes Azure DevOps live-published terminal test results remaining Pending by explicitly setting their state to Completed.
Changes:
- Adds
state: "Completed"to terminal results. - Adds unit and browser-WASM regression coverage.
- Updates the internal API baseline.
| File | Description |
|---|---|
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/AzureDevOpsLivePublishingTests.cs |
Verifies terminal-state mapping. |
test/IntegrationTests/Microsoft.Testing.Platform.Acceptance.IntegrationTests/BrowserWasmExecutionTests.cs |
Verifies serialized REST payload states. |
src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/InternalAPI/InternalAPI.Unshipped.txt |
Tracks the new internal getter. |
src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/AzureDevOpsLivePublishingModels.cs |
Adds the completed result state. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Pipeline Test Triage — Final ResolutionBuild: [1588618]((dev.azure.com/redacted) ( Result: No actionable test failures found.
Conclusion: No issue created — no durable test defect, flaky test, crash, or slowness regression threshold was met. The macOS job cancellation is a non-blocking infrastructure timeout; if it recurs across multiple builds, it would warrant separate build-infrastructure investigation rather than a test-triage issue.
|
Retrigger the required build after Azure DevOps canceled the macOS job due to an infrastructure worker timeout. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Azure DevOps keeps live-published test results in
Pendingwhen the payload contains a terminal outcome but omits the result-level state. This change publishesstate: "Completed"for every terminal result so completed runs report accurate passed, failed, and incomplete counts.The regression coverage verifies:
The adjacent-path audit confirmed retry attempts use the same parent result model. Azure DevOps
TestSubResulthas no result-state field, so no equivalent sub-result change is required.Fixes: #11122