Add artifact merge engines and Kind metadata flow (RFC 018 phase 1)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)

[Amaury Levé (Evangelink)]

Summary

Implements the first testfx-side pieces of RFC 018 — Artifact post-processing for dotnet test (MTP). Two independent, self-contained foundations that every later phase (dispatcher tool, SDK election) reuses. No SDK dependency; the SDK orchestration lands separately once this merges.

1. Report merge engines (pure, invocation-agnostic — no I/O in the core)

Validated the RFC's "collect same-kind inputs → re-aggregate → emit one" shape across both data models:

Engine	Format	Merge unit	Re-aggregation
TrxReportEngine.Merge / MergeToFileAsync	XML	Results/TestDefinitions/TestEntries	counters summed, Times earliest/latest, TestLists deduped by id, outcome Failed if any input failed
JUnitReportMerger	XML	<testsuite>	counters derived by summing per-suite (correct even when root aggregates are missing); supports bare <testsuite> roots
CtrfReportMerger	JSON (JsonNode)	results.tests[]	summary derived from the merged tests[] so summary.tests always matches the array; start/stop min/max

HTML is intentionally not file-merged (it's a rendered template with an embedded JSON blob) — this validates the design's opt-in / return-null semantics rather than breaking it.

2. Kind metadata flow (producer → IPC wire)

So the dotnet test orchestrator can group artifacts by format without inspecting file contents:

• SessionFileArtifact gains an optional kind (experimental-gated, [TPEXP]); the shipped 4-arg constructor is preserved for binary compatibility.
• IPC: FileArtifactMessage.Kind + FileArtifactMessageFieldsId.Kind = 7 + serializer read/write/field-count (forward/backward compatible — old readers skip the unknown field).
• DotnetTestDataConsumer propagates Kind onto the wire message.
• Report producers tag their kind: TRX microsoft.testing.trx, JUnit microsoft.testing.junit, CTRF microsoft.testing.ctrf, HTML microsoft.testing.html.

Tests

• Unit tests for all three merge engines (null/empty inputs, counter summing, outcome, dedup, timestamps, bare-root/missing-aggregate robustness, summary-missing).
• IPC protocol round-trip tests assert Kind survives the pipe.
• Full repo builds clean (only the unrelated WasiPlayground sample fails on a missing workload); Platform IPC/protocol, contract-package, and Extensions unit tests all green.

Not in this PR (future phases, per the RFC)

• IArtifactPostProcessor typed contract wrapping the engines.
• Handshake advertisement of post-processor kinds.
• Dispatcher ITool + tool-host-over-pipe composition.
• User tools (merge-trx, …) and the dotnet/sdk orchestration.

cc Amaury Levé (@Evangelink)

Co-authored-by: Copilot App 223556219+Copilot@users.noreply.github.com

[Copilot]

Pull request overview

Adds report-merging foundations and propagates artifact format metadata through MTP’s artifact and IPC layers.

Changes:

• Adds TRX, JUnit, and CTRF merge engines with unit tests.
• Adds experimental SessionFileArtifact.Kind metadata and IPC serialization.
• Tags TRX, JUnit, CTRF, and HTML report artifacts by format.

Show a summary per file

File	Description
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolTests.cs	Covers IPC kind serialization.
test/UnitTests/Microsoft.Testing.Platform.UnitTests/IPC/ProtocolEdgeCaseTests.cs	Tests nullable kind round trips.
test/UnitTests/Microsoft.Testing.Platform.DotnetTestProtocolContract.UnitTests/DotnetTestProtocolSerializerTests.cs	Verifies protocol-contract serialization.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/TrxReportEngineMergeTests.cs	Tests TRX merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/JUnitReportMergerTests.cs	Tests JUnit merging.
test/UnitTests/Microsoft.Testing.Extensions.UnitTests/CtrfReportMergerTests.cs	Tests CTRF merging.
src/Platform/SharedExtensionHelpers/ReportGeneratorBase.cs	Publishes report artifact kinds.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Serializers/FileArtifactMessagesSerializer.cs	Serializes the new kind field.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/ObjectFieldIds.cs	Assigns IPC field ID 7.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/Models/FileArtifactMessages.cs	Adds kind to the wire model.
src/Platform/Microsoft.Testing.Platform/ServerMode/DotnetTest/IPC/DotnetTestDataConsumer.cs	Propagates session artifact kinds.
src/Platform/Microsoft.Testing.Platform/PublicAPI/PublicAPI.Unshipped.txt	Tracks the experimental public API.
src/Platform/Microsoft.Testing.Platform/Messages/FileArtifacts.cs	Adds the kind-aware constructor and property.
src/Platform/Microsoft.Testing.Platform/InternalAPI/InternalAPI.Unshipped.txt	Tracks IPC internal API changes.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxReportEngine.Merge.cs	Implements TRX merging.
src/Platform/Microsoft.Testing.Extensions.TrxReport/TrxDataConsumer.cs	Tags in-process TRX artifacts.
src/Platform/Microsoft.Testing.Extensions.TrxReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks TRX internal APIs.
src/Platform/Microsoft.Testing.Extensions.Retry/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.MSBuild/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportMerger.cs	Implements JUnit merging.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/JUnitReportGenerator.cs	Tags JUnit artifacts.
src/Platform/Microsoft.Testing.Extensions.JUnitReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks JUnit internal APIs.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks shared generator API.
src/Platform/Microsoft.Testing.Extensions.HtmlReport/HtmlReportGenerator.cs	Tags HTML artifacts.
src/Platform/Microsoft.Testing.Extensions.HangDump/InternalAPI/InternalAPI.Unshipped.txt	Tracks linked IPC field API.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/InternalAPI/InternalAPI.Unshipped.txt	Tracks CTRF internal APIs.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportMerger.cs	Implements CTRF merging.
src/Platform/Microsoft.Testing.Extensions.CtrfReport/CtrfReportGenerator.cs	Tags CTRF artifacts.

Review details

• Files reviewed: 28/28 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 11
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 30/30 changed files
• Comments generated: 1
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 32/32 changed files
• Comments generated: 3
• Review effort level: Low

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 5
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 31/31 changed files
• Comments generated: 3
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 4
• Review effort level: Medium

[Copilot]

Review details

• Files reviewed: 35/35 changed files
• Comments generated: 1
• Review effort level: Medium

[github-actions]

🧪 Test quality grade — PR #9805

Grade	Test	Notes
B (80–89)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Clear scenario and deterministic inputs; equality assertion on both IDs plus a non-null guard make this near-perfect — no issues found, A could be reached by noting the comment rationale inline.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenInputLivesUnderMergedRoot_ PreservesOriginalReportAndAttachment	Presence-only assertions (File.Exists) confirm files survive, but adding a content check (File.ReadAllText) would close the preservation guarantee fully.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameEscapesOutputDirectory_ UsesConfinedDeploymentRoot	Security assertions (StartsWith, no-separator, confinement scan) are well-chosen; ~38-line body with a directory scan could be split into a confinement test and a content-integrity test.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RepeatedIntoSameNestedLayout_ IsBoundedAndNonDestructive	Loop + copy-count + href-resolution are all meaningful; the for-loop is idiomatic here, but extracting the loop limit (4) into a named constant would clarify intent.
B (80–89)	mod TrxReportEngineMergeTests. MergeToFileAsync_ RelocatesPerTestResultFilesByPrefixingResultDirectory	Four meaningful assertions covering path rewriting and file content; ~50-line body with manual XML construction — consider extracting a BuildResultFilesReport helper to compress the arrange phase.
A (90–100)	new CtrfReportMergerTests. Merge_ ReportIdIsUnaffectedByIgnoredNonCtrfInput	Inline comment explains non-CTRF input semantics; equality on both IDs plus IsNotNull guard — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesOmitAttributesNoInputSupplies	Null-absence and equality assertions together cover both the omission and the surviving fields — no issues found.
A (90–100)	new TrxReportEngineMergeTests. Merge_ TimesTrackEarliestCreationQueuingStartIndependently	All four time attributes verified independently with inputs deliberately split across two reports — no issues found.
A (90–100)	new TrxReportEngineMergeTests. MergeToFileAsync_ SecondMergeIntoSameOutput_ DoesNotCorruptPriorReportsAttachments	Two-merge scenario with distinct-root assertion and byte-level content verification — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ IsolatesCollidingAttachmentsPerInputAndRewritesHrefs	Now reads mergedRoot from the document rather than assuming runName; content + href assertions are thorough — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenRunNameMatchesInputDeploymentRoot_ UsesUniqueRootAndRelocates	AreNotEqual uniqueness check, original-preservation check, and content-verified href resolution — no issues found.
A (90–100)	mod TrxReportEngineMergeTests. MergeToFileAsync_ WhenSourceNestedUnderMergedRoot_ RelocatesAndKeepsHrefsValid	Reads mergedRoot dynamically and validates href resolution end-to-end with content check — no issues found.

_{This advisory comment was generated automatically. Grades are heuristic
and informational — they do not block merging. Re-run with
/grade-tests.}

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

• awmgmcpg

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
allowed:
- defaults
- "awmgmcpg"

See Network Configuration for more information.

🤖 Automated content by GitHub Copilot. Generated by the Grade Tests on PR (on open / sync) workflow. · 71.5 AIC · ⌖ 5.33 AIC · ⊞ 8.9K · [◷]( · ◷)