Uh oh!
There was an error while loading. Please reload this page.
Add Azure DevOps per-assembly log groups (#9141) - #9177
Conversation
Wrap each test assembly's output in an Azure DevOps log group (##[group] / ##[endgroup]) so the raw pipeline log view collapses the assembly's test output by default. Unlike ##vso[task.logdetail] records, the ##[group] format commands render in the modern AzDO Pipelines log viewer. Gated on --report-azdo + TF_BUILD=true, consistent with the rest of the extension. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
There was a problem hiding this comment.
Pull request overview
This PR adds per-test-assembly Azure DevOps log grouping to the Microsoft.Testing.Extensions.AzureDevOpsReport extension by emitting ##[group] / ##[endgroup] around a test session’s output when --report-azdo is enabled and TF_BUILD=true, making Azure Pipelines raw logs collapsible per assembly.
Changes:
- Added
AzureDevOpsLogGroupReporter(ITestSessionLifetimeHandler) that emits##[group]Tests: {assembly} ({tfm})on session start and##[endgroup]on session finish. - Registered the reporter in the Azure DevOps extension wiring so it participates in the test-session lifetime callbacks.
- Added a localized
LogGroupHeaderresource string (resx + all xlf) and introduced unit tests validating enablement and emitted lines.
Show a summary per file
| File | Description |
|---|---|
| test/UnitTests/Microsoft.Testing.Extensions.UnitTests/AzureDevOpsLogGroupReporterTests.cs | New unit tests for enablement gating and group header/endgroup emissions. |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/AzureDevOpsLogGroupReporter.cs | New session lifetime handler that emits ##[group] / ##[endgroup] lines. |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/AzureDevOpsExtensions.cs | Registers the new lifetime handler in the Azure DevOps extension pipeline. |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/AzureDevOpsResources.resx | Adds LogGroupHeader base resource string. |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.cs.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.de.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.es.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.fr.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.it.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.ja.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.ko.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.pl.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.pt-BR.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.ru.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.tr.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.zh-Hans.xlf | Adds localized LogGroupHeader entry (new state). |
| src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/Resources/xlf/AzureDevOpsResources.zh-Hant.xlf | Adds localized LogGroupHeader entry (new state). |
Copilot's findings
- Files reviewed: 17/17 changed files
- Comments generated: 3
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
…og-groups-9141 # Conflicts: # src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/AzureDevOpsExtensions.cs
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Amaury Levé (Evangelink)
commented
Jun 16, 2026
🔴 Build Failure AnalysisThe build failed with 1 root-cause error (reported 3 times across multiple target framework compilations). Root Cause — |
| Error | IDE0046 — 'if' statement can be simplified |
| File | src/Platform/Microsoft.Testing.Extensions.AzureDevOpsReport/AzureDevOpsLogGroupReporter.cs |
| Location | Line 59, column 9 |
| Project | Microsoft.Testing.Extensions.AzureDevOpsReport.csproj |
The IsEnabledAsync method uses an early-return if guard that the enforced analyzer style (IDE0046, treated as an error) requires to be rewritten as a conditional expression:
// ❌ Current code (triggers IDE0046)publicTask<bool>IsEnabledAsync(){boolisEnabledByParameter=_commandLineOptions.IsOptionSet(AzureDevOpsCommandLineOptions.AzureDevOpsOptionName);if(!isEnabledByParameter){returnTask.FromResult(false);}returnTask.FromResult(AzureDevOpsConstants.IsRunningInAzureDevOps(_environment));}Suggested fix — combine both conditions with && and use an expression body:
// ✅ FixedpublicTask<bool>IsEnabledAsync()=>Task.FromResult(_commandLineOptions.IsOptionSet(AzureDevOpsCommandLineOptions.AzureDevOpsOptionName)&&AzureDevOpsConstants.IsRunningInAzureDevOps(_environment));Cascading failures
The same IDE0046 error is reported three times (once per compiled target framework for the project) — they all stem from the single code location above. Fixing line 59 will resolve all three instances.
No other errors
There are no other compilation errors or warnings in the build. Once IDE0046 is resolved the build should pass cleanly.
🤖 Automated content by GitHub Copilot. Posted via a maintainer's GitHub token, so it appears under their account — the account owner did not write or approve this content personally. Generated by the Build Failure Analysis workflow. · 516.2 AIC · ⌖ 19.6 AIC · [◷]( · ◷)
Amaury Levé (Evangelink)
left a comment
There was a problem hiding this comment.
🤖 Automated content by GitHub Copilot. Posted via a maintainer's GitHub token, so it appears under their account — the account owner did not write or approve this content personally. Generated by the Build Failure Analysis workflow. · 516.2 AIC · ⌖ 19.6 AIC · ◷
Uh oh!
There was an error while loading. Please reload this page.
…; harden tests - IsEnabledAsync is now an expression body (fixes IDE0046 error that broke the build). - AzureDevOpsLogGroupReporter now also implements IDataConsumer (no-op consume) and is registered last, so ##[endgroup] is emitted in the consumer phase after the other AzDO handlers' finishing ##vso lines, making the group wrap the whole assembly's output. - Tests derive the header prefix from AzureDevOpsResources.LogGroupHeader and use AzureDevOpsConstants for TF_BUILD; added a ConsumeAsync no-op test. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Amaury Levé (Evangelink)
commented
Jun 16, 2026
🧪 Test quality grade — PR #9177
This advisory comment was generated automatically. Grades are heuristic
|
Uh oh!
There was an error while loading. Please reload this page.
What
First focused PR for #9141. Adds per-assembly Azure DevOps log groups: wraps each test assembly's output in ##[group] / ##[endgroup] so the raw pipeline log view collapses the assembly's test output by default.
ITestSessionLifetimeHandler):##[group]Tests: {assembly} ({tfm})##[endgroup]--report-azdo+TF_BUILD=true(consistent with the rest of the extension), so it stays opt-in and CI-only. No new CLI option, so no--help/--infoacceptance-test churn.LogGroupHeaderresource string (+ regenerated xlf for all locales).AzureDevOpsLogGroupReporterTests(6 tests, all passing).Unlike
##vso[task.logdetail]records,##[group]format commands are rendered by the modern Azure DevOps Pipelines log viewer.Scope note for #9141
The original issue listed four items. Re-scoped after the
task.logdetailprogress reporter was found to be on the way out (see #9154 follow-up):##vso[task.logissue …](AzureDevOpsReporter.cs); the issue's proposedtask.issueis invalid AzDO syntaxtask.logdetail)--report-azdo-progress/AzureDevOpsProgressReporterare being removed becausetask.logdetaildoesn't render in the modern UIA separate small PR can add an opt-out knob (
--report-azdo-groups) later if desired.Relates to #9141.