WasmTestOnChrome: can't open file gen-debug-dump-docs.py

[svick]

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=1371813
Build error leg or test failing: WasmTestOnChrome-CLR-ST-Common.Tests.WorkItemExecution
Pull request: #126411

Error Message

Fill the error message using step by step known issues guidance.

{
 "ErrorMessage": "/home/helixbot/.vsts-env/bin/python3: can't open file '/root/helix/work/correlation/gen-debug-dump-docs.py': [Errno 2] No such file or directory",
 "BuildRetry": false,
 "ExcludeConsoleLog": false
}

/home/helixbot/.vsts-env/bin/python3: can't open file '/root/helix/work/correlation/gen-debug-dump-docs.py': [Errno 2] No such file or directory

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=1371813
Error message validated: [/home/helixbot/.vsts-env/bin/python3: can't open file '/root/helix/work/correlation/gen-debug-dump-docs.py': [Errno 2] No such file or directory]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2026 1:11:09 PM UTC

Report

Build	Definition	Test	Pull Request
1374936	dotnet/runtime	WasmTestOnChrome-CLR-ST-Batch-8.WorkItemExecution	#126782
1374701	dotnet/runtime	WasmTestOnChrome-CLR-ST-Batch-1.WorkItemExecution	#126776
1374659	dotnet/runtime	WasmTestOnChrome-CLR-ST-Batch-17.WorkItemExecution	#126767
1374324	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.LibraryInitializerTests.WorkItemExecution	#123920
1370662	dotnet/runtime	WasmTestOnChrome-CLR-ST-Microsoft.Extensions.Diagnostics.Tests.WorkItemExecution	#126519
1374160	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.LibraryInitializerTests.WorkItemExecution	#126751
1372179	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126158
1373734	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.SatelliteLoadingTests.WorkItemExecution	#126407
1373518	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.LibraryInitializerTests.WorkItemExecution
1373430	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.IO.Compression.Tests.WorkItemExecution	#126645
1373419	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126542
1371647	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#118057
1372621	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126525
1372261	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#121880
1373165	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.LibraryInitializerTests.WorkItemExecution	#126733
1373089	dotnet/runtime	WasmTestOnChrome-CLR-ST-Microsoft.Extensions.Configuration.Functional.Tests.WorkItemExecution	#126662
1373002	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#123969
1373005	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.LibraryInitializerTests.WorkItemExecution	#126632
1372978	dotnet/runtime	WBT-NoWorkload-CLR-ST-Wasm.Build.Tests.LibraryInitializerTests.WorkItemExecution	#126276
1372913	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#125795
1370239	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#122649
1372872	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126676
1372863	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#125439
1372849	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#125437
1372819	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126631
1372812	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126700
1369801	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126199
1372785	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Linq.Queryable.Tests.WorkItemExecution	#126669
1372790	dotnet/runtime	WasmTestOnChrome-CLR-ST-Microsoft.Extensions.Configuration.Json.Tests.WorkItemExecution
1372777	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126663
1372767	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126712
1372743	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126729
1372730	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126728
1372719	dotnet/runtime	WasmTestOnChrome-CLR-ST-Microsoft.Extensions.Configuration.UserSecrets.Tests.WorkItemExecution	#126707
1372698	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Linq.Parallel.Tests.WorkItemExecution	#126719
1372661	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.IO.FileSystem.Manual.Tests.WorkItemExecution	#126678
1371456	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126680
1372655	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#126702
1370690	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.IO.Packaging.Tests.WorkItemExecution	#126034
1372609	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.IO.UnmanagedMemoryStream.Tests.WorkItemExecution	#125436
1372633	dotnet/runtime	WasmTestOnFirefox-CLR-ST-System.Threading.Tests.WorkItemExecution	#126691
1372612	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#124851
1372606	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126721
1372642	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#126649
1372589	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126713
1372566	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126520
1372550	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126718
1372554	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126396
1372539	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#124698
1372519	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#124365
1372494	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126717
1372475	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#126699
1372457	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#115996
1372434	dotnet/runtime	WasmTestOnChrome-CLR-ST-Microsoft.Extensions.Diagnostics.Tests.WorkItemExecution	#124003
1372451	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126715
1372391	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#126091
1372371	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126711
1372366	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#125559
1372423	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Security.Enterprise.Tests.WorkItemExecution	#126693
1372350	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126710
1372347	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Memory.Data.Tests.WorkItemExecution	#126705
1372343	dotnet/runtime	WasmTestOnChrome-CLR-ST-Microsoft.Extensions.Diagnostics.Tests.WorkItemExecution	#126512
1372288	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#125347
1372278	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#125333
1372258	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Linq.AsyncEnumerable.Tests.WorkItemExecution	#126629
1371365	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126622
1372240	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Linq.Parallel.Tests.WorkItemExecution	#126093
1372223	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126549
1372200	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126707
1372194	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#124637
1370694	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126655
1372169	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126704
1371466	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126493
1372111	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126645
1372096	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126646
1372092	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126542
1372040	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126701
1372012	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#125437
1371993	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#125439
1371949	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126632
1371915	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#122093
1371813	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126411
1371731	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.IO.Tests.WorkItemExecution	#126669
1371604	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.IO.UnmanagedMemoryStream.Tests.WorkItemExecution	#126666
1371516	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Linq.AsyncEnumerable.Tests.WorkItemExecution	#126660
1371487	dotnet/runtime	WasmTestOnChrome-CLR-ST-System.Net.Http.Enterprise.Tests.WorkItemExecution	#126657

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
6	86	86

[dotnet-policy-service]

Tagging subscribers to this area: @agocke, @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.

[danmoseley]

Diagnosis

Error: python3: can't open file '/root/helix/work/correlation/gen-debug-dump-docs.py'

Root cause: The HelixPostCommands in src/libraries/sendtohelixhelp.proj (lines 267-276) invoke gen-debug-dump-docs.py from the correlation payload whenever RuntimeFlavor=CoreCLR. But for TargetOS=browser, the correlation payload is built by PrepareHelixCorrelationPayload_Wasm in sendtohelix-browser.targets, which does NOT include the debug dump files. The standard CompressRuntimeDirectory target in sendtohelix.proj -- which does include them via IncludeDumpDocsInTesthost -- is skipped for browser targets (IncludeHelixCorrelationPayload=false).

The WasmTestOnChrome-CLR test leg runs with both TargetOS=browser AND RuntimeFlavor=CoreCLR, so the post-command fires but the file is missing.

Timeline:

• 2021 (PR Use ProductVersion in how-to-debug-dump #59848): gen-debug-dump-docs.py HelixPostCommand added, gated on RuntimeFlavor=CoreCLR -- correct at the time since browser tests were Mono-only.
• Jan 2026 ([browser][coreCLR] enable System.Runtime.Tests on CI as Release build #122980): browser+CoreCLR configuration introduced with a small number of tests. The mismatch existed but was latent.
• Feb 2026 ([browser][CoreCLR] smoke test libraries on V8 and Firefox #124641): More browser+CoreCLR smoke tests added.
• Mar 24 ([wasm][coreclr] Enable more libraries tests #125824): ~50 test project exclusions removed, dramatically expanding the number of WasmTestOnChrome-CLR Helix work items. This made the post-command failure frequent and persistent enough to block CI.
• Apr 10 ([wasm][coreclr] Batch CoreCLR library test suites on Helix #126157): Batching PR added batch work items, which also hit the same issue.

Proposed fix -- add TargetOS exclusions to the condition in sendtohelixhelp.proj:

<!-- Before -->
<PropertyGroup Condition="'$(RuntimeFlavor)' == 'CoreCLR' and '$(BUILD_BUILDID)' != ''">

<!-- After -->
<PropertyGroup Condition="'$(RuntimeFlavor)' == 'CoreCLR' and '$(BUILD_BUILDID)' != '' and '$(TargetOS)' != 'browser' and '$(TargetOS)' != 'wasi'">

This is the simplest fix -- crash dump debugging docs are not useful for browser/wasm targets anyway, since they run in a sandboxed wasm environment without native crash dumps.

An alternative would be to guard the shell command with a file-existence check (test -f ... &&), but excluding at the MSBuild level is cleaner and avoids running unnecessary commands.

[dotnet-policy-service]

Tagging subscribers to this area: @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.