Skip to content

Validate Helix Job Monitor result upload changes - #132799

Draft
mmitche wants to merge 32 commits into
mainfrom
mmitche-patch-1
Draft

Validate Helix Job Monitor result upload changes#132799
mmitche wants to merge 32 commits into
mainfrom
mmitche-patch-1

Conversation

@mmitche

Copy link
Copy Markdown
Member

Uses the locally built and general-testing-published Helix Job Monitor package \11.0.0-beta.26426.1\ to validate the result preparation/observation/publication refactor in runtime CI.\n\nThe validation pipeline enables the runtime monitor with 48 result upload workers.

mmitche added 28 commits August 6, 2026 14:12
Contains a fix for retries of test uploads
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 7a9af9ab-d2e9-4097-a50b-ac179b9486de
Removed the verbose flag from the Helix job monitor command.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Use package 11.0.0-beta.31411.5 to ingest Helix result files with trailing .txt suffixes, report status throughout drain, and measure a higher upload concurrency after parallelism 32 showed no throttling.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Update to 11.0.0-beta.31411.6 while retaining upload parallelism 64, which reduced the final drain to 4.8 seconds without throttling.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
The instrumented parallelism-64 run met the drain target but accumulated substantial Azure DevOps rate-limit guidance and shared-gate wait time. Test a lower concurrency to reduce service pressure while retaining upload overlap.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Update to Job Monitor 11.0.0-beta.31411.7, which distinguishes independent logical Helix jobs submitted by the same AzDO job to the same queue so same-named passing work items cannot erase failures.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Update to Job Monitor 11.0.0-beta.31411.8, which uses System.PhaseName to keep independent runtime matrix jobs distinct even when they share System.JobName=__default, queue, logical scenario, and work-item names.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Use package 11.0.0-beta.31411.9 to validate attempt-aware retry lineage in runtime CI.
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 3a3a2b2f-e044-4835-8a3c-0c99a6a29484
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 810f897d-3e88-4973-9e90-5e76fb0ba4bc
@dotnet-policy-service

Copy link
Copy Markdown
Contributor

Tagging subscribers to this area: @dotnet/runtime-infrastructure
See info in area-owners.md if you want to be subscribed.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 810f897d-3e88-4973-9e90-5e76fb0ba4bc
Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 810f897d-3e88-4973-9e90-5e76fb0ba4bc
@mmitche

Copy link
Copy Markdown
MemberAuthor

/azp run runtime

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines will not run the associated pipelines, because the pull request was updated after the run command was issued. Review the pull request again and issue a new run command.

@mmitche

Copy link
Copy Markdown
MemberAuthor

/azp run runtime

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 810f897d-3e88-4973-9e90-5e76fb0ba4bc
@mmitche

Copy link
Copy Markdown
MemberAuthor

/azp run runtime

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
Successfully started running 1 pipeline(s).

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copilot-Session: 810f897d-3e88-4973-9e90-5e76fb0ba4bc
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

1 participant

@mmitche