Skip to content

Stop running all SSI system test VMs on MQ - #11946

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/reconfigure-gitlab-system-tests
Jul 14, 2026
Merged

Stop running all SSI system test VMs on MQ#11946
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/reconfigure-gitlab-system-tests

Conversation

@sarahchen6

Copy link
Copy Markdown
Contributor

What Does This Do

Run all SSI GitLab system tests on master only, no longer on the Merge Queue

Motivation

These tests are relatively flaky and difficult to mark as flaky on the dd-trace-java side. They are negatively affecting MQ success rates. The tests were intended to be run nightly, so running only on master should be okay.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6
sarahchen6 requested a review from a team as a code ownerJuly 14, 2026 15:56
@sarahchen6sarahchen6 added the tag: no release notes Changes to exclude from release notes label Jul 14, 2026
@sarahchen6
sarahchen6 requested a review from a team as a code ownerJuly 14, 2026 15:56
@sarahchen6sarahchen6 added the comp: tooling Build & Tooling label Jul 14, 2026
@sarahchen6
sarahchen6 requested review from bric3 and erikayasuda and removed request for a teamJuly 14, 2026 15:56

@datadog-datadog-prod-us1datadog-datadog-prod-us1Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

Three-line CI config deletion that removes SYSTEM_TESTS_RUN_ALL_VMS: "true" from the MQ workflow rule — the downstream system-tests pipeline (via remote one-pipeline.yml) will now use its default VM set on MQ while master retains the full-VM run; the Gradle test_ssi_smoke jobs continue running on MQ unaffected because they have their own explicit rules and do not consume this variable.

Was this helpful? React 👍 or 👎

Open Bits AI session

🤖 Datadog Autotest · Commit 1648cdd · What is Autotest? · Any feedback? Reach out in #autotest

@datadog-datadog-prod-us1

datadog-datadog-prod-us1Bot commented Jul 14, 2026

Copy link
Copy Markdown
Contributor

🎯 Code Coverage (details)
Patch Coverage: 100.00%
Overall Coverage: 57.17% (-0.02%)

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 1648cdd | Docs | Datadog PR Page | Give us feedback!

@dd-octo-sts

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

SuiteStatus
Startup🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
ScenarioCandidatemasterΔ (95% CI of mean)
startup:insecure-bank:iast:Agent13.92 s14.03 s[-1.4%; -0.1%] (maybe better)
startup:insecure-bank:tracing:Agent13.02 s13.06 s[-1.1%; +0.6%] (no difference)
startup:petclinic:appsec:Agent16.89 s16.21 s[-0.2%; +8.7%] (no difference)
startup:petclinic:iast:Agent16.80 s16.96 s[-1.7%; -0.2%] (maybe better)
startup:petclinic:profiling:Agent16.81 s16.66 s[-0.2%; +2.0%] (no difference)
startup:petclinic:sca:Agent16.93 s16.91 s[-0.7%; +0.9%] (no difference)
startup:petclinic:tracing:Agent16.17 s16.33 s[-1.8%; -0.2%] (maybe better)

Commit:1648cdd6 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@mccullsmcculls left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense

@sarahchen6

Copy link
Copy Markdown
ContributorAuthor

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351Bot commented Jul 14, 2026

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-07-14 17:11:52 UTC ℹ️ Start processing command /merge


2026-07-14 17:11:57 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).


2026-07-14 18:13:08 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot merged commit 979299b into masterJul 14, 2026
587 of 590 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot deleted the sarahchen6/reconfigure-gitlab-system-tests branch July 14, 2026 18:13
@github-actionsgithub-actionsBot added this to the 1.65.0 milestone Jul 14, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: toolingBuild & Toolingtag: no release notesChanges to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@sarahchen6@mcculls