Skip to content

Relax arm64 CI jobs and align coverage with amd64 - #11835

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits into
masterfrom
alexeyk/relax-amd64-tests
Jul 2, 2026
Merged

Relax arm64 CI jobs and align coverage with amd64#11835
gh-worker-dd-mergequeue-cf854d[bot] merged 2 commits into
masterfrom
alexeyk/relax-amd64-tests

Conversation

@AlexeyKuznetsov-DD

@AlexeyKuznetsov-DDAlexeyKuznetsov-DD commented Jul 2, 2026•
edited
Loading

Copy link
Copy Markdown
Contributor

What Does This Do

  • Marks all *_arm64 test jobs as allow_failure: true on merge queue (mq-working-branch-*) and master by adding allow_failure to the shared .test_job_arm64 rules.
  • Fixes -PcheckCoverage on arm64 to match the amd64 jobs:
    • test_debugger_arm64: skip coverage on semeru8/semeru11/semeru17 (those disable some tests and can't reach the expected coverage).
    • test_base_arm64: run coverage only on JVM 8, mirroring test_base.

Motivation

arm64 tests were just introduced to the merge queue and master. Keeping them non-blocking lets us collect stability stats and fix flaky/failing jobs in a relaxed way without blocking the whole team. It also unbreaks the arm64 debugger job, which was failing coverage verification on Semeru JVMs (same root cause fixed for amd64 in #11807).

Additional Notes

  • ibm8/oracle8 never run on arm64 (excluded by .test_job_arm64 rules), so they're intentionally omitted from the debugger coverage condition.
  • allow_failure is temporary — remove it once the arm64 suite is proven stable.

@AlexeyKuznetsov-DD@claude
Relax arm64 CI jobs and align coverage with amd64
41ddd10
Make arm64 tests non-blocking on merge queue and master while collecting
stability stats, and fix -PcheckCoverage setup to mirror the amd64 jobs.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@AlexeyKuznetsov-DDAlexeyKuznetsov-DD self-assigned this Jul 2, 2026
@AlexeyKuznetsov-DDAlexeyKuznetsov-DD added type: bug fix Bug fix tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Jul 2, 2026
@AlexeyKuznetsov-DD
AlexeyKuznetsov-DD marked this pull request as ready for review July 2, 2026 02:32
@AlexeyKuznetsov-DD
AlexeyKuznetsov-DD requested review from a team as code ownersJuly 2, 2026 02:32
@AlexeyKuznetsov-DD
AlexeyKuznetsov-DD requested review from erikayasuda and removed request for a teamJuly 2, 2026 02:32
@dd-octo-stsdd-octo-stsBot added the tag: ai generated Largely based on code generated by an AI or LLM label Jul 2, 2026
@datadog-official

This comment has been minimized.

Sign in to view
@AlexeyKuznetsov-DD@claude
Enable non-default JVMs on demand.
19745d8
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@dd-octo-sts

dd-octo-stsBot commented Jul 2, 2026•
edited
Loading

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

SuiteStatus
Startup🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
ScenarioCandidatemasterΔ (95% CI of mean)
startup:insecure-bank:iast:Agent14.01 s13.94 s[-0.3%; +1.2%] (no difference)
startup:insecure-bank:tracing:Agent12.97 s12.98 s[-0.8%; +0.6%] (no difference)
startup:petclinic:appsec:Agent16.48 s16.39 s[-5.9%; +7.0%] (unstable)
startup:petclinic:iast:Agent16.87 s16.87 s[-0.8%; +0.7%] (no difference)
startup:petclinic:profiling:Agent16.79 s16.88 s[-2.0%; +0.9%] (no difference)
startup:petclinic:sca:Agent16.87 s16.25 s[-0.6%; +8.2%] (no difference)
startup:petclinic:tracing:Agent15.70 s16.02 s[-6.2%; +2.2%] (no difference)

Commit:19745d8e · CI Pipeline · Benchmarking Platform UI

Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@amarziali
amarziali added this pull request to the merge queueJul 2, 2026
@dd-octo-sts

dd-octo-stsBot commented Jul 2, 2026

Copy link
Copy Markdown
Contributor

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351Bot commented Jul 2, 2026•
edited
Loading

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-07-02 04:30:35 UTC ℹ️ Start processing command /merge

2026-07-02 04:30:39 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

2026-07-02 05:34:45 UTC ℹ️ MergeQueue: This merge request was merged

@github-merge-queue
github-merge-queueBot removed this pull request from the merge queue due to failed status checks Jul 2, 2026
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot merged commit 4f5c4cc into masterJul 2, 2026
946 of 948 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot deleted the alexeyk/relax-amd64-tests branch July 2, 2026 05:34
@github-actionsgithub-actionsBot added this to the 1.64.0 milestone Jul 2, 2026
@AlexeyKuznetsov-DDAlexeyKuznetsov-DD mentioned this pull request Aug 12, 2026
Open
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@amarzialiamarzialiamarziali approved these changes
@bric3bric3Awaiting requested review from bric3
@erikayasudaerikayasudaAwaiting requested review from erikayasudaerikayasuda is a code owner automatically assigned from DataDog/apm-release-platform

Assignees

@AlexeyKuznetsov-DDAlexeyKuznetsov-DD

Labels

comp: toolingBuild & Toolingtag: ai generatedLargely based on code generated by an AI or LLMtag: no release notesChanges to exclude from release notestype: bug fixBug fix

Projects

None yet

Milestone

1.64.0

Development

Successfully merging this pull request may close these issues.

2 participants

@AlexeyKuznetsov-DD@amarziali