Skip to content

Mark testDynamicInstrumentationEnablementWithLineProbe as Flaky - #11947

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/mark-test-flaky
Jul 14, 2026
Merged

Mark testDynamicInstrumentationEnablementWithLineProbe as Flaky#11947
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
sarahchen6/mark-test-flaky

Conversation

@sarahchen6

Copy link
Copy Markdown
Contributor

What Does This Do

Mark testDynamicInstrumentationEnablementWithLineProbe() as Flaky

Motivation

Green CI

Additional Notes

For failure examples, see:

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@sarahchen6
sarahchen6 requested a review from a team as a code ownerJuly 14, 2026 16:06
@sarahchen6
sarahchen6 requested review from dudikeleti and removed request for a teamJuly 14, 2026 16:06
@sarahchen6sarahchen6 added comp: testing Testing tag: no release notes Changes to exclude from release notes tag: flaky test/disabled Disabled flaky tests labels Jul 14, 2026
@sarahchen6
sarahchen6 requested a review from jpbempelJuly 14, 2026 16:07

@datadog-prod-us1-5datadog-prod-us1-5Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Datadog Autotest: PASS

More details

The @Flaky annotation is correctly applied — it uses the already-imported datadog.trace.test.util.Flaky, follows the identical pattern used by testExceptionReplayEnablementFailure in the same class, emits the JUnit5 "flaky" tag consumed by Gradle's skip/run flaky-test properties, and the test_flaky CI job explicitly targets :debuggerTest with CONTINUE_ON_FAILURE: true. The class-level @NonRetryable does not interfere (it controls the test-retry plugin, not JUnit5 tag-based test selection).

Was this helpful? React 👍 or 👎

📊 Validated against 4 scenarios · Open Bits AI session

🤖 Datadog Autotest · Commit d21c429 · What is Autotest? · Any feedback? Reach out in #autotest

@dd-octo-sts

Copy link
Copy Markdown
Contributor

🟢 Java Benchmark SLOs — All performance SLOs passed

SuiteStatus
Startup🟢 pass

SLO thresholds are defined here based on automatically generated metrics. A warning is raised when results are within 5% of the threshold.

PR vs. master results
ScenarioCandidatemasterΔ (95% CI of mean)
startup:insecure-bank:iast:Agent13.98 s13.93 s[-0.4%; +1.1%] (no difference)
startup:insecure-bank:tracing:Agent12.98 s13.03 s[-1.1%; +0.4%] (no difference)
startup:petclinic:appsec:Agent16.98 s16.87 s[-0.4%; +1.7%] (no difference)
startup:petclinic:iast:Agent16.96 s16.43 s[-1.2%; +7.6%] (no difference)
startup:petclinic:profiling:Agent16.81 s16.93 s[-1.8%; +0.5%] (no difference)
startup:petclinic:sca:Agent16.86 s16.87 s[-1.0%; +1.0%] (no difference)
startup:petclinic:tracing:Agent16.19 s16.11 s[-0.8%; +1.8%] (no difference)

Commit:d21c4298 · CI Pipeline · Benchmarking Platform UI


Load and DaCapo benchmarks can be triggered manually in the GitLab pipeline. Results will appear in the Benchmarking Platform UI after completion.

@sarahchen6

Copy link
Copy Markdown
ContributorAuthor

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351Bot commented Jul 14, 2026

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-07-14 17:27:27 UTC ℹ️ Start processing command /merge


2026-07-14 17:27:31 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).


2026-07-14 19:01:59 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot merged commit fbd28da into masterJul 14, 2026
587 of 590 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot deleted the sarahchen6/mark-test-flaky branch July 14, 2026 19:01
@github-actionsgithub-actionsBot added this to the 1.65.0 milestone Jul 14, 2026
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: testingTestingtag: flaky test/disabledDisabled flaky teststag: no release notesChanges to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@sarahchen6@mcculls@jpbempel