Skip to content

New tests for the build time instrumentation - #10743

Merged
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
bdu/build-time-instrumentation-tests
Mar 5, 2026
Merged

New tests for the build time instrumentation#10743
gh-worker-dd-mergequeue-cf854d[bot] merged 1 commit into
masterfrom
bdu/build-time-instrumentation-tests

Conversation

@bric3

@bric3bric3 commented Mar 4, 2026

Copy link
Copy Markdown
Contributor

What Does This Do

Add new tests to cover the fixes introduced in #10735.

In particular

  • The includeClassDirectories extension method
  • Re running tasks

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note:Once your PR is ready to merge, add it to the merge queue by commenting /merge./merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@bric3
bric3 requested a review from a team as a code ownerMarch 4, 2026 19:25
@bric3
bric3 requested a review from dougqhMarch 4, 2026 19:25
@bric3bric3 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Mar 4, 2026
@bric3
bric3 requested a review from mccullsMarch 4, 2026 19:26
@bric3

bric3 commented Mar 4, 2026

Copy link
Copy Markdown
ContributorAuthor

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351Bot commented Mar 4, 2026•
edited
Loading

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-03-04 19:26:26 UTC ℹ️ Start processing command /merge

2026-03-04 19:26:32 UTC ℹ️ MergeQueue: waiting for PR to be ready

This pull request is not mergeable according to GitHub. Common reasons include pending required checks, missing approvals, or merge conflicts — but it could also be blocked by other repository rules or settings.
It will be added to the queue as soon as checks pass and/or get approvals. View in MergeQueue UI.
Note: if you pushed new commits since the last approval, you may need additional approval.
You can remove it from the waiting list with /remove command.

2026-03-05 00:20:06 UTC⚠️MergeQueue: This merge request was unqueued

devflow unqueued this merge request: It did not become mergeable within the expected time

bric3
bric3 commented Mar 4, 2026
View reviewed changes
Comment threadbuildSrc/src/test/kotlin/datadog/gradle/plugin/instrument/BuildTimeInstrumentationPluginTest.kt
]
""".trimIndent()

private val testPlugin = """

@bric3bric3Mar 4, 2026

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

note: Changed as function, and moved after tests.

@pr-commenter

pr-commenterBot commented Mar 4, 2026

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterbdu/build-time-instrumentation-tests
git_commit_date17726501691772652209
git_commit_shae27f2346f1d66a
release_version1.61.0-SNAPSHOT~e27f2349891.61.0-SNAPSHOT~6f1d66a4f5
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17726539101772653910
ci_job_id14765168201476516820
ci_pipeline_id100422901100422901
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zfyrx7zua-project-304-concurrent-0-cgmdvqzn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zfyrx7zua-project-304-concurrent-0-cgmdvqzn 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 65 metrics, 6 unstable metrics.

Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067722
Total [baseline] (8.849 s) : 0, 8848892
Agent [candidate] (1.067 s) : 0, 1066824
Total [candidate] (8.839 s) : 0, 8839282
section iast
Agent [baseline] (1.235 s) : 0, 1234722
Total [baseline] (9.582 s) : 0, 9581753
Agent [candidate] (1.227 s) : 0, 1226668
Total [candidate] (9.573 s) : 0, 9573429
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.068 s-
Agentiast1.235 s167.0 ms (15.6%)
Totaltracing8.849 s-
Totaliast9.582 s732.861 ms (8.3%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.067 s-
Agentiast1.227 s159.844 ms (15.0%)
Totaltracing8.839 s-
Totaliast9.573 s734.147 ms (8.3%)
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.199 ms) : 0, 1199
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (634.374 ms) : 0, 634374
BytebuddyAgent [candidate] (633.148 ms) : 0, 633148
AgentMeter [baseline] (29.376 ms) : 0, 29376
AgentMeter [candidate] (29.228 ms) : 0, 29228
GlobalTracer [baseline] (258.432 ms) : 0, 258432
GlobalTracer [candidate] (258.455 ms) : 0, 258455
AppSec [baseline] (31.776 ms) : 0, 31776
AppSec [candidate] (31.709 ms) : 0, 31709
Debugger [baseline] (59.038 ms) : 0, 59038
Debugger [candidate] (59.094 ms) : 0, 59094
Remote Config [baseline] (597.071 µs) : 0, 597
Remote Config [candidate] (608.204 µs) : 0, 608
Telemetry [baseline] (8.778 ms) : 0, 8778
Telemetry [candidate] (8.734 ms) : 0, 8734
Flare Poller [baseline] (7.911 ms) : 0, 7911
Flare Poller [candidate] (8.549 ms) : 0, 8549
section iast
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (801.613 ms) : 0, 801613
BytebuddyAgent [candidate] (796.227 ms) : 0, 796227
AgentMeter [baseline] (11.431 ms) : 0, 11431
AgentMeter [candidate] (11.322 ms) : 0, 11322
GlobalTracer [baseline] (249.003 ms) : 0, 249003
GlobalTracer [candidate] (247.48 ms) : 0, 247480
IAST [baseline] (25.451 ms) : 0, 25451
IAST [candidate] (25.194 ms) : 0, 25194
AppSec [baseline] (26.651 ms) : 0, 26651
AppSec [candidate] (26.361 ms) : 0, 26361
Debugger [baseline] (62.811 ms) : 0, 62811
Debugger [candidate] (62.644 ms) : 0, 62644
Remote Config [baseline] (530.479 µs) : 0, 530
Remote Config [candidate] (537.111 µs) : 0, 537
Telemetry [baseline] (14.938 ms) : 0, 14938
Telemetry [candidate] (14.806 ms) : 0, 14806
Flare Poller [baseline] (4.917 ms) : 0, 4917
Flare Poller [candidate] (4.891 ms) : 0, 4891
Loading
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1060306
Total [baseline] (10.98 s) : 0, 10979636
Agent [candidate] (1.056 s) : 0, 1056467
Total [candidate] (11.008 s) : 0, 11008255
section appsec
Agent [baseline] (1.255 s) : 0, 1255428
Total [baseline] (11.191 s) : 0, 11191185
Agent [candidate] (1.244 s) : 0, 1243900
Total [candidate] (11.116 s) : 0, 11116408
section iast
Agent [baseline] (1.227 s) : 0, 1227344
Total [baseline] (11.361 s) : 0, 11360592
Agent [candidate] (1.239 s) : 0, 1239102
Total [candidate] (11.383 s) : 0, 11383165
section profiling
Agent [baseline] (1.191 s) : 0, 1191133
Total [baseline] (11.086 s) : 0, 11086331
Agent [candidate] (1.191 s) : 0, 1191421
Total [candidate] (11.101 s) : 0, 11100793
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.06 s-
Agentappsec1.255 s195.122 ms (18.4%)
Agentiast1.227 s167.038 ms (15.8%)
Agentprofiling1.191 s130.827 ms (12.3%)
Totaltracing10.98 s-
Totalappsec11.191 s211.549 ms (1.9%)
Totaliast11.361 s380.957 ms (3.5%)
Totalprofiling11.086 s106.695 ms (1.0%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.056 s-
Agentappsec1.244 s187.433 ms (17.7%)
Agentiast1.239 s182.636 ms (17.3%)
Agentprofiling1.191 s134.954 ms (12.8%)
Totaltracing11.008 s-
Totalappsec11.116 s108.153 ms (1.0%)
Totaliast11.383 s374.911 ms (3.4%)
Totalprofiling11.101 s92.538 ms (0.8%)
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (628.586 ms) : 0, 628586
BytebuddyAgent [candidate] (627.489 ms) : 0, 627489
AgentMeter [baseline] (29.182 ms) : 0, 29182
AgentMeter [candidate] (29.117 ms) : 0, 29117
GlobalTracer [baseline] (257.282 ms) : 0, 257282
GlobalTracer [candidate] (256.678 ms) : 0, 256678
AppSec [baseline] (31.463 ms) : 0, 31463
AppSec [candidate] (31.34 ms) : 0, 31340
Debugger [baseline] (59.381 ms) : 0, 59381
Debugger [candidate] (59.094 ms) : 0, 59094
Remote Config [baseline] (584.303 µs) : 0, 584
Remote Config [candidate] (581.359 µs) : 0, 581
Telemetry [baseline] (8.662 ms) : 0, 8662
Telemetry [candidate] (8.565 ms) : 0, 8565
Flare Poller [baseline] (7.972 ms) : 0, 7972
Flare Poller [candidate] (6.472 ms) : 0, 6472
section appsec
crashtracking [baseline] (1.196 ms) : 0, 1196
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (664.446 ms) : 0, 664446
BytebuddyAgent [candidate] (657.165 ms) : 0, 657165
AgentMeter [baseline] (12.092 ms) : 0, 12092
AgentMeter [candidate] (12.002 ms) : 0, 12002
GlobalTracer [baseline] (259.892 ms) : 0, 259892
GlobalTracer [candidate] (257.935 ms) : 0, 257935
AppSec [baseline] (177.949 ms) : 0, 177949
AppSec [candidate] (177.005 ms) : 0, 177005
Debugger [baseline] (65.144 ms) : 0, 65144
Debugger [candidate] (65.372 ms) : 0, 65372
Remote Config [baseline] (583.515 µs) : 0, 584
Remote Config [candidate] (568.84 µs) : 0, 569
Telemetry [baseline] (9.909 ms) : 0, 9909
Telemetry [candidate] (9.001 ms) : 0, 9001
Flare Poller [baseline] (3.649 ms) : 0, 3649
Flare Poller [candidate] (3.605 ms) : 0, 3605
IAST [baseline] (24.206 ms) : 0, 24206
IAST [candidate] (23.888 ms) : 0, 23888
section iast
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.209 ms) : 0, 1209
BytebuddyAgent [baseline] (796.15 ms) : 0, 796150
BytebuddyAgent [candidate] (806.082 ms) : 0, 806082
AgentMeter [baseline] (11.3 ms) : 0, 11300
AgentMeter [candidate] (11.584 ms) : 0, 11584
GlobalTracer [baseline] (247.067 ms) : 0, 247067
GlobalTracer [candidate] (248.307 ms) : 0, 248307
AppSec [baseline] (26.354 ms) : 0, 26354
AppSec [candidate] (27.287 ms) : 0, 27287
Debugger [baseline] (63.836 ms) : 0, 63836
Debugger [candidate] (62.538 ms) : 0, 62538
Remote Config [baseline] (525.374 µs) : 0, 525
Remote Config [candidate] (534.265 µs) : 0, 534
Telemetry [baseline] (14.897 ms) : 0, 14897
Telemetry [candidate] (15.019 ms) : 0, 15019
Flare Poller [baseline] (4.871 ms) : 0, 4871
Flare Poller [candidate] (5.015 ms) : 0, 5015
IAST [baseline] (25.167 ms) : 0, 25167
IAST [candidate] (25.226 ms) : 0, 25226
section profiling
ProfilingAgent [baseline] (94.008 ms) : 0, 94008
ProfilingAgent [candidate] (94.46 ms) : 0, 94460
crashtracking [baseline] (1.172 ms) : 0, 1172
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (688.746 ms) : 0, 688746
BytebuddyAgent [candidate] (688.482 ms) : 0, 688482
AgentMeter [baseline] (8.693 ms) : 0, 8693
AgentMeter [candidate] (8.661 ms) : 0, 8661
GlobalTracer [baseline] (217.034 ms) : 0, 217034
GlobalTracer [candidate] (217.282 ms) : 0, 217282
AppSec [baseline] (32.211 ms) : 0, 32211
AppSec [candidate] (32.257 ms) : 0, 32257
Debugger [baseline] (65.759 ms) : 0, 65759
Debugger [candidate] (63.126 ms) : 0, 63126
Remote Config [baseline] (588.994 µs) : 0, 589
Remote Config [candidate] (600.153 µs) : 0, 600
Telemetry [baseline] (8.183 ms) : 0, 8183
Telemetry [candidate] (10.66 ms) : 0, 10660
Flare Poller [baseline] (3.495 ms) : 0, 3495
Flare Poller [candidate] (3.544 ms) : 0, 3544
Profiling [baseline] (94.577 ms) : 0, 94577
Profiling [candidate] (95.026 ms) : 0, 95026
Loading

Load

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterbdu/build-time-instrumentation-tests
git_commit_date17726501691772652209
git_commit_shae27f2346f1d66a
release_version1.61.0-SNAPSHOT~e27f2349891.61.0-SNAPSHOT~6f1d66a4f5
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17726543861772654386
ci_job_id14765168211476516821
ci_pipeline_id100422901100422901
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zfyrx7zua-project-304-concurrent-0-tc1kmft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zfyrx7zua-project-304-concurrent-0-tc1kmft9 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 3 performance regressions! Performance is the same for 12 metrics, 19 unstable metrics.

scenarioΔ mean agg_http_req_duration_p50Δ mean agg_http_req_duration_p95Δ mean throughputcandidate mean agg_http_req_duration_p50candidate mean agg_http_req_duration_p95candidate mean throughputbaseline mean agg_http_req_duration_p50baseline mean agg_http_req_duration_p95baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_loadworse
[+143.361µs; +268.897µs] or [+5.460%; +10.242%]		worse
[+182.536µs; +806.069µs] or [+2.441%; +10.781%]		unstable
[-246.817op/s; +62.130op/s] or [-18.181%; +4.576%]		2.832ms7.971ms1265.250op/s2.625ms7.476ms1357.594op/s
scenario:load:petclinic:appsec:high_loadbetter
[-1.932ms; -0.624ms] or [-9.896%; -3.195%]		better
[-2.388ms; -0.646ms] or [-7.719%; -2.088%]		unstable
[-12.322op/s; +43.947op/s] or [-5.203%; +18.558%]		18.246ms29.414ms252.625op/s19.524ms30.931ms236.812op/s
scenario:load:petclinic:code_origins:high_loadworse
[+489.005µs; +1093.713µs] or [+2.852%; +6.379%]		same
[-196.754µs; +894.248µs] or [-0.686%; +3.117%]		unstable
[-37.666op/s; +21.041op/s] or [-14.224%; +7.946%]		17.937ms29.038ms256.500op/s17.145ms28.689ms264.812op/s
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section baseline
no_agent (17.935 ms) : 17750, 18120
. : milestone, 17935,
appsec (19.717 ms) : 19515, 19918
. : milestone, 19717,
code_origins (17.623 ms) : 17447, 17798
. : milestone, 17623,
iast (18.682 ms) : 18493, 18872
. : milestone, 18682,
profiling (19.785 ms) : 19587, 19982
. : milestone, 19785,
tracing (17.678 ms) : 17500, 17855
. : milestone, 17678,
section candidate
no_agent (17.723 ms) : 17538, 17908
. : milestone, 17723,
appsec (18.474 ms) : 18285, 18662
. : milestone, 18474,
code_origins (18.191 ms) : 18010, 18373
. : milestone, 18191,
iast (18.19 ms) : 18008, 18372
. : milestone, 18190,
profiling (19.544 ms) : 19346, 19741
. : milestone, 19544,
tracing (17.534 ms) : 17357, 17711
. : milestone, 17534,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent17.935 ms [17.75 ms, 18.12 ms]-
appsec19.717 ms [19.515 ms, 19.918 ms]1.782 ms (9.9%)
code_origins17.623 ms [17.447 ms, 17.798 ms]-311.956 µs (-1.7%)
iast18.682 ms [18.493 ms, 18.872 ms]747.374 µs (4.2%)
profiling19.785 ms [19.587 ms, 19.982 ms]1.85 ms (10.3%)
tracing17.678 ms [17.5 ms, 17.855 ms]-257.232 µs (-1.4%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent17.723 ms [17.538 ms, 17.908 ms]-
appsec18.474 ms [18.285 ms, 18.662 ms]750.895 µs (4.2%)
code_origins18.191 ms [18.01 ms, 18.373 ms]468.49 µs (2.6%)
iast18.19 ms [18.008 ms, 18.372 ms]467.034 µs (2.6%)
profiling19.544 ms [19.346 ms, 19.741 ms]1.821 ms (10.3%)
tracing17.534 ms [17.357 ms, 17.711 ms]-189.105 µs (-1.1%)
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section baseline
no_agent (1.179 ms) : 1168, 1191
. : milestone, 1179,
iast (3.197 ms) : 3155, 3239
. : milestone, 3197,
iast_FULL (5.741 ms) : 5683, 5799
. : milestone, 5741,
iast_GLOBAL (3.373 ms) : 3320, 3427
. : milestone, 3373,
profiling (2.049 ms) : 2031, 2067
. : milestone, 2049,
tracing (1.797 ms) : 1781, 1812
. : milestone, 1797,
section candidate
no_agent (1.177 ms) : 1166, 1189
. : milestone, 1177,
iast (3.205 ms) : 3162, 3247
. : milestone, 3205,
iast_FULL (5.475 ms) : 5421, 5528
. : milestone, 5475,
iast_GLOBAL (3.625 ms) : 3557, 3693
. : milestone, 3625,
profiling (1.965 ms) : 1949, 1981
. : milestone, 1965,
tracing (1.749 ms) : 1734, 1764
. : milestone, 1749,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.179 ms [1.168 ms, 1.191 ms]-
iast3.197 ms [3.155 ms, 3.239 ms]2.018 ms (171.1%)
iast_FULL5.741 ms [5.683 ms, 5.799 ms]4.561 ms (386.7%)
iast_GLOBAL3.373 ms [3.32 ms, 3.427 ms]2.194 ms (186.0%)
profiling2.049 ms [2.031 ms, 2.067 ms]869.843 µs (73.8%)
tracing1.797 ms [1.781 ms, 1.812 ms]617.136 µs (52.3%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.177 ms [1.166 ms, 1.189 ms]-
iast3.205 ms [3.162 ms, 3.247 ms]2.027 ms (172.2%)
iast_FULL5.475 ms [5.421 ms, 5.528 ms]4.297 ms (365.0%)
iast_GLOBAL3.625 ms [3.557 ms, 3.693 ms]2.447 ms (207.9%)
profiling1.965 ms [1.949 ms, 1.981 ms]787.383 µs (66.9%)
tracing1.749 ms [1.734 ms, 1.764 ms]571.68 µs (48.6%)

Dacapo

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterbdu/build-time-instrumentation-tests
git_commit_date17726501691772652209
git_commit_shae27f2346f1d66a
release_version1.61.0-SNAPSHOT~e27f2349891.61.0-SNAPSHOT~6f1d66a4f5
See matching parameters
BaselineCandidate
applicationbiojavabiojava
ci_job_date17726541671772654167
ci_job_id14765168221476516822
ci_pipeline_id100422901100422901
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zfyrx7zua-project-304-concurrent-1-yju0xxpm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zfyrx7zua-project-304-concurrent-1-yju0xxpm 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section baseline
no_agent (14.781 s) : 14781000, 14781000
. : milestone, 14781000,
appsec (14.965 s) : 14965000, 14965000
. : milestone, 14965000,
iast (17.763 s) : 17763000, 17763000
. : milestone, 17763000,
iast_GLOBAL (17.797 s) : 17797000, 17797000
. : milestone, 17797000,
profiling (14.745 s) : 14745000, 14745000
. : milestone, 14745000,
tracing (15.145 s) : 15145000, 15145000
. : milestone, 15145000,
section candidate
no_agent (15.463 s) : 15463000, 15463000
. : milestone, 15463000,
appsec (15.014 s) : 15014000, 15014000
. : milestone, 15014000,
iast (17.641 s) : 17641000, 17641000
. : milestone, 17641000,
iast_GLOBAL (17.51 s) : 17510000, 17510000
. : milestone, 17510000,
profiling (14.709 s) : 14709000, 14709000
. : milestone, 14709000,
tracing (15.125 s) : 15125000, 15125000
. : milestone, 15125000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent14.781 s [14.781 s, 14.781 s]-
appsec14.965 s [14.965 s, 14.965 s]184.0 ms (1.2%)
iast17.763 s [17.763 s, 17.763 s]2.982 s (20.2%)
iast_GLOBAL17.797 s [17.797 s, 17.797 s]3.016 s (20.4%)
profiling14.745 s [14.745 s, 14.745 s]-36.0 ms (-0.2%)
tracing15.145 s [15.145 s, 15.145 s]364.0 ms (2.5%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.463 s [15.463 s, 15.463 s]-
appsec15.014 s [15.014 s, 15.014 s]-449.0 ms (-2.9%)
iast17.641 s [17.641 s, 17.641 s]2.178 s (14.1%)
iast_GLOBAL17.51 s [17.51 s, 17.51 s]2.047 s (13.2%)
profiling14.709 s [14.709 s, 14.709 s]-754.0 ms (-4.9%)
tracing15.125 s [15.125 s, 15.125 s]-338.0 ms (-2.2%)
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~6f1d66a4f5, baseline=1.61.0-SNAPSHOT~e27f234989
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1488
. : milestone, 1476,
appsec (2.502 ms) : 2447, 2556
. : milestone, 2502,
iast (2.248 ms) : 2179, 2317
. : milestone, 2248,
iast_GLOBAL (2.286 ms) : 2217, 2355
. : milestone, 2286,
profiling (2.094 ms) : 2037, 2150
. : milestone, 2094,
tracing (2.05 ms) : 1997, 2104
. : milestone, 2050,
section candidate
no_agent (1.474 ms) : 1462, 1485
. : milestone, 1474,
appsec (3.779 ms) : 3557, 4001
. : milestone, 3779,
iast (2.255 ms) : 2186, 2325
. : milestone, 2255,
iast_GLOBAL (2.291 ms) : 2222, 2361
. : milestone, 2291,
profiling (2.07 ms) : 2015, 2125
. : milestone, 2070,
tracing (2.067 ms) : 2013, 2121
. : milestone, 2067,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.476 ms [1.464 ms, 1.488 ms]-
appsec2.502 ms [2.447 ms, 2.556 ms]1.026 ms (69.5%)
iast2.248 ms [2.179 ms, 2.317 ms]772.121 µs (52.3%)
iast_GLOBAL2.286 ms [2.217 ms, 2.355 ms]809.947 µs (54.9%)
profiling2.094 ms [2.037 ms, 2.15 ms]617.539 µs (41.8%)
tracing2.05 ms [1.997 ms, 2.104 ms]574.436 µs (38.9%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.474 ms [1.462 ms, 1.485 ms]-
appsec3.779 ms [3.557 ms, 4.001 ms]2.305 ms (156.4%)
iast2.255 ms [2.186 ms, 2.325 ms]781.752 µs (53.0%)
iast_GLOBAL2.291 ms [2.222 ms, 2.361 ms]817.374 µs (55.5%)
profiling2.07 ms [2.015 ms, 2.125 ms]596.173 µs (40.5%)
tracing2.067 ms [2.013 ms, 2.121 ms]593.468 µs (40.3%)

amarziali
amarziali approved these changes Mar 5, 2026
View reviewed changes

@amarzialiamarziali left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good thanks

@bric3

bric3 commented Mar 5, 2026

Copy link
Copy Markdown
ContributorAuthor

/merge

@gh-worker-devflow-routing-ef8351

gh-worker-devflow-routing-ef8351Bot commented Mar 5, 2026•
edited
Loading

Copy link
Copy Markdown

View all feedbacks in Devflow UI.

2026-03-05 09:57:48 UTC ℹ️ Start processing command /merge

2026-03-05 09:57:53 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 1h (p90).

2026-03-05 11:15:47 UTC ℹ️ MergeQueue: This merge request was merged

@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot merged commit 9ab4514 into masterMar 5, 2026
742 of 747 checks passed
@gh-worker-dd-mergequeue-cf854d
gh-worker-dd-mergequeue-cf854dBot deleted the bdu/build-time-instrumentation-tests branch March 5, 2026 11:15
@github-actionsgithub-actionsBot added this to the 1.61.0 milestone Mar 5, 2026
@bric3bric3 mentioned this pull request Mar 5, 2026
Merged
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mccullsmccullsmcculls approved these changes
@amarzialiamarzialiamarziali approved these changes
@dougqhdougqhAwaiting requested review from dougqhdougqh was automatically assigned from DataDog/dd-trace-java-admin

Assignees

No one assigned

Labels

comp: toolingBuild & Toolingtag: no release notesChanges to exclude from release notes

Projects

None yet

Milestone

1.61.0

Development

Successfully merging this pull request may close these issues.

3 participants

@bric3@mcculls@amarziali