Improve instrumentation JUnit testing by PerfectSlayer · Pull Request #11096 · DataDog/dd-trace-java

PerfectSlayer · 2026-04-13T13:47:40Z

What Does This Do

This PR fixes base instrumentation tests class to initialize the tracer from per method to per class to match Spock setupSpec() / cleanUpSpec().

It introduces a InstrumentationTestConfig to help with configuring the tests.
As the tracer is now initialized in a static @BeforeEach, the instrumentation test config must be done in a static initializer block like:

classMyTestextendsAbstractInstrumentationTest {
static {
testConfig.idGenerationStrategy("RANDOM").strictTraceWrites(false);
}
}

Not ideal but it could have been worse. Not many tests should changed the default configuration any way.

Additionally, it improves error reports, add missing default tags to tag assert, and fix case when span link matchers are missing.

Motivation

This is the current behavior from the Spock specification and the per method was killing test execution performance.

Additional Notes

This PR is part of some bigger improvements in stacked PRs:

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: APMLP-1247

Note:Once your PR is ready to merge, add it to the merge queue by commenting /merge./merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-04-13T14:36:26Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java-instrumented-tests
git_commit_date	1777290080	1777289163
git_commit_sha	b30f2bb1ee	`5e0f9d5`
release_version	1.62.0-SNAPSHOT~eb30f2bb1ee	1.62.0-SNAPSHOT~5e0f9d55f9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1777291378	1777291378
ci_job_id	1633014747	1633014747
ci_pipeline_id	109864028	109864028
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-6204ipe4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-6204ipe4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 63 metrics, 8 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1057582
Total [baseline] (8.85 s) : 0, 8849594
Agent [candidate] (1.059 s) : 0, 1059337
Total [candidate] (8.859 s) : 0, 8858769
section iast
Agent [baseline] (1.239 s) : 0, 1238989
Total [baseline] (9.6 s) : 0, 9600231
Agent [candidate] (1.239 s) : 0, 1238545
Total [candidate] (9.602 s) : 0, 9602058

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	iast	1.239 s	181.408 ms (17.2%)
Total	tracing	8.85 s	-
Total	iast	9.6 s	750.637 ms (8.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.059 s	-
Agent	iast	1.239 s	179.207 ms (16.9%)
Total	tracing	8.859 s	-
Total	iast	9.602 s	743.289 ms (8.4%)

gantt
title insecure-bank - break down per module: candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.227 ms) : 0, 1227
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (634.996 ms) : 0, 634996
BytebuddyAgent [candidate] (634.78 ms) : 0, 634780
AgentMeter [baseline] (29.398 ms) : 0, 29398
AgentMeter [candidate] (29.749 ms) : 0, 29749
GlobalTracer [baseline] (248.471 ms) : 0, 248471
GlobalTracer [candidate] (250.225 ms) : 0, 250225
AppSec [baseline] (32.283 ms) : 0, 32283
AppSec [candidate] (32.534 ms) : 0, 32534
Debugger [baseline] (59.606 ms) : 0, 59606
Debugger [candidate] (60.032 ms) : 0, 60032
Remote Config [baseline] (607.037 µs) : 0, 607
Remote Config [candidate] (604.701 µs) : 0, 605
Telemetry [baseline] (8.766 ms) : 0, 8766
Telemetry [candidate] (9.613 ms) : 0, 9613
Flare Poller [baseline] (5.925 ms) : 0, 5925
Flare Poller [candidate] (4.408 ms) : 0, 4408
section iast
crashtracking [baseline] (1.242 ms) : 0, 1242
crashtracking [candidate] (1.231 ms) : 0, 1231
BytebuddyAgent [baseline] (813.146 ms) : 0, 813146
BytebuddyAgent [candidate] (813.738 ms) : 0, 813738
AgentMeter [baseline] (11.49 ms) : 0, 11490
AgentMeter [candidate] (11.451 ms) : 0, 11451
GlobalTracer [baseline] (241.637 ms) : 0, 241637
GlobalTracer [candidate] (240.963 ms) : 0, 240963
AppSec [baseline] (28.993 ms) : 0, 28993
AppSec [candidate] (28.01 ms) : 0, 28010
Debugger [baseline] (65.897 ms) : 0, 65897
Debugger [candidate] (65.687 ms) : 0, 65687
Remote Config [baseline] (539.774 µs) : 0, 540
Remote Config [candidate] (532.124 µs) : 0, 532
Telemetry [baseline] (7.859 ms) : 0, 7859
Telemetry [candidate] (7.836 ms) : 0, 7836
Flare Poller [baseline] (3.463 ms) : 0, 3463
Flare Poller [candidate] (3.503 ms) : 0, 3503
IAST [baseline] (28.531 ms) : 0, 28531
IAST [candidate] (29.43 ms) : 0, 29430

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056590
Total [baseline] (11.191 s) : 0, 11191498
Agent [candidate] (1.066 s) : 0, 1065717
Total [candidate] (11.137 s) : 0, 11137349
section appsec
Agent [baseline] (1.275 s) : 0, 1275162
Total [baseline] (11.079 s) : 0, 11079229
Agent [candidate] (1.266 s) : 0, 1266204
Total [candidate] (11.146 s) : 0, 11146143
section iast
Agent [baseline] (1.234 s) : 0, 1233792
Total [baseline] (11.427 s) : 0, 11426990
Agent [candidate] (1.247 s) : 0, 1247151
Total [candidate] (11.391 s) : 0, 11390556
section profiling
Agent [baseline] (1.185 s) : 0, 1184646
Total [baseline] (11.003 s) : 0, 11003412
Agent [candidate] (1.189 s) : 0, 1188767
Total [candidate] (11.136 s) : 0, 11135673

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.275 s	218.572 ms (20.7%)
Agent	iast	1.234 s	177.202 ms (16.8%)
Agent	profiling	1.185 s	128.057 ms (12.1%)
Total	tracing	11.191 s	-
Total	appsec	11.079 s	-112.269 ms (-1.0%)
Total	iast	11.427 s	235.492 ms (2.1%)
Total	profiling	11.003 s	-188.086 ms (-1.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.266 s	200.487 ms (18.8%)
Agent	iast	1.247 s	181.434 ms (17.0%)
Agent	profiling	1.189 s	123.05 ms (11.5%)
Total	tracing	11.137 s	-
Total	appsec	11.146 s	8.794 ms (0.1%)
Total	iast	11.391 s	253.206 ms (2.3%)
Total	profiling	11.136 s	-1.676 ms (-0.0%)

gantt
title petclinic - break down per module: candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.23 ms) : 0, 1230
crashtracking [candidate] (1.233 ms) : 0, 1233
BytebuddyAgent [baseline] (635.189 ms) : 0, 635189
BytebuddyAgent [candidate] (641.615 ms) : 0, 641615
AgentMeter [baseline] (29.395 ms) : 0, 29395
AgentMeter [candidate] (29.572 ms) : 0, 29572
GlobalTracer [baseline] (249.123 ms) : 0, 249123
GlobalTracer [candidate] (250.84 ms) : 0, 250840
AppSec [baseline] (32.389 ms) : 0, 32389
AppSec [candidate] (32.52 ms) : 0, 32520
Debugger [baseline] (60.698 ms) : 0, 60698
Debugger [candidate] (61.132 ms) : 0, 61132
Remote Config [baseline] (606.853 µs) : 0, 607
Remote Config [candidate] (607.076 µs) : 0, 607
Telemetry [baseline] (8.089 ms) : 0, 8089
Telemetry [candidate] (8.228 ms) : 0, 8228
Flare Poller [baseline] (3.604 ms) : 0, 3604
Flare Poller [candidate] (3.628 ms) : 0, 3628
section appsec
crashtracking [baseline] (1.256 ms) : 0, 1256
crashtracking [candidate] (1.225 ms) : 0, 1225
BytebuddyAgent [baseline] (684.307 ms) : 0, 684307
BytebuddyAgent [candidate] (678.064 ms) : 0, 678064
AgentMeter [baseline] (12.391 ms) : 0, 12391
AgentMeter [candidate] (12.29 ms) : 0, 12290
GlobalTracer [baseline] (251.366 ms) : 0, 251366
GlobalTracer [candidate] (249.764 ms) : 0, 249764
IAST [baseline] (24.33 ms) : 0, 24330
IAST [candidate] (24.234 ms) : 0, 24234
AppSec [baseline] (186.626 ms) : 0, 186626
AppSec [candidate] (186.998 ms) : 0, 186998
Debugger [baseline] (66.332 ms) : 0, 66332
Debugger [candidate] (65.272 ms) : 0, 65272
Remote Config [baseline] (581.428 µs) : 0, 581
Remote Config [candidate] (582.757 µs) : 0, 583
Telemetry [baseline] (7.859 ms) : 0, 7859
Telemetry [candidate] (7.866 ms) : 0, 7866
Flare Poller [baseline] (3.438 ms) : 0, 3438
Flare Poller [candidate] (3.462 ms) : 0, 3462
section iast
crashtracking [baseline] (1.238 ms) : 0, 1238
crashtracking [candidate] (1.248 ms) : 0, 1248
BytebuddyAgent [baseline] (810.478 ms) : 0, 810478
BytebuddyAgent [candidate] (819.566 ms) : 0, 819566
AgentMeter [baseline] (11.403 ms) : 0, 11403
AgentMeter [candidate] (11.539 ms) : 0, 11539
GlobalTracer [baseline] (239.248 ms) : 0, 239248
GlobalTracer [candidate] (242.426 ms) : 0, 242426
IAST [baseline] (30.976 ms) : 0, 30976
IAST [candidate] (30.002 ms) : 0, 30002
AppSec [baseline] (27.548 ms) : 0, 27548
AppSec [candidate] (28.801 ms) : 0, 28801
Debugger [baseline] (65.087 ms) : 0, 65087
Debugger [candidate] (65.474 ms) : 0, 65474
Remote Config [baseline] (547.016 µs) : 0, 547
Remote Config [candidate] (529.596 µs) : 0, 530
Telemetry [baseline] (7.809 ms) : 0, 7809
Telemetry [candidate] (7.786 ms) : 0, 7786
Flare Poller [baseline] (3.429 ms) : 0, 3429
Flare Poller [candidate] (3.42 ms) : 0, 3420
section profiling
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (691.411 ms) : 0, 691411
BytebuddyAgent [candidate] (693.93 ms) : 0, 693930
AgentMeter [baseline] (8.923 ms) : 0, 8923
AgentMeter [candidate] (8.988 ms) : 0, 8988
GlobalTracer [baseline] (207.525 ms) : 0, 207525
GlobalTracer [candidate] (208.293 ms) : 0, 208293
AppSec [baseline] (32.305 ms) : 0, 32305
AppSec [candidate] (32.62 ms) : 0, 32620
Debugger [baseline] (65.882 ms) : 0, 65882
Debugger [candidate] (65.838 ms) : 0, 65838
Remote Config [baseline] (582.236 µs) : 0, 582
Remote Config [candidate] (588.068 µs) : 0, 588
Telemetry [baseline] (7.745 ms) : 0, 7745
Telemetry [candidate] (7.885 ms) : 0, 7885
Flare Poller [baseline] (3.469 ms) : 0, 3469
Flare Poller [candidate] (3.536 ms) : 0, 3536
ProfilingAgent [baseline] (93.806 ms) : 0, 93806
ProfilingAgent [candidate] (94.198 ms) : 0, 94198
Profiling [baseline] (94.359 ms) : 0, 94359
Profiling [candidate] (94.77 ms) : 0, 94770

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java-instrumented-tests
git_commit_date	1777289993	1777289163
git_commit_sha	b30f2bb1ee	`5e0f9d5`
release_version	1.62.0-SNAPSHOT~eb30f2bb1ee	1.62.0-SNAPSHOT~5e0f9d55f9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1777291764	1777291764
ci_job_id	1633014748	1633014748
ci_pipeline_id	109864028	109864028
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-mjjc17uu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-mjjc17uu 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+215.783µs; +477.260µs] or [+4.020%; +8.892%]	worse [+317.648µs; +1083.930µs] or [+2.484%; +8.477%]	unstable [-113.948op/s; +35.760op/s] or [-14.928%; +4.685%]	5.714ms	13.487ms	724.219op/s	5.368ms	12.786ms	763.312op/s
scenario:load:petclinic:iast:high_load	better [-1.558ms; -0.718ms] or [-8.288%; -3.821%]	unsure [-1.949ms; -0.518ms] or [-6.484%; -1.722%]	unstable [-13.598op/s; +41.035op/s] or [-5.543%; +16.728%]	17.660ms	28.827ms	259.031op/s	18.798ms	30.061ms	245.312op/s

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section baseline
no_agent (1.25 ms) : 1238, 1262
. : milestone, 1250,
iast (3.332 ms) : 3283, 3380
. : milestone, 3332,
iast_FULL (6.06 ms) : 5998, 6122
. : milestone, 6060,
iast_GLOBAL (3.685 ms) : 3623, 3747
. : milestone, 3685,
profiling (2.381 ms) : 2356, 2407
. : milestone, 2381,
tracing (1.884 ms) : 1869, 1899
. : milestone, 1884,
section candidate
no_agent (1.23 ms) : 1218, 1241
. : milestone, 1230,
iast (3.303 ms) : 3255, 3351
. : milestone, 3303,
iast_FULL (6.391 ms) : 6323, 6458
. : milestone, 6391,
iast_GLOBAL (3.642 ms) : 3582, 3702
. : milestone, 3642,
profiling (2.203 ms) : 2183, 2223
. : milestone, 2203,
tracing (1.877 ms) : 1862, 1892
. : milestone, 1877,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.25 ms [1.238 ms, 1.262 ms]	-
iast	3.332 ms [3.283 ms, 3.38 ms]	2.082 ms (166.5%)
iast_FULL	6.06 ms [5.998 ms, 6.122 ms]	4.81 ms (384.7%)
iast_GLOBAL	3.685 ms [3.623 ms, 3.747 ms]	2.435 ms (194.8%)
profiling	2.381 ms [2.356 ms, 2.407 ms]	1.131 ms (90.5%)
tracing	1.884 ms [1.869 ms, 1.899 ms]	634.137 µs (50.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.23 ms [1.218 ms, 1.241 ms]	-
iast	3.303 ms [3.255 ms, 3.351 ms]	2.073 ms (168.6%)
iast_FULL	6.391 ms [6.323 ms, 6.458 ms]	5.161 ms (419.7%)
iast_GLOBAL	3.642 ms [3.582 ms, 3.702 ms]	2.412 ms (196.2%)
profiling	2.203 ms [2.183 ms, 2.223 ms]	973.524 µs (79.2%)
tracing	1.877 ms [1.862 ms, 1.892 ms]	647.363 µs (52.6%)

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section baseline
no_agent (19.564 ms) : 19367, 19760
. : milestone, 19564,
appsec (19.269 ms) : 19073, 19466
. : milestone, 19269,
code_origins (18.09 ms) : 17910, 18270
. : milestone, 18090,
iast (19.031 ms) : 18842, 19220
. : milestone, 19031,
profiling (18.222 ms) : 18044, 18401
. : milestone, 18222,
tracing (17.905 ms) : 17728, 18082
. : milestone, 17905,
section candidate
no_agent (18.433 ms) : 18242, 18624
. : milestone, 18433,
appsec (18.845 ms) : 18651, 19040
. : milestone, 18845,
code_origins (17.701 ms) : 17527, 17876
. : milestone, 17701,
iast (18.012 ms) : 17835, 18190
. : milestone, 18012,
profiling (18.715 ms) : 18530, 18900
. : milestone, 18715,
tracing (17.865 ms) : 17687, 18043
. : milestone, 17865,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.564 ms [19.367 ms, 19.76 ms]	-
appsec	19.269 ms [19.073 ms, 19.466 ms]	-294.274 µs (-1.5%)
code_origins	18.09 ms [17.91 ms, 18.27 ms]	-1.474 ms (-7.5%)
iast	19.031 ms [18.842 ms, 19.22 ms]	-532.709 µs (-2.7%)
profiling	18.222 ms [18.044 ms, 18.401 ms]	-1.341 ms (-6.9%)
tracing	17.905 ms [17.728 ms, 18.082 ms]	-1.659 ms (-8.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.433 ms [18.242 ms, 18.624 ms]	-
appsec	18.845 ms [18.651 ms, 19.04 ms]	412.123 µs (2.2%)
code_origins	17.701 ms [17.527 ms, 17.876 ms]	-731.834 µs (-4.0%)
iast	18.012 ms [17.835 ms, 18.19 ms]	-420.574 µs (-2.3%)
profiling	18.715 ms [18.53 ms, 18.9 ms]	281.843 µs (1.5%)
tracing	17.865 ms [17.687 ms, 18.043 ms]	-567.81 µs (-3.1%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/groovy-to-java-instrumented-tests
git_commit_date	1777290080	1777289163
git_commit_sha	b30f2bb1ee	`5e0f9d5`
release_version	1.62.0-SNAPSHOT~eb30f2bb1ee	1.62.0-SNAPSHOT~5e0f9d55f9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1777291577	1777291577
ci_job_id	1633014749	1633014749
ci_pipeline_id	109864028	109864028
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-reiy0unz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-reiy0unz 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section baseline
no_agent (15.463 s) : 15463000, 15463000
. : milestone, 15463000,
appsec (14.991 s) : 14991000, 14991000
. : milestone, 14991000,
iast (18.149 s) : 18149000, 18149000
. : milestone, 18149000,
iast_GLOBAL (17.986 s) : 17986000, 17986000
. : milestone, 17986000,
profiling (14.851 s) : 14851000, 14851000
. : milestone, 14851000,
tracing (14.926 s) : 14926000, 14926000
. : milestone, 14926000,
section candidate
no_agent (15.503 s) : 15503000, 15503000
. : milestone, 15503000,
appsec (14.434 s) : 14434000, 14434000
. : milestone, 14434000,
iast (18.336 s) : 18336000, 18336000
. : milestone, 18336000,
iast_GLOBAL (17.883 s) : 17883000, 17883000
. : milestone, 17883000,
profiling (14.949 s) : 14949000, 14949000
. : milestone, 14949000,
tracing (15.098 s) : 15098000, 15098000
. : milestone, 15098000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.463 s [15.463 s, 15.463 s]	-
appsec	14.991 s [14.991 s, 14.991 s]	-472.0 ms (-3.1%)
iast	18.149 s [18.149 s, 18.149 s]	2.686 s (17.4%)
iast_GLOBAL	17.986 s [17.986 s, 17.986 s]	2.523 s (16.3%)
profiling	14.851 s [14.851 s, 14.851 s]	-612.0 ms (-4.0%)
tracing	14.926 s [14.926 s, 14.926 s]	-537.0 ms (-3.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.503 s [15.503 s, 15.503 s]	-
appsec	14.434 s [14.434 s, 14.434 s]	-1.069 s (-6.9%)
iast	18.336 s [18.336 s, 18.336 s]	2.833 s (18.3%)
iast_GLOBAL	17.883 s [17.883 s, 17.883 s]	2.38 s (15.4%)
profiling	14.949 s [14.949 s, 14.949 s]	-554.0 ms (-3.6%)
tracing	15.098 s [15.098 s, 15.098 s]	-405.0 ms (-2.6%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.62.0-SNAPSHOT~5e0f9d55f9, baseline=1.62.0-SNAPSHOT~eb30f2bb1ee
dateFormat X
axisFormat %s
section baseline
no_agent (1.486 ms) : 1475, 1498
. : milestone, 1486,
appsec (3.759 ms) : 3542, 3977
. : milestone, 3759,
iast (2.277 ms) : 2207, 2346
. : milestone, 2277,
iast_GLOBAL (2.322 ms) : 2252, 2392
. : milestone, 2322,
profiling (2.103 ms) : 2048, 2158
. : milestone, 2103,
tracing (2.093 ms) : 2040, 2147
. : milestone, 2093,
section candidate
no_agent (1.488 ms) : 1477, 1500
. : milestone, 1488,
appsec (3.843 ms) : 3622, 4065
. : milestone, 3843,
iast (2.273 ms) : 2203, 2343
. : milestone, 2273,
iast_GLOBAL (2.312 ms) : 2242, 2382
. : milestone, 2312,
profiling (2.107 ms) : 2052, 2162
. : milestone, 2107,
tracing (2.078 ms) : 2024, 2131
. : milestone, 2078,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.486 ms [1.475 ms, 1.498 ms]	-
appsec	3.759 ms [3.542 ms, 3.977 ms]	2.273 ms (152.9%)
iast	2.277 ms [2.207 ms, 2.346 ms]	790.204 µs (53.2%)
iast_GLOBAL	2.322 ms [2.252 ms, 2.392 ms]	835.28 µs (56.2%)
profiling	2.103 ms [2.048 ms, 2.158 ms]	616.638 µs (41.5%)
tracing	2.093 ms [2.04 ms, 2.147 ms]	606.889 µs (40.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.488 ms [1.477 ms, 1.5 ms]	-
appsec	3.843 ms [3.622 ms, 4.065 ms]	2.355 ms (158.3%)
iast	2.273 ms [2.203 ms, 2.343 ms]	784.985 µs (52.7%)
iast_GLOBAL	2.312 ms [2.242 ms, 2.382 ms]	823.529 µs (55.3%)
profiling	2.107 ms [2.052 ms, 2.162 ms]	618.865 µs (41.6%)
tracing	2.078 ms [2.024 ms, 2.131 ms]	589.653 µs (39.6%)

So child classes can benefits from class level configs and we can configure the tracer for example

…tension Move DD_* environment variable and dd.* system property validation logic from DDJavaSpecification into a reusable CleanConfigStateExtension. Improves error reporting with detailed leak information.

Fix tracer initialization from per method to per class to match Spock setupSpec() / cleanUpSpec()

PerfectSlayer · 2026-04-21T09:26:46Z

/merge

gh-worker-devflow-routing-ef8351 · 2026-04-21T09:26:50Z

View all feedbacks in Devflow UI.

2026-04-21 09:26:49 UTC ℹ️ Start processing command /merge

2026-04-21 09:26:54 UTC ℹ️ MergeQueue: pull request added to the queue

The expected merge time in master is approximately 2h (p90).

2026-04-21 10:44:44 UTC ℹ️ MergeQueue: This merge request was merged

PerfectSlayer requested review from a team and ygree April 13, 2026 13:47

PerfectSlayer added type: bug fix Bug fix comp: testing Testing tag: performance Performance related changes tag: ai generated Largely based on code generated by an AI or LLM labels Apr 13, 2026

PerfectSlayer mentioned this pull request Apr 13, 2026
Improve Config JUnit extension #11094
Merged

PerfectSlayer changed the title ~~fix(junit): Setup tracer per class only~~Fix test tracer setup per class onlyApr 13, 2026

PerfectSlayer changed the title ~~Fix test tracer setup per class only~~Improve instrumentation JUnit testing Apr 13, 2026

This was referenced Apr 13, 2026
Add unit and instrumentation test documentation for JUnit #11097
Merged
Migrate OpenTelemetry instrumentation tests to JUnit #11081
Merged

bric3 approved these changes Apr 15, 2026
View reviewed changes

PerfectSlayer added 3 commits April 17, 2026 09:24

feat(junit): Fix @WithConfig to be applied at any level
e749671

fix(junit): Only rebuild config once
8f6e54b

fix(junit): Apply class level configuration at@beforeeachlevel
b37c48c
So child classes can benefits from class level configs and we can configure the tracer for example

PerfectSlayer force-pushed the bbujon/groovy-to-java-config branch from 8d727de to cd97498Compare April 17, 2026 07:27

PerfectSlayer added 6 commits April 17, 2026 13:25

feat(test): Extract config cleanup assertions into dedicated JUnit ex…
7536862
…tension Move DD_* environment variable and dd.* system property validation logic from DDJavaSpecification into a reusable CleanConfigStateExtension. Improves error reporting with detailed leak information.

feat(junit): Improve generated code readability
af45d6c

fix(junit): Setup tracer per class only
20c8e7b
Fix tracer initialization from per method to per class to match Spock setupSpec() / cleanUpSpec()

feat(testing): Improve error messages
6e1b214

fix(testing): Fix span links assertion
9d49c2a

feat(testing): Refine default tags
9d9228c

PerfectSlayer force-pushed the bbujon/groovy-to-java-config branch from cd97498 to af45d6cCompare April 17, 2026 11:26

PerfectSlayer force-pushed the bbujon/groovy-to-java-instrumented-tests branch from 1d931de to 9d9228cCompare April 17, 2026 12:23

Base automatically changed from bbujon/groovy-to-java-config to masterApril 17, 2026 13:31

PerfectSlayer enabled auto-merge April 20, 2026 17:12

PerfectSlayer disabled auto-merge April 21, 2026 09:26

gh-worker-dd-mergequeue-cf854dBot merged commit 534f75e into masterApr 21, 2026
750 of 752 checks passed

gh-worker-dd-mergequeue-cf854dBot deleted the bbujon/groovy-to-java-instrumented-tests branch April 21, 2026 10:44

github-actionsBot added this to the 1.62.0 milestone Apr 21, 2026

PerfectSlayer mentioned this pull request Apr 27, 2026
Improve trace assert API #11209
Merged

Navigation Menu

Uh oh!

Improve instrumentation JUnit testing - #11096

Improve instrumentation JUnit testing #11096
gh-worker-dd-mergequeue-cf854d[bot] merged 9 commits into
masterfrom
bbujon/groovy-to-java-instrumented-tests

PerfectSlayer commented Apr 13, 2026•
edited by atlassian Bot
Loading

Uh oh!

pr-commenterBot commented Apr 13, 2026•
edited
Loading

Uh oh!

PerfectSlayer commented Apr 21, 2026

Uh oh!

gh-worker-devflow-routing-ef8351Bot commented Apr 21, 2026•
edited
Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

PerfectSlayer commented Apr 13, 2026• edited by atlassian BotLoading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Apr 13, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer commented Apr 21, 2026

Uh oh!

gh-worker-devflow-routing-ef8351Bot commented Apr 21, 2026• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

PerfectSlayer commented Apr 13, 2026•
edited by atlassian Bot
Loading

pr-commenterBot commented Apr 13, 2026•
edited
Loading

gh-worker-devflow-routing-ef8351Bot commented Apr 21, 2026•
edited
Loading