🍒 8865 - Add support for JUnit 5.13-RC1 by nikita-tkachenko-datadog · Pull Request #8928 · DataDog/dd-trace-java

nikita-tkachenko-datadog · 2025-06-05T11:32:41Z

Backport #8865 to release/v1.49.x

(cherry picked from commit a08d100)

pr-commenter · 2025-06-05T12:24:14Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita.tkachenko/backport-pr-8865
git_commit_date	1749044153	1749123155
git_commit_sha	`7787af7`	`fdacac3`
release_version	1.50.0-SNAPSHOT~7787af738f	1.50.0-SNAPSHOT~fdacac3b73

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1749126096	1749126096
ci_job_id	969609406	969609406
ci_pipeline_id	67045317	67045317
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-o6ycphvs-project-304-concurrent-0-lbhbb70m 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-o6ycphvs-project-304-concurrent-0-lbhbb70m 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 56 metrics, 11 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent	better [-8.723ms; -4.087ms] or [-8.381%; -3.927%]	97.675ms	104.080ms
scenario:startup:petclinic:profiling:GlobalTracer	worse [+10.442ms; +20.749ms] or [+2.861%; +5.685%]	380.573ms	364.978ms
scenario:startup:petclinic:profiling:AppSec	better [-9.410ms; -7.435ms] or [-15.153%; -11.973%]	53.673ms	62.095ms
scenario:startup:petclinic:profiling:Profiling	better [-8.723ms; -4.087ms] or [-8.379%; -3.926%]	97.699ms	104.104ms

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.024 s) : 0, 1024177
Total [baseline] (11.095 s) : 0, 11094727
Agent [candidate] (1.005 s) : 0, 1004836
Total [candidate] (11.111 s) : 0, 11111242
section appsec
Agent [baseline] (1.165 s) : 0, 1165010
Total [baseline] (11.21 s) : 0, 11209702
Agent [candidate] (1.153 s) : 0, 1153455
Total [candidate] (11.207 s) : 0, 11207003
section iast
Agent [baseline] (1.152 s) : 0, 1152214
Total [baseline] (11.451 s) : 0, 11451476
Agent [candidate] (1.148 s) : 0, 1147693
Total [candidate] (11.314 s) : 0, 11314236
section profiling
Agent [baseline] (1.283 s) : 0, 1282969
Total [baseline] (11.601 s) : 0, 11600743
Agent [candidate] (1.261 s) : 0, 1260820
Total [candidate] (11.387 s) : 0, 11386899

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.024 s	-
Agent	appsec	1.165 s	140.833 ms (13.8%)
Agent	iast	1.152 s	128.037 ms (12.5%)
Agent	profiling	1.283 s	258.793 ms (25.3%)
Total	tracing	11.095 s	-
Total	appsec	11.21 s	114.975 ms (1.0%)
Total	iast	11.451 s	356.749 ms (3.2%)
Total	profiling	11.601 s	506.016 ms (4.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.005 s	-
Agent	appsec	1.153 s	148.619 ms (14.8%)
Agent	iast	1.148 s	142.857 ms (14.2%)
Agent	profiling	1.261 s	255.984 ms (25.5%)
Total	tracing	11.111 s	-
Total	appsec	11.207 s	95.761 ms (0.9%)
Total	iast	11.314 s	202.994 ms (1.8%)
Total	profiling	11.387 s	275.657 ms (2.5%)

gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.693 ms) : 0, 683693
BytebuddyAgent [candidate] (669.047 ms) : 0, 669047
GlobalTracer [baseline] (240.451 ms) : 0, 240451
GlobalTracer [candidate] (239.589 ms) : 0, 239589
AppSec [baseline] (56.585 ms) : 0, 56585
AppSec [candidate] (54.992 ms) : 0, 54992
Debugger [baseline] (6.198 ms) : 0, 6198
Debugger [candidate] (6.28 ms) : 0, 6280
Remote Config [baseline] (735.284 µs) : 0, 735
Remote Config [candidate] (706.48 µs) : 0, 706
Telemetry [baseline] (12.788 ms) : 0, 12788
Telemetry [candidate] (10.743 ms) : 0, 10743
section appsec
BytebuddyAgent [baseline] (702.433 ms) : 0, 702433
BytebuddyAgent [candidate] (691.366 ms) : 0, 691366
GlobalTracer [baseline] (237.963 ms) : 0, 237963
GlobalTracer [candidate] (236.827 ms) : 0, 236827
AppSec [baseline] (176.052 ms) : 0, 176052
AppSec [candidate] (176.819 ms) : 0, 176819
Debugger [baseline] (5.974 ms) : 0, 5974
Debugger [candidate] (5.922 ms) : 0, 5922
Remote Config [baseline] (623.326 µs) : 0, 623
Remote Config [candidate] (622.026 µs) : 0, 622
Telemetry [baseline] (7.351 ms) : 0, 7351
Telemetry [candidate] (7.355 ms) : 0, 7355
IAST [baseline] (21.964 ms) : 0, 21964
IAST [candidate] (21.847 ms) : 0, 21847
section iast
BytebuddyAgent [baseline] (802.53 ms) : 0, 802530
BytebuddyAgent [candidate] (797.668 ms) : 0, 797668
GlobalTracer [baseline] (231.557 ms) : 0, 231557
GlobalTracer [candidate] (231.813 ms) : 0, 231813
AppSec [baseline] (53.158 ms) : 0, 53158
AppSec [candidate] (56.962 ms) : 0, 56962
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (5.976 ms) : 0, 5976
Remote Config [baseline] (609.354 µs) : 0, 609
Remote Config [candidate] (620.612 µs) : 0, 621
Telemetry [baseline] (7.899 ms) : 0, 7899
Telemetry [candidate] (7.99 ms) : 0, 7990
IAST [baseline] (26.904 ms) : 0, 26904
IAST [candidate] (22.928 ms) : 0, 22928
section profiling
BytebuddyAgent [baseline] (685.285 ms) : 0, 685285
BytebuddyAgent [candidate] (663.524 ms) : 0, 663524
GlobalTracer [baseline] (364.978 ms) : 0, 364978
GlobalTracer [candidate] (380.573 ms) : 0, 380573
AppSec [baseline] (62.095 ms) : 0, 62095
AppSec [candidate] (53.673 ms) : 0, 53673
Debugger [baseline] (6.136 ms) : 0, 6136
Debugger [candidate] (6.167 ms) : 0, 6167
Remote Config [baseline] (661.094 µs) : 0, 661
Remote Config [candidate] (660.164 µs) : 0, 660
Telemetry [baseline] (8.171 ms) : 0, 8171
Telemetry [candidate] (8.232 ms) : 0, 8232
ProfilingAgent [baseline] (104.08 ms) : 0, 104080
ProfilingAgent [candidate] (97.675 ms) : 0, 97675
Profiling [baseline] (104.104 ms) : 0, 104104
Profiling [candidate] (97.699 ms) : 0, 97699

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1021496
Total [baseline] (8.52 s) : 0, 8520290
Agent [candidate] (1.014 s) : 0, 1014353
Total [candidate] (8.533 s) : 0, 8532672
section iast
Agent [baseline] (1.148 s) : 0, 1148112
Total [baseline] (9.156 s) : 0, 9156396
Agent [candidate] (1.145 s) : 0, 1144927
Total [candidate] (9.237 s) : 0, 9236988
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.157 s) : 0, 1157246
Total [baseline] (9.192 s) : 0, 9191788
Agent [candidate] (1.134 s) : 0, 1133584
Total [candidate] (9.126 s) : 0, 9126356
section iast_TELEMETRY_OFF
Agent [baseline] (1.148 s) : 0, 1147527
Total [baseline] (9.249 s) : 0, 9248931
Agent [candidate] (1.15 s) : 0, 1149898
Total [candidate] (9.195 s) : 0, 9195418

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.021 s	-
Agent	iast	1.148 s	126.615 ms (12.4%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.157 s	135.749 ms (13.3%)
Agent	iast_TELEMETRY_OFF	1.148 s	126.031 ms (12.3%)
Total	tracing	8.52 s	-
Total	iast	9.156 s	636.106 ms (7.5%)
Total	iast_HARDCODED_SECRET_DISABLED	9.192 s	671.498 ms (7.9%)
Total	iast_TELEMETRY_OFF	9.249 s	728.641 ms (8.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.014 s	-
Agent	iast	1.145 s	130.574 ms (12.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.134 s	119.231 ms (11.8%)
Agent	iast_TELEMETRY_OFF	1.15 s	135.545 ms (13.4%)
Total	tracing	8.533 s	-
Total	iast	9.237 s	704.316 ms (8.3%)
Total	iast_HARDCODED_SECRET_DISABLED	9.126 s	593.684 ms (7.0%)
Total	iast_TELEMETRY_OFF	9.195 s	662.746 ms (7.8%)

gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.902 ms) : 0, 681902
BytebuddyAgent [candidate] (675.525 ms) : 0, 675525
GlobalTracer [baseline] (240.073 ms) : 0, 240073
GlobalTracer [candidate] (240.767 ms) : 0, 240767
AppSec [baseline] (55.828 ms) : 0, 55828
AppSec [candidate] (54.981 ms) : 0, 54981
Debugger [baseline] (6.228 ms) : 0, 6228
Debugger [candidate] (6.274 ms) : 0, 6274
Remote Config [baseline] (740.938 µs) : 0, 741
Remote Config [candidate] (717.617 µs) : 0, 718
Telemetry [baseline] (13.179 ms) : 0, 13179
Telemetry [candidate] (12.423 ms) : 0, 12423
section iast
BytebuddyAgent [baseline] (800.336 ms) : 0, 800336
BytebuddyAgent [candidate] (796.188 ms) : 0, 796188
GlobalTracer [baseline] (230.373 ms) : 0, 230373
GlobalTracer [candidate] (231.326 ms) : 0, 231326
AppSec [baseline] (52.439 ms) : 0, 52439
AppSec [candidate] (56.511 ms) : 0, 56511
Debugger [baseline] (6.016 ms) : 0, 6016
Debugger [candidate] (5.943 ms) : 0, 5943
Remote Config [baseline] (585.362 µs) : 0, 585
Remote Config [candidate] (603.649 µs) : 0, 604
Telemetry [baseline] (7.896 ms) : 0, 7896
Telemetry [candidate] (7.877 ms) : 0, 7877
IAST [baseline] (26.996 ms) : 0, 26996
IAST [candidate] (22.794 ms) : 0, 22794
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (805.155 ms) : 0, 805155
BytebuddyAgent [candidate] (787.06 ms) : 0, 787060
GlobalTracer [baseline] (232.648 ms) : 0, 232648
GlobalTracer [candidate] (229.711 ms) : 0, 229711
AppSec [baseline] (54.423 ms) : 0, 54423
AppSec [candidate] (56.276 ms) : 0, 56276
Debugger [baseline] (6.117 ms) : 0, 6117
Debugger [candidate] (5.91 ms) : 0, 5910
Remote Config [baseline] (611.584 µs) : 0, 612
Remote Config [candidate] (588.66 µs) : 0, 589
Telemetry [baseline] (8.099 ms) : 0, 8099
Telemetry [candidate] (7.832 ms) : 0, 7832
IAST [baseline] (26.543 ms) : 0, 26543
IAST [candidate] (22.798 ms) : 0, 22798
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (799.114 ms) : 0, 799114
BytebuddyAgent [candidate] (799.883 ms) : 0, 799883
GlobalTracer [baseline] (230.757 ms) : 0, 230757
GlobalTracer [candidate] (231.823 ms) : 0, 231823
AppSec [baseline] (52.084 ms) : 0, 52084
AppSec [candidate] (57.304 ms) : 0, 57304
Debugger [baseline] (6.025 ms) : 0, 6025
Debugger [candidate] (6.006 ms) : 0, 6006
Remote Config [baseline] (601.952 µs) : 0, 602
Remote Config [candidate] (604.936 µs) : 0, 605
Telemetry [baseline] (7.876 ms) : 0, 7876
Telemetry [candidate] (7.828 ms) : 0, 7828
IAST [baseline] (27.521 ms) : 0, 27521
IAST [candidate] (22.656 ms) : 0, 22656

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-06-05T11:51:47	2025-06-05T11:59:22
git_branch	master	nikita.tkachenko/backport-pr-8865
git_commit_date	1749044153	1749123155
git_commit_sha	`7787af7`	`fdacac3`
release_version	1.50.0-SNAPSHOT~7787af738f	1.50.0-SNAPSHOT~fdacac3b73
start_time	2025-06-05T11:51:27	2025-06-05T11:59:02

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1749125455	1749125455
ci_job_id	969609407	969609407
ci_pipeline_id	67045317	67045317
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-i3wcqa5q-project-304-concurrent-0-9mpetp5c 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-i3wcqa5q-project-304-concurrent-0-9mpetp5c 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
thresholds_or_results	results	results
variant	iast_FULL	iast_FULL

Summary

Found 6 performance improvements and 2 performance regressions! Performance is the same for 3 metrics, 11 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:appsec	better [-51.566ms; -50.355ms] or [-87.005%; -84.961%]	unstable [+502.967op/s; +524.339op/s] or [+603.355%; +628.993%]	8.308ms	597.015op/s	59.268ms	83.362op/s
scenario:load:petclinic:appsec_no_iast	better [-57.194ms; -55.807ms] or [-84.334%; -82.288%]	unstable [+342.780op/s; +385.439op/s] or [+471.535%; +530.218%]	11.318ms	436.804op/s	67.819ms	72.694op/s
scenario:load:petclinic:code_origins	better [-38.739ms; -36.141ms] or [-47.118%; -43.958%]	unstable [+23.289op/s; +61.854op/s] or [+41.694%; +110.735%]	44.778ms	98.429op/s	82.218ms	55.857op/s
scenario:load:petclinic:iast	better [-39.588ms; -37.784ms] or [-52.316%; -49.931%]	unstable [+47.430op/s; +77.690op/s] or [+73.833%; +120.937%]	36.985ms	126.800op/s	75.671ms	64.240op/s
scenario:load:petclinic:no_agent	worse [+804.963µs; +854.116µs] or [+10.296%; +10.925%]	worse [-77.461op/s; -49.523op/s] or [-12.200%; -7.800%]	8.647ms	571.429op/s	7.818ms	634.921op/s
scenario:load:petclinic:profiling	better [-50.044ms; -48.943ms] or [-101.067%; -98.844%]	unstable [+14487.851op/s; +25314.522op/s] or [+14661.804%; +25618.470%]	0.022ms	20000.000op/s	49.516ms	98.814op/s
scenario:load:petclinic:tracing	better [-3.829ms; -3.652ms] or [-30.982%; -29.548%]	unstable [+137.655op/s; +202.857op/s] or [+34.313%; +50.566%]	8.619ms	571.429op/s	12.360ms	401.173op/s

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (7.818 ms) : 7795, 7841
. : milestone, 7818,
appsec (59.268 ms) : 58473, 60064
. : milestone, 59268,
appsec_no_iast (67.819 ms) : 66909, 68728
. : milestone, 67819,
code_origins (82.218 ms) : 80563, 83873
. : milestone, 82218,
iast (75.671 ms) : 74546, 76796
. : milestone, 75671,
profiling (49.516 ms) : 48793, 50239
. : milestone, 49516,
tracing (12.36 ms) : 12246, 12473
. : milestone, 12360,
section candidate
no_agent (8.647 ms) : 8625, 8670
. : milestone, 8647,
appsec (8.308 ms) : 8282, 8333
. : milestone, 8308,
appsec_no_iast (11.318 ms) : 11255, 11381
. : milestone, 11318,
code_origins (44.778 ms) : 44358, 45197
. : milestone, 44778,
iast (36.985 ms) : 36611, 37360
. : milestone, 36985,
profiling (22.074 µs) : 16, 28
. : milestone, 22,
tracing (8.619 ms) : 8591, 8647
. : milestone, 8619,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	7.818 ms [7.795 ms, 7.841 ms]	-
appsec	59.268 ms [58.473 ms, 60.064 ms]	51.45 ms (658.1%)
appsec_no_iast	67.819 ms [66.909 ms, 68.728 ms]	60.001 ms (767.5%)
code_origins	82.218 ms [80.563 ms, 83.873 ms]	74.4 ms (951.7%)
iast	75.671 ms [74.546 ms, 76.796 ms]	67.853 ms (867.9%)
profiling	49.516 ms [48.793 ms, 50.239 ms]	41.698 ms (533.4%)
tracing	12.36 ms [12.246 ms, 12.473 ms]	4.542 ms (58.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	8.647 ms [8.625 ms, 8.67 ms]	-
appsec	8.308 ms [8.282 ms, 8.333 ms]	-339.857 µs (-3.9%)
appsec_no_iast	11.318 ms [11.255 ms, 11.381 ms]	2.671 ms (30.9%)
code_origins	44.778 ms [44.358 ms, 45.197 ms]	36.13 ms (417.8%)
iast	36.985 ms [36.611 ms, 37.36 ms]	28.338 ms (327.7%)
profiling	22.074 µs [15.922 µs, 28.225 µs]	-8.625 ms (-99.7%)
tracing	8.619 ms [8.591 ms, 8.647 ms]	-28.494 µs (-0.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita.tkachenko/backport-pr-8865
git_commit_date	1749044153	1749123155
git_commit_sha	`7787af7`	`fdacac3`
release_version	1.50.0-SNAPSHOT~7787af738f	1.50.0-SNAPSHOT~fdacac3b73

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1749125600	1749125600
ci_job_id	969609408	969609408
ci_pipeline_id	67045317	67045317
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-o6ycphvs-project-304-concurrent-1-63ky8vi8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-o6ycphvs-project-304-concurrent-1-63ky8vi8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (15.34 s) : 15340000, 15340000
. : milestone, 15340000,
appsec (14.976 s) : 14976000, 14976000
. : milestone, 14976000,
iast (19.117 s) : 19117000, 19117000
. : milestone, 19117000,
iast_GLOBAL (18.206 s) : 18206000, 18206000
. : milestone, 18206000,
profiling (15.164 s) : 15164000, 15164000
. : milestone, 15164000,
tracing (14.877 s) : 14877000, 14877000
. : milestone, 14877000,
section candidate
no_agent (15.205 s) : 15205000, 15205000
. : milestone, 15205000,
appsec (14.831 s) : 14831000, 14831000
. : milestone, 14831000,
iast (18.316 s) : 18316000, 18316000
. : milestone, 18316000,
iast_GLOBAL (17.789 s) : 17789000, 17789000
. : milestone, 17789000,
profiling (15.244 s) : 15244000, 15244000
. : milestone, 15244000,
tracing (14.915 s) : 14915000, 14915000
. : milestone, 14915000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.34 s [15.34 s, 15.34 s]	-
appsec	14.976 s [14.976 s, 14.976 s]	-364.0 ms (-2.4%)
iast	19.117 s [19.117 s, 19.117 s]	3.777 s (24.6%)
iast_GLOBAL	18.206 s [18.206 s, 18.206 s]	2.866 s (18.7%)
profiling	15.164 s [15.164 s, 15.164 s]	-176.0 ms (-1.1%)
tracing	14.877 s [14.877 s, 14.877 s]	-463.0 ms (-3.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.205 s [15.205 s, 15.205 s]	-
appsec	14.831 s [14.831 s, 14.831 s]	-374.0 ms (-2.5%)
iast	18.316 s [18.316 s, 18.316 s]	3.111 s (20.5%)
iast_GLOBAL	17.789 s [17.789 s, 17.789 s]	2.584 s (17.0%)
profiling	15.244 s [15.244 s, 15.244 s]	39.0 ms (0.3%)
tracing	14.915 s [14.915 s, 14.915 s]	-290.0 ms (-1.9%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~fdacac3b73, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (1.474 ms) : 1462, 1486
. : milestone, 1474,
appsec (2.401 ms) : 2352, 2449
. : milestone, 2401,
iast (2.185 ms) : 2124, 2246
. : milestone, 2185,
iast_GLOBAL (2.226 ms) : 2164, 2287
. : milestone, 2226,
profiling (2.474 ms) : 2250, 2698
. : milestone, 2474,
tracing (2.008 ms) : 1960, 2055
. : milestone, 2008,
section candidate
no_agent (1.474 ms) : 1462, 1485
. : milestone, 1474,
appsec (2.4 ms) : 2351, 2448
. : milestone, 2400,
iast (2.17 ms) : 2109, 2231
. : milestone, 2170,
iast_GLOBAL (2.225 ms) : 2163, 2287
. : milestone, 2225,
profiling (2.026 ms) : 1977, 2075
. : milestone, 2026,
tracing (2.001 ms) : 1954, 2049
. : milestone, 2001,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.486 ms]	-
appsec	2.401 ms [2.352 ms, 2.449 ms]	926.731 µs (62.9%)
iast	2.185 ms [2.124 ms, 2.246 ms]	711.05 µs (48.2%)
iast_GLOBAL	2.226 ms [2.164 ms, 2.287 ms]	751.548 µs (51.0%)
profiling	2.474 ms [2.25 ms, 2.698 ms]	1.0 ms (67.9%)
tracing	2.008 ms [1.96 ms, 2.055 ms]	533.647 µs (36.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	2.4 ms [2.351 ms, 2.448 ms]	926.127 µs (62.8%)
iast	2.17 ms [2.109 ms, 2.231 ms]	696.543 µs (47.3%)
iast_GLOBAL	2.225 ms [2.163 ms, 2.287 ms]	751.194 µs (51.0%)
profiling	2.026 ms [1.977 ms, 2.075 ms]	552.794 µs (37.5%)
tracing	2.001 ms [1.954 ms, 2.049 ms]	527.808 µs (35.8%)

fix junit5 instrumentation after 5.13-RC
fdacac3
(cherry picked from commit a08d100)

nikita-tkachenko-datadog requested a review from a team as a code owner June 5, 2025 11:32

nikita-tkachenko-datadog requested a review from daniel-mohedano June 5, 2025 11:32

nikita-tkachenko-datadog added type: feature Enhancements and improvements comp: ci visibility Continuous Integration Visibility labels Jun 5, 2025

nikita-tkachenko-datadog added this to the 1.49.1 milestone Jun 5, 2025

daniel-mohedano approved these changes Jun 5, 2025
View reviewed changes

nikita-tkachenko-datadog enabled auto-merge (squash) June 5, 2025 11:47

nikita-tkachenko-datadog disabled auto-merge June 5, 2025 11:47

nikita-tkachenko-datadog enabled auto-merge (squash) June 5, 2025 11:47

nikita-tkachenko-datadog closed this Jun 5, 2025

auto-merge was automatically disabled June 5, 2025 13:49
Pull request was closed

Navigation Menu

Uh oh!

🍒 8865 - Add support for JUnit 5.13-RC1 - #8928

🍒 8865 - Add support for JUnit 5.13-RC1#8928
nikita-tkachenko-datadog wants to merge 1 commit into
release/v1.49.xfrom
nikita.tkachenko/backport-pr-8865

nikita-tkachenko-datadog commented Jun 5, 2025

Uh oh!

pr-commenterBot commented Jun 5, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

nikita-tkachenko-datadog commented Jun 5, 2025

Uh oh!

pr-commenterBot commented Jun 5, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants