chore: remove jmh from projects that don't have any benchmarks by bric3 · Pull Request #8854 · DataDog/dd-trace-java

bric3 · 2025-05-20T12:58:35Z

What Does This Do

Remove jmh gradle plugin when the project actually has no benchmarks

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

sarahchen6

🙌

…brary plugin is applied

mcculls · 2025-05-20T13:35:30Z

@@ -1,13 +1,9 @@
 plugins {
-id("me.champeau.jmh")
+`java-library`


isn't this added by applying $rootDir/gradle/java.gradle below?

Good question. It is, but in kotlin DSL scripts, the apply(from = ) style doesn't give access to generated configuration type-safe accessors like implementation used in this project. Only the plugins block triggers this.
Access to implementation in particular is available only with the java-library plugin or if another plugin depends on it like me.champeau.jmh.
In general Gradle doesn't recommend the apply(from = ) style at all anymore (for various reasons), instead they recommend using convention plugins. Those would inherit any applied plugins.

pr-commenter · 2025-05-20T13:47:41Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	remove-jmh-if-no-benchmarks
git_commit_date	1747743756	1747746440
git_commit_sha	`0ebd52b`	`861e629`
release_version	1.50.0-SNAPSHOT~0ebd52ba72	1.50.0-SNAPSHOT~861e629d36

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747748813	1747748813
ci_job_id	945838326	945838326
ci_pipeline_id	65605981	65605981
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-qba76gvb-project-304-concurrent-0-09eoglrq 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-qba76gvb-project-304-concurrent-0-09eoglrq 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.015 s) : 0, 1015439
Total [baseline] (8.652 s) : 0, 8652490
Agent [candidate] (1.024 s) : 0, 1024357
Total [candidate] (8.674 s) : 0, 8674002
section iast
Agent [baseline] (1.144 s) : 0, 1144279
Total [baseline] (9.23 s) : 0, 9229875
Agent [candidate] (1.156 s) : 0, 1156366
Total [candidate] (9.269 s) : 0, 9269095
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.149 s) : 0, 1148968
Total [baseline] (9.218 s) : 0, 9217589
Agent [candidate] (1.151 s) : 0, 1150905
Total [candidate] (9.201 s) : 0, 9200826
section iast_TELEMETRY_OFF
Agent [baseline] (1.146 s) : 0, 1145731
Total [baseline] (9.247 s) : 0, 9247049
Agent [candidate] (1.145 s) : 0, 1145227
Total [candidate] (9.28 s) : 0, 9279580

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.015 s	-
Agent	iast	1.144 s	128.84 ms (12.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.149 s	133.529 ms (13.1%)
Agent	iast_TELEMETRY_OFF	1.146 s	130.292 ms (12.8%)
Total	tracing	8.652 s	-
Total	iast	9.23 s	577.385 ms (6.7%)
Total	iast_HARDCODED_SECRET_DISABLED	9.218 s	565.099 ms (6.5%)
Total	iast_TELEMETRY_OFF	9.247 s	594.559 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.024 s	-
Agent	iast	1.156 s	132.009 ms (12.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.151 s	126.548 ms (12.4%)
Agent	iast_TELEMETRY_OFF	1.145 s	120.87 ms (11.8%)
Total	tracing	8.674 s	-
Total	iast	9.269 s	595.093 ms (6.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.201 s	526.824 ms (6.1%)
Total	iast_TELEMETRY_OFF	9.28 s	605.578 ms (7.0%)

gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (680.399 ms) : 0, 680399
BytebuddyAgent [candidate] (684.572 ms) : 0, 684572
GlobalTracer [baseline] (239.307 ms) : 0, 239307
GlobalTracer [candidate] (241.18 ms) : 0, 241180
AppSec [baseline] (54.174 ms) : 0, 54174
AppSec [candidate] (54.597 ms) : 0, 54597
Debugger [baseline] (8.298 ms) : 0, 8298
Debugger [candidate] (8.413 ms) : 0, 8413
Remote Config [baseline] (703.856 µs) : 0, 704
Remote Config [candidate] (708.034 µs) : 0, 708
Telemetry [baseline] (9.011 ms) : 0, 9011
Telemetry [candidate] (11.291 ms) : 0, 11291
section iast
BytebuddyAgent [baseline] (798.472 ms) : 0, 798472
BytebuddyAgent [candidate] (807.03 ms) : 0, 807030
GlobalTracer [baseline] (229.902 ms) : 0, 229902
GlobalTracer [candidate] (231.801 ms) : 0, 231801
IAST [baseline] (28.938 ms) : 0, 28938
IAST [candidate] (29.493 ms) : 0, 29493
AppSec [baseline] (49.276 ms) : 0, 49276
AppSec [candidate] (49.826 ms) : 0, 49826
Debugger [baseline] (5.854 ms) : 0, 5854
Debugger [candidate] (5.981 ms) : 0, 5981
Remote Config [baseline] (592.741 µs) : 0, 593
Remote Config [candidate] (595.523 µs) : 0, 596
Telemetry [baseline] (7.832 ms) : 0, 7832
Telemetry [candidate] (7.92 ms) : 0, 7920
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (801.986 ms) : 0, 801986
BytebuddyAgent [candidate] (801.923 ms) : 0, 801923
GlobalTracer [baseline] (230.367 ms) : 0, 230367
GlobalTracer [candidate] (231.94 ms) : 0, 231940
IAST [baseline] (28.3 ms) : 0, 28300
IAST [candidate] (27.044 ms) : 0, 27044
AppSec [baseline] (50.509 ms) : 0, 50509
AppSec [candidate] (51.92 ms) : 0, 51920
Debugger [baseline] (5.876 ms) : 0, 5876
Debugger [candidate] (5.931 ms) : 0, 5931
Remote Config [baseline] (585.205 µs) : 0, 585
Remote Config [candidate] (596.0 µs) : 0, 596
Telemetry [baseline] (7.88 ms) : 0, 7880
Telemetry [candidate] (7.937 ms) : 0, 7937
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (798.305 ms) : 0, 798305
BytebuddyAgent [candidate] (798.627 ms) : 0, 798627
GlobalTracer [baseline] (230.637 ms) : 0, 230637
GlobalTracer [candidate] (230.254 ms) : 0, 230254
IAST [baseline] (22.296 ms) : 0, 22296
IAST [candidate] (23.088 ms) : 0, 23088
AppSec [baseline] (56.276 ms) : 0, 56276
AppSec [candidate] (55.403 ms) : 0, 55403
Debugger [baseline] (6.065 ms) : 0, 6065
Debugger [candidate] (5.985 ms) : 0, 5985
Remote Config [baseline] (620.656 µs) : 0, 621
Remote Config [candidate] (595.563 µs) : 0, 596
Telemetry [baseline] (7.964 ms) : 0, 7964
Telemetry [candidate] (7.787 ms) : 0, 7787

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019417
Total [baseline] (10.506 s) : 0, 10506174
Agent [candidate] (1.022 s) : 0, 1021991
Total [candidate] (10.508 s) : 0, 10508244
section appsec
Agent [baseline] (1.161 s) : 0, 1161167
Total [baseline] (10.699 s) : 0, 10699418
Agent [candidate] (1.164 s) : 0, 1163709
Total [candidate] (10.745 s) : 0, 10745166
section iast
Agent [baseline] (1.158 s) : 0, 1157603
Total [baseline] (10.872 s) : 0, 10871706
Agent [candidate] (1.15 s) : 0, 1150272
Total [candidate] (10.945 s) : 0, 10945201
section profiling
Agent [baseline] (1.286 s) : 0, 1285547
Total [baseline] (10.91 s) : 0, 10909975
Agent [candidate] (1.277 s) : 0, 1276704
Total [candidate] (10.827 s) : 0, 10827325

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.019 s	-
Agent	appsec	1.161 s	141.75 ms (13.9%)
Agent	iast	1.158 s	138.186 ms (13.6%)
Agent	profiling	1.286 s	266.13 ms (26.1%)
Total	tracing	10.506 s	-
Total	appsec	10.699 s	193.243 ms (1.8%)
Total	iast	10.872 s	365.531 ms (3.5%)
Total	profiling	10.91 s	403.801 ms (3.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.022 s	-
Agent	appsec	1.164 s	141.719 ms (13.9%)
Agent	iast	1.15 s	128.282 ms (12.6%)
Agent	profiling	1.277 s	254.713 ms (24.9%)
Total	tracing	10.508 s	-
Total	appsec	10.745 s	236.922 ms (2.3%)
Total	iast	10.945 s	436.957 ms (4.2%)
Total	profiling	10.827 s	319.081 ms (3.0%)

gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.465 ms) : 0, 682465
BytebuddyAgent [candidate] (684.072 ms) : 0, 684072
GlobalTracer [baseline] (239.697 ms) : 0, 239697
GlobalTracer [candidate] (240.982 ms) : 0, 240982
AppSec [baseline] (54.866 ms) : 0, 54866
AppSec [candidate] (54.586 ms) : 0, 54586
Debugger [baseline] (8.241 ms) : 0, 8241
Debugger [candidate] (7.569 ms) : 0, 7569
Remote Config [baseline] (683.586 µs) : 0, 684
Remote Config [candidate] (704.578 µs) : 0, 705
Telemetry [baseline] (9.9 ms) : 0, 9900
Telemetry [candidate] (10.524 ms) : 0, 10524
section appsec
BytebuddyAgent [baseline] (700.313 ms) : 0, 700313
BytebuddyAgent [candidate] (702.321 ms) : 0, 702321
GlobalTracer [baseline] (236.342 ms) : 0, 236342
GlobalTracer [candidate] (236.798 ms) : 0, 236798
AppSec [baseline] (175.684 ms) : 0, 175684
AppSec [candidate] (175.757 ms) : 0, 175757
Debugger [baseline] (5.964 ms) : 0, 5964
Debugger [candidate] (5.929 ms) : 0, 5929
Remote Config [baseline] (628.342 µs) : 0, 628
Remote Config [candidate] (629.742 µs) : 0, 630
Telemetry [baseline] (7.836 ms) : 0, 7836
Telemetry [candidate] (7.794 ms) : 0, 7794
IAST [baseline] (21.576 ms) : 0, 21576
IAST [candidate] (21.684 ms) : 0, 21684
section iast
BytebuddyAgent [baseline] (808.297 ms) : 0, 808297
BytebuddyAgent [candidate] (802.127 ms) : 0, 802127
GlobalTracer [baseline] (231.812 ms) : 0, 231812
GlobalTracer [candidate] (231.588 ms) : 0, 231588
AppSec [baseline] (50.737 ms) : 0, 50737
AppSec [candidate] (50.461 ms) : 0, 50461
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (5.909 ms) : 0, 5909
Remote Config [baseline] (606.246 µs) : 0, 606
Remote Config [candidate] (596.147 µs) : 0, 596
Telemetry [baseline] (7.999 ms) : 0, 7999
Telemetry [candidate] (7.877 ms) : 0, 7877
IAST [baseline] (27.728 ms) : 0, 27728
IAST [candidate] (27.486 ms) : 0, 27486
section profiling
BytebuddyAgent [baseline] (677.626 ms) : 0, 677626
BytebuddyAgent [candidate] (671.993 ms) : 0, 671993
GlobalTracer [baseline] (376.014 ms) : 0, 376014
GlobalTracer [candidate] (374.432 ms) : 0, 374432
AppSec [baseline] (62.159 ms) : 0, 62159
AppSec [candidate] (61.678 ms) : 0, 61678
Debugger [baseline] (6.276 ms) : 0, 6276
Debugger [candidate] (6.272 ms) : 0, 6272
Remote Config [baseline] (661.593 µs) : 0, 662
Remote Config [candidate] (655.948 µs) : 0, 656
Telemetry [baseline] (8.231 ms) : 0, 8231
Telemetry [candidate] (8.058 ms) : 0, 8058
ProfilingAgent [baseline] (103.561 ms) : 0, 103561
ProfilingAgent [candidate] (102.82 ms) : 0, 102820
Profiling [baseline] (103.586 ms) : 0, 103586
Profiling [candidate] (102.844 ms) : 0, 102844

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-05-20T13:17:10	2025-05-20T13:24:53
git_branch	master	remove-jmh-if-no-benchmarks
git_commit_date	1747743756	1747746440
git_commit_sha	`0ebd52b`	`861e629`
release_version	1.50.0-SNAPSHOT~0ebd52ba72	1.50.0-SNAPSHOT~861e629d36
start_time	2025-05-20T13:16:56	2025-05-20T13:24:39

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1747747890	1747747890
ci_job_id	945838329	945838329
ci_pipeline_id	65605981	65605981
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-uus1uqpw-project-304-concurrent-0-pi8jtac4 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-uus1uqpw-project-304-concurrent-0-pi8jtac4 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1377
. : milestone, 1358,
appsec (1.737 ms) : 1714, 1761
. : milestone, 1737,
appsec_no_iast (1.733 ms) : 1709, 1756
. : milestone, 1733,
code_origins (1.664 ms) : 1636, 1691
. : milestone, 1664,
iast (1.517 ms) : 1493, 1541
. : milestone, 1517,
profiling (1.517 ms) : 1494, 1541
. : milestone, 1517,
tracing (1.479 ms) : 1454, 1503
. : milestone, 1479,
section candidate
no_agent (1.353 ms) : 1334, 1373
. : milestone, 1353,
appsec (1.736 ms) : 1713, 1760
. : milestone, 1736,
appsec_no_iast (1.718 ms) : 1695, 1742
. : milestone, 1718,
code_origins (1.676 ms) : 1649, 1704
. : milestone, 1676,
iast (1.501 ms) : 1477, 1525
. : milestone, 1501,
profiling (1.527 ms) : 1502, 1552
. : milestone, 1527,
tracing (1.475 ms) : 1450, 1500
. : milestone, 1475,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.358 ms [1.338 ms, 1.377 ms]	-
appsec	1.737 ms [1.714 ms, 1.761 ms]	379.724 µs (28.0%)
appsec_no_iast	1.733 ms [1.709 ms, 1.756 ms]	375.011 µs (27.6%)
code_origins	1.664 ms [1.636 ms, 1.691 ms]	306.066 µs (22.5%)
iast	1.517 ms [1.493 ms, 1.541 ms]	159.694 µs (11.8%)
profiling	1.517 ms [1.494 ms, 1.541 ms]	159.794 µs (11.8%)
tracing	1.479 ms [1.454 ms, 1.503 ms]	121.179 µs (8.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.353 ms [1.334 ms, 1.373 ms]	-
appsec	1.736 ms [1.713 ms, 1.76 ms]	382.862 µs (28.3%)
appsec_no_iast	1.718 ms [1.695 ms, 1.742 ms]	364.99 µs (27.0%)
code_origins	1.676 ms [1.649 ms, 1.704 ms]	323.113 µs (23.9%)
iast	1.501 ms [1.477 ms, 1.525 ms]	147.616 µs (10.9%)
profiling	1.527 ms [1.502 ms, 1.552 ms]	173.695 µs (12.8%)
tracing	1.475 ms [1.45 ms, 1.5 ms]	121.822 µs (9.0%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section baseline
no_agent (379.767 µs) : 359, 401
. : milestone, 380,
iast (510.384 µs) : 488, 532
. : milestone, 510,
iast_FULL (737.262 µs) : 715, 759
. : milestone, 737,
iast_GLOBAL (560.989 µs) : 539, 583
. : milestone, 561,
iast_HARDCODED_SECRET_DISABLED (526.811 µs) : 503, 550
. : milestone, 527,
iast_INACTIVE (464.827 µs) : 442, 488
. : milestone, 465,
iast_TELEMETRY_OFF (503.12 µs) : 480, 526
. : milestone, 503,
tracing (457.741 µs) : 435, 480
. : milestone, 458,
section candidate
no_agent (379.731 µs) : 360, 399
. : milestone, 380,
iast (520.045 µs) : 497, 543
. : milestone, 520,
iast_FULL (731.046 µs) : 709, 753
. : milestone, 731,
iast_GLOBAL (564.884 µs) : 543, 587
. : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (524.872 µs) : 502, 548
. : milestone, 525,
iast_INACTIVE (458.881 µs) : 437, 481
. : milestone, 459,
iast_TELEMETRY_OFF (512.395 µs) : 489, 535
. : milestone, 512,
tracing (458.501 µs) : 436, 481
. : milestone, 459,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.767 µs [358.691 µs, 400.844 µs]	-
iast	510.384 µs [488.477 µs, 532.29 µs]	130.616 µs (34.4%)
iast_FULL	737.262 µs [715.405 µs, 759.119 µs]	357.494 µs (94.1%)
iast_GLOBAL	560.989 µs [538.853 µs, 583.124 µs]	181.221 µs (47.7%)
iast_HARDCODED_SECRET_DISABLED	526.811 µs [503.302 µs, 550.319 µs]	147.043 µs (38.7%)
iast_INACTIVE	464.827 µs [441.941 µs, 487.714 µs]	85.06 µs (22.4%)
iast_TELEMETRY_OFF	503.12 µs [479.859 µs, 526.381 µs]	123.352 µs (32.5%)
tracing	457.741 µs [435.267 µs, 480.214 µs]	77.973 µs (20.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.731 µs [359.982 µs, 399.48 µs]	-
iast	520.045 µs [496.939 µs, 543.152 µs]	140.314 µs (37.0%)
iast_FULL	731.046 µs [709.233 µs, 752.86 µs]	351.315 µs (92.5%)
iast_GLOBAL	564.884 µs [542.533 µs, 587.234 µs]	185.153 µs (48.8%)
iast_HARDCODED_SECRET_DISABLED	524.872 µs [501.775 µs, 547.969 µs]	145.141 µs (38.2%)
iast_INACTIVE	458.881 µs [436.712 µs, 481.049 µs]	79.15 µs (20.8%)
iast_TELEMETRY_OFF	512.395 µs [489.33 µs, 535.46 µs]	132.664 µs (34.9%)
tracing	458.501 µs [436.104 µs, 480.898 µs]	78.77 µs (20.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	remove-jmh-if-no-benchmarks
git_commit_date	1747743756	1747746440
git_commit_sha	`0ebd52b`	`861e629`
release_version	1.50.0-SNAPSHOT~0ebd52ba72	1.50.0-SNAPSHOT~861e629d36

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1747748393	1747748393
ci_job_id	945838331	945838331
ci_pipeline_id	65605981	65605981
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-qba76gvb-project-304-concurrent-1-0w2ck24p 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-qba76gvb-project-304-concurrent-1-0w2ck24p 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section baseline
no_agent (15.422 s) : 15422000, 15422000
. : milestone, 15422000,
appsec (14.93 s) : 14930000, 14930000
. : milestone, 14930000,
iast (19.173 s) : 19173000, 19173000
. : milestone, 19173000,
iast_GLOBAL (18.12 s) : 18120000, 18120000
. : milestone, 18120000,
profiling (14.89 s) : 14890000, 14890000
. : milestone, 14890000,
tracing (15.072 s) : 15072000, 15072000
. : milestone, 15072000,
section candidate
no_agent (15.447 s) : 15447000, 15447000
. : milestone, 15447000,
appsec (15.055 s) : 15055000, 15055000
. : milestone, 15055000,
iast (18.553 s) : 18553000, 18553000
. : milestone, 18553000,
iast_GLOBAL (18.258 s) : 18258000, 18258000
. : milestone, 18258000,
profiling (15.085 s) : 15085000, 15085000
. : milestone, 15085000,
tracing (15.181 s) : 15181000, 15181000
. : milestone, 15181000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.422 s [15.422 s, 15.422 s]	-
appsec	14.93 s [14.93 s, 14.93 s]	-492.0 ms (-3.2%)
iast	19.173 s [19.173 s, 19.173 s]	3.751 s (24.3%)
iast_GLOBAL	18.12 s [18.12 s, 18.12 s]	2.698 s (17.5%)
profiling	14.89 s [14.89 s, 14.89 s]	-532.0 ms (-3.4%)
tracing	15.072 s [15.072 s, 15.072 s]	-350.0 ms (-2.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.447 s [15.447 s, 15.447 s]	-
appsec	15.055 s [15.055 s, 15.055 s]	-392.0 ms (-2.5%)
iast	18.553 s [18.553 s, 18.553 s]	3.106 s (20.1%)
iast_GLOBAL	18.258 s [18.258 s, 18.258 s]	2.811 s (18.2%)
profiling	15.085 s [15.085 s, 15.085 s]	-362.0 ms (-2.3%)
tracing	15.181 s [15.181 s, 15.181 s]	-266.0 ms (-1.7%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~861e629d36, baseline=1.50.0-SNAPSHOT~0ebd52ba72
dateFormat X
axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1486
. : milestone, 1475,
appsec (2.403 ms) : 2354, 2452
. : milestone, 2403,
iast (2.185 ms) : 2123, 2247
. : milestone, 2185,
iast_GLOBAL (2.228 ms) : 2166, 2291
. : milestone, 2228,
profiling (2.029 ms) : 1979, 2078
. : milestone, 2029,
tracing (2.02 ms) : 1972, 2068
. : milestone, 2020,
section candidate
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (2.405 ms) : 2356, 2454
. : milestone, 2405,
iast (2.185 ms) : 2122, 2247
. : milestone, 2185,
iast_GLOBAL (2.226 ms) : 2164, 2289
. : milestone, 2226,
profiling (2.505 ms) : 2325, 2686
. : milestone, 2505,
tracing (2.006 ms) : 1958, 2054
. : milestone, 2006,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.475 ms [1.464 ms, 1.486 ms]	-
appsec	2.403 ms [2.354 ms, 2.452 ms]	927.986 µs (62.9%)
iast	2.185 ms [2.123 ms, 2.247 ms]	710.194 µs (48.1%)
iast_GLOBAL	2.228 ms [2.166 ms, 2.291 ms]	753.166 µs (51.1%)
profiling	2.029 ms [1.979 ms, 2.078 ms]	553.656 µs (37.5%)
tracing	2.02 ms [1.972 ms, 2.068 ms]	545.096 µs (37.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.458 ms, 1.481 ms]	-
appsec	2.405 ms [2.356 ms, 2.454 ms]	935.039 µs (63.6%)
iast	2.185 ms [2.122 ms, 2.247 ms]	714.914 µs (48.6%)
iast_GLOBAL	2.226 ms [2.164 ms, 2.289 ms]	756.637 µs (51.5%)
profiling	2.505 ms [2.325 ms, 2.686 ms]	1.036 ms (70.5%)
tracing	2.006 ms [1.958 ms, 2.054 ms]	536.092 µs (36.5%)

chore: remove jmh from projects that don't have any benchmarks
986c3d6

bric3 requested a review from a team as a code owner May 20, 2025 12:58

bric3 added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 20, 2025

sarahchen6 approved these changes May 20, 2025
View reviewed changes

chore: implementation generated accessor is only available if java-li…
861e629
…brary plugin is applied

PerfectSlayer approved these changes May 20, 2025
View reviewed changes

mcculls reviewed May 20, 2025
View reviewed changes

bric3 merged commit de3871c into masterMay 20, 2025

bric3 deleted the remove-jmh-if-no-benchmarks branch May 20, 2025 14:47

github-actionsBot added this to the 1.50.0 milestone May 20, 2025

Navigation Menu

Uh oh!

chore: remove jmh from projects that don't have any benchmarks - #8854

chore: remove jmh from projects that don't have any benchmarks#8854
bric3 merged 2 commits into
masterfrom
remove-jmh-if-no-benchmarks

bric3 commented May 20, 2025

Uh oh!

sarahchen6 left a comment

Uh oh!

mccullsMay 20, 2025

Uh oh!

bric3May 20, 2025•
edited
Loading

Uh oh!

pr-commenterBot commented May 20, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

bric3 commented May 20, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

sarahchen6 left a comment

Choose a reason for hiding this comment

Uh oh!

mccullsMay 20, 2025

Choose a reason for hiding this comment

Uh oh!

bric3May 20, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

pr-commenterBot commented May 20, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

bric3May 20, 2025•
edited
Loading