Mark virtual thread tests as flaky by PerfectSlayer · Pull Request #10122 · DataDog/dd-trace-java

PerfectSlayer · 2025-12-09T14:01:36Z

What Does This Do

Disabling flaky tests.

Motivation

There is a class loading deadlock with Groovy dynamic code generation. This should not impact customers so I left the instrumentation enabled by default.

Additional Notes

Refers to #10040

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APMLP-782

pr-commenter · 2025-12-09T14:47:13Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/virtual-threads
git_commit_date	1765270216	1765288506
git_commit_sha	`ea52d2d`	`df052db`
release_version	1.57.0-SNAPSHOT~ea52d2d1fb	1.57.0-SNAPSHOT~df052db0e6

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765290624	1765290624
ci_job_id	1279530681	1279530681
ci_pipeline_id	85584037	85584037
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-gkhpc5w1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-gkhpc5w1 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 6 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config	better [-73.052µs; -13.677µs] or [-10.984%; -2.056%]	621.730µs	665.095µs

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.081 s) : 0, 1080911
Total [baseline] (10.792 s) : 0, 10791739
Agent [candidate] (1.083 s) : 0, 1082742
Total [candidate] (11.062 s) : 0, 11061785
section appsec
Agent [baseline] (1.268 s) : 0, 1267761
Total [baseline] (11.166 s) : 0, 11166305
Agent [candidate] (1.266 s) : 0, 1265528
Total [candidate] (11.095 s) : 0, 11094576
section iast
Agent [baseline] (1.232 s) : 0, 1232061
Total [baseline] (11.223 s) : 0, 11223196
Agent [candidate] (1.222 s) : 0, 1221863
Total [candidate] (11.12 s) : 0, 11120116
section profiling
Agent [baseline] (1.207 s) : 0, 1207197
Total [baseline] (11.087 s) : 0, 11086572
Agent [candidate] (1.213 s) : 0, 1212616
Total [candidate] (11.054 s) : 0, 11054431

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.081 s	-
Agent	appsec	1.268 s	186.849 ms (17.3%)
Agent	iast	1.232 s	151.15 ms (14.0%)
Agent	profiling	1.207 s	126.286 ms (11.7%)
Total	tracing	10.792 s	-
Total	appsec	11.166 s	374.565 ms (3.5%)
Total	iast	11.223 s	431.456 ms (4.0%)
Total	profiling	11.087 s	294.832 ms (2.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.083 s	-
Agent	appsec	1.266 s	182.787 ms (16.9%)
Agent	iast	1.222 s	139.122 ms (12.8%)
Agent	profiling	1.213 s	129.874 ms (12.0%)
Total	tracing	11.062 s	-
Total	appsec	11.095 s	32.791 ms (0.3%)
Total	iast	11.12 s	58.33 ms (0.5%)
Total	profiling	11.054 s	-7.354 ms (-0.1%)

gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (648.189 ms) : 0, 648189
BytebuddyAgent [candidate] (650.143 ms) : 0, 650143
GlobalTracer [baseline] (281.735 ms) : 0, 281735
GlobalTracer [candidate] (282.464 ms) : 0, 282464
AppSec [baseline] (32.291 ms) : 0, 32291
AppSec [candidate] (32.239 ms) : 0, 32239
Debugger [baseline] (68.562 ms) : 0, 68562
Debugger [candidate] (67.721 ms) : 0, 67721
Remote Config [baseline] (654.277 µs) : 0, 654
Remote Config [candidate] (626.793 µs) : 0, 627
Telemetry [baseline] (9.044 ms) : 0, 9044
Telemetry [candidate] (9.024 ms) : 0, 9024
Flare Poller [baseline] (3.751 ms) : 0, 3751
Flare Poller [candidate] (3.755 ms) : 0, 3755
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.2 ms) : 0, 1200
BytebuddyAgent [baseline] (691.017 ms) : 0, 691017
BytebuddyAgent [candidate] (689.131 ms) : 0, 689131
GlobalTracer [baseline] (259.798 ms) : 0, 259798
GlobalTracer [candidate] (260.011 ms) : 0, 260011
AppSec [baseline] (175.124 ms) : 0, 175124
AppSec [candidate] (174.019 ms) : 0, 174019
Debugger [baseline] (66.523 ms) : 0, 66523
Debugger [candidate] (67.269 ms) : 0, 67269
Remote Config [baseline] (714.678 µs) : 0, 715
Remote Config [candidate] (714.431 µs) : 0, 714
Telemetry [baseline] (9.163 ms) : 0, 9163
Telemetry [candidate] (9.147 ms) : 0, 9147
Flare Poller [baseline] (3.945 ms) : 0, 3945
Flare Poller [candidate] (3.984 ms) : 0, 3984
IAST [baseline] (24.726 ms) : 0, 24726
IAST [candidate] (24.514 ms) : 0, 24514
section iast
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (796.522 ms) : 0, 796522
BytebuddyAgent [candidate] (789.766 ms) : 0, 789766
GlobalTracer [baseline] (257.051 ms) : 0, 257051
GlobalTracer [candidate] (255.193 ms) : 0, 255193
AppSec [baseline] (34.723 ms) : 0, 34723
AppSec [candidate] (35.273 ms) : 0, 35273
Debugger [baseline] (67.182 ms) : 0, 67182
Debugger [candidate] (65.672 ms) : 0, 65672
Remote Config [baseline] (548.909 µs) : 0, 549
Remote Config [candidate] (545.864 µs) : 0, 546
Telemetry [baseline] (8.419 ms) : 0, 8419
Telemetry [candidate] (8.343 ms) : 0, 8343
Flare Poller [baseline] (3.422 ms) : 0, 3422
Flare Poller [candidate] (3.426 ms) : 0, 3426
IAST [baseline] (27.377 ms) : 0, 27377
IAST [candidate] (27.1 ms) : 0, 27100
section profiling
crashtracking [baseline] (1.211 ms) : 0, 1211
crashtracking [candidate] (1.197 ms) : 0, 1197
BytebuddyAgent [baseline] (703.575 ms) : 0, 703575
BytebuddyAgent [candidate] (706.956 ms) : 0, 706956
GlobalTracer [baseline] (221.49 ms) : 0, 221490
GlobalTracer [candidate] (222.308 ms) : 0, 222308
AppSec [baseline] (32.229 ms) : 0, 32229
AppSec [candidate] (32.495 ms) : 0, 32495
Debugger [baseline] (67.938 ms) : 0, 67938
Debugger [candidate] (68.36 ms) : 0, 68360
Remote Config [baseline] (623.218 µs) : 0, 623
Remote Config [candidate] (615.61 µs) : 0, 616
Telemetry [baseline] (8.978 ms) : 0, 8978
Telemetry [candidate] (9.059 ms) : 0, 9059
Flare Poller [baseline] (3.761 ms) : 0, 3761
Flare Poller [candidate] (3.808 ms) : 0, 3808
ProfilingAgent [baseline] (97.659 ms) : 0, 97659
ProfilingAgent [candidate] (97.847 ms) : 0, 97847
Profiling [baseline] (98.247 ms) : 0, 98247
Profiling [candidate] (98.422 ms) : 0, 98422

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090547
Total [baseline] (8.807 s) : 0, 8807091
Agent [candidate] (1.079 s) : 0, 1079119
Total [candidate] (8.784 s) : 0, 8784114
section iast
Agent [baseline] (1.222 s) : 0, 1221592
Total [baseline] (9.525 s) : 0, 9525344
Agent [candidate] (1.223 s) : 0, 1223295
Total [candidate] (9.495 s) : 0, 9495396

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.091 s	-
Agent	iast	1.222 s	131.045 ms (12.0%)
Total	tracing	8.807 s	-
Total	iast	9.525 s	718.253 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.079 s	-
Agent	iast	1.223 s	144.176 ms (13.4%)
Total	tracing	8.784 s	-
Total	iast	9.495 s	711.282 ms (8.1%)

gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.204 ms) : 0, 1204
crashtracking [candidate] (1.221 ms) : 0, 1221
BytebuddyAgent [baseline] (654.362 ms) : 0, 654362
BytebuddyAgent [candidate] (647.693 ms) : 0, 647693
GlobalTracer [baseline] (284.626 ms) : 0, 284626
GlobalTracer [candidate] (282.308 ms) : 0, 282308
AppSec [baseline] (32.834 ms) : 0, 32834
AppSec [candidate] (32.4 ms) : 0, 32400
Debugger [baseline] (68.156 ms) : 0, 68156
Debugger [candidate] (66.56 ms) : 0, 66560
Remote Config [baseline] (665.095 µs) : 0, 665
Remote Config [candidate] (621.73 µs) : 0, 622
Telemetry [baseline] (9.136 ms) : 0, 9136
Telemetry [candidate] (8.967 ms) : 0, 8967
Flare Poller [baseline] (3.796 ms) : 0, 3796
Flare Poller [candidate] (3.774 ms) : 0, 3774
section iast
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (789.477 ms) : 0, 789477
BytebuddyAgent [candidate] (791.281 ms) : 0, 791281
GlobalTracer [baseline] (255.408 ms) : 0, 255408
GlobalTracer [candidate] (255.988 ms) : 0, 255988
AppSec [baseline] (35.675 ms) : 0, 35675
AppSec [candidate] (34.567 ms) : 0, 34567
Debugger [baseline] (64.952 ms) : 0, 64952
Debugger [candidate] (65.545 ms) : 0, 65545
Remote Config [baseline] (601.23 µs) : 0, 601
Remote Config [candidate] (551.12 µs) : 0, 551
Telemetry [baseline] (8.441 ms) : 0, 8441
Telemetry [candidate] (8.379 ms) : 0, 8379
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (3.406 ms) : 0, 3406
IAST [baseline] (26.962 ms) : 0, 26962
IAST [candidate] (26.927 ms) : 0, 26927

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/virtual-threads
git_commit_date	1765270216	1765288506
git_commit_sha	`ea52d2d`	`df052db`
release_version	1.57.0-SNAPSHOT~ea52d2d1fb	1.57.0-SNAPSHOT~df052db0e6

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1765291013	1765291013
ci_job_id	1279530683	1279530683
ci_pipeline_id	85584037	85584037
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-a18wdy7v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-a18wdy7v 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 16 metrics, 17 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast_FULL:high_load	worse [+234.311µs; +458.055µs] or [+4.781%; +9.346%]	worse [+388.421µs; +925.187µs] or [+3.305%; +7.871%]	unstable [-130.138op/s; +40.513op/s] or [-15.660%; +4.875%]	5.247ms	12.411ms	786.188op/s	4.901ms	11.754ms	831.000op/s
scenario:load:petclinic:no_agent:high_load	better [-2.113ms; -0.511ms] or [-11.859%; -2.870%]	unstable [-3.512ms; -0.229ms] or [-11.719%; -0.763%]	unstable [-15.472op/s; +46.472op/s] or [-6.014%; +18.063%]	16.506ms	28.103ms	272.781op/s	17.818ms	29.973ms	257.281op/s

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section baseline
no_agent (18.137 ms) : 17949, 18324
. : milestone, 18137,
appsec (18.763 ms) : 18573, 18953
. : milestone, 18763,
code_origins (17.593 ms) : 17419, 17766
. : milestone, 17593,
iast (17.459 ms) : 17285, 17633
. : milestone, 17459,
profiling (18.734 ms) : 18547, 18922
. : milestone, 18734,
tracing (17.561 ms) : 17386, 17736
. : milestone, 17561,
section candidate
no_agent (17.101 ms) : 16934, 17269
. : milestone, 17101,
appsec (19.465 ms) : 19265, 19665
. : milestone, 19465,
code_origins (17.666 ms) : 17489, 17844
. : milestone, 17666,
iast (17.568 ms) : 17396, 17741
. : milestone, 17568,
profiling (18.714 ms) : 18530, 18897
. : milestone, 18714,
tracing (17.703 ms) : 17529, 17877
. : milestone, 17703,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.137 ms [17.949 ms, 18.324 ms]	-
appsec	18.763 ms [18.573 ms, 18.953 ms]	626.264 µs (3.5%)
code_origins	17.593 ms [17.419 ms, 17.766 ms]	-544.007 µs (-3.0%)
iast	17.459 ms [17.285 ms, 17.633 ms]	-677.419 µs (-3.7%)
profiling	18.734 ms [18.547 ms, 18.922 ms]	597.525 µs (3.3%)
tracing	17.561 ms [17.386 ms, 17.736 ms]	-575.642 µs (-3.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.101 ms [16.934 ms, 17.269 ms]	-
appsec	19.465 ms [19.265 ms, 19.665 ms]	2.363 ms (13.8%)
code_origins	17.666 ms [17.489 ms, 17.844 ms]	564.822 µs (3.3%)
iast	17.568 ms [17.396 ms, 17.741 ms]	466.949 µs (2.7%)
profiling	18.714 ms [18.53 ms, 18.897 ms]	1.613 ms (9.4%)
tracing	17.703 ms [17.529 ms, 17.877 ms]	601.551 µs (3.5%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section baseline
no_agent (1.203 ms) : 1191, 1215
. : milestone, 1203,
iast (3.219 ms) : 3182, 3256
. : milestone, 3219,
iast_FULL (5.56 ms) : 5506, 5615
. : milestone, 5560,
iast_GLOBAL (3.629 ms) : 3567, 3690
. : milestone, 3629,
profiling (2.028 ms) : 2011, 2045
. : milestone, 2028,
tracing (1.81 ms) : 1795, 1826
. : milestone, 1810,
section candidate
no_agent (1.216 ms) : 1204, 1228
. : milestone, 1216,
iast (3.243 ms) : 3199, 3287
. : milestone, 3243,
iast_FULL (5.881 ms) : 5821, 5940
. : milestone, 5881,
iast_GLOBAL (3.672 ms) : 3614, 3731
. : milestone, 3672,
profiling (2.099 ms) : 2080, 2118
. : milestone, 2099,
tracing (1.843 ms) : 1828, 1858
. : milestone, 1843,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.203 ms [1.191 ms, 1.215 ms]	-
iast	3.219 ms [3.182 ms, 3.256 ms]	2.016 ms (167.6%)
iast_FULL	5.56 ms [5.506 ms, 5.615 ms]	4.357 ms (362.2%)
iast_GLOBAL	3.629 ms [3.567 ms, 3.69 ms]	2.426 ms (201.7%)
profiling	2.028 ms [2.011 ms, 2.045 ms]	825.012 µs (68.6%)
tracing	1.81 ms [1.795 ms, 1.826 ms]	607.354 µs (50.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.216 ms [1.204 ms, 1.228 ms]	-
iast	3.243 ms [3.199 ms, 3.287 ms]	2.027 ms (166.8%)
iast_FULL	5.881 ms [5.821 ms, 5.94 ms]	4.665 ms (383.8%)
iast_GLOBAL	3.672 ms [3.614 ms, 3.731 ms]	2.457 ms (202.1%)
profiling	2.099 ms [2.08 ms, 2.118 ms]	883.828 µs (72.7%)
tracing	1.843 ms [1.828 ms, 1.858 ms]	627.22 µs (51.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/virtual-threads
git_commit_date	1765270216	1765288506
git_commit_sha	`ea52d2d`	`df052db`
release_version	1.57.0-SNAPSHOT~ea52d2d1fb	1.57.0-SNAPSHOT~df052db0e6

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1765290857	1765290857
ci_job_id	1279530685	1279530685
ci_pipeline_id	85584037	85584037
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-7kephkwv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-7kephkwv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.417ms; -1.073ms] or [-38.154%; -28.879%]	2.469ms	3.714ms

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section baseline
no_agent (14.781 s) : 14781000, 14781000
. : milestone, 14781000,
appsec (14.916 s) : 14916000, 14916000
. : milestone, 14916000,
iast (18.095 s) : 18095000, 18095000
. : milestone, 18095000,
iast_GLOBAL (17.929 s) : 17929000, 17929000
. : milestone, 17929000,
profiling (15.266 s) : 15266000, 15266000
. : milestone, 15266000,
tracing (14.981 s) : 14981000, 14981000
. : milestone, 14981000,
section candidate
no_agent (15.283 s) : 15283000, 15283000
. : milestone, 15283000,
appsec (14.399 s) : 14399000, 14399000
. : milestone, 14399000,
iast (18.308 s) : 18308000, 18308000
. : milestone, 18308000,
iast_GLOBAL (17.765 s) : 17765000, 17765000
. : milestone, 17765000,
profiling (14.737 s) : 14737000, 14737000
. : milestone, 14737000,
tracing (14.636 s) : 14636000, 14636000
. : milestone, 14636000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.781 s [14.781 s, 14.781 s]	-
appsec	14.916 s [14.916 s, 14.916 s]	135.0 ms (0.9%)
iast	18.095 s [18.095 s, 18.095 s]	3.314 s (22.4%)
iast_GLOBAL	17.929 s [17.929 s, 17.929 s]	3.148 s (21.3%)
profiling	15.266 s [15.266 s, 15.266 s]	485.0 ms (3.3%)
tracing	14.981 s [14.981 s, 14.981 s]	200.0 ms (1.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.283 s [15.283 s, 15.283 s]	-
appsec	14.399 s [14.399 s, 14.399 s]	-884.0 ms (-5.8%)
iast	18.308 s [18.308 s, 18.308 s]	3.025 s (19.8%)
iast_GLOBAL	17.765 s [17.765 s, 17.765 s]	2.482 s (16.2%)
profiling	14.737 s [14.737 s, 14.737 s]	-546.0 ms (-3.6%)
tracing	14.636 s [14.636 s, 14.636 s]	-647.0 ms (-4.2%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~df052db0e6, baseline=1.57.0-SNAPSHOT~ea52d2d1fb
dateFormat X
axisFormat %s
section baseline
no_agent (1.482 ms) : 1470, 1493
. : milestone, 1482,
appsec (3.714 ms) : 3494, 3934
. : milestone, 3714,
iast (2.216 ms) : 2151, 2280
. : milestone, 2216,
iast_GLOBAL (2.259 ms) : 2194, 2324
. : milestone, 2259,
profiling (2.065 ms) : 2013, 2117
. : milestone, 2065,
tracing (2.052 ms) : 2001, 2102
. : milestone, 2052,
section candidate
no_agent (1.481 ms) : 1470, 1493
. : milestone, 1481,
appsec (2.469 ms) : 2417, 2521
. : milestone, 2469,
iast (2.218 ms) : 2154, 2282
. : milestone, 2218,
iast_GLOBAL (2.26 ms) : 2195, 2325
. : milestone, 2260,
profiling (2.069 ms) : 2017, 2121
. : milestone, 2069,
tracing (2.038 ms) : 1988, 2089
. : milestone, 2038,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.47 ms, 1.493 ms]	-
appsec	3.714 ms [3.494 ms, 3.934 ms]	2.233 ms (150.7%)
iast	2.216 ms [2.151 ms, 2.28 ms]	734.006 µs (49.5%)
iast_GLOBAL	2.259 ms [2.194 ms, 2.324 ms]	777.515 µs (52.5%)
profiling	2.065 ms [2.013 ms, 2.117 ms]	583.131 µs (39.4%)
tracing	2.052 ms [2.001 ms, 2.102 ms]	570.359 µs (38.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.47 ms, 1.493 ms]	-
appsec	2.469 ms [2.417 ms, 2.521 ms]	988.173 µs (66.7%)
iast	2.218 ms [2.154 ms, 2.282 ms]	736.588 µs (49.7%)
iast_GLOBAL	2.26 ms [2.195 ms, 2.325 ms]	778.839 µs (52.6%)
profiling	2.069 ms [2.017 ms, 2.121 ms]	587.93 µs (39.7%)
tracing	2.038 ms [1.988 ms, 2.089 ms]	557.346 µs (37.6%)

fix(java-lang): Mark test as flaky
df052db

PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Dec 9, 2025

PerfectSlayer requested a review from a team as a code owner December 9, 2025 14:01

PerfectSlayer added tag: flaky test Flaky tests tag: flaky test/disabled Disabled flaky tests inst: java Core Java language instrumentation labels Dec 9, 2025

PerfectSlayer temporarily deployed to ci-build December 9, 2025 14:01 — with GitHub Actions Inactive

bric3 approved these changes Dec 9, 2025
View reviewed changes

PerfectSlayer enabled auto-merge (squash) December 9, 2025 14:09

AlexeyKuznetsov-DD approved these changes Dec 9, 2025
View reviewed changes

PerfectSlayer merged commit f431e84 into masterDec 9, 2025
549 checks passed

PerfectSlayer deleted the bbujon/virtual-threads branch December 9, 2025 15:02

github-actionsBot added this to the 1.57.0 milestone Dec 9, 2025

bric3 added the tag: concurrency Virtual Threads, Coroutines, Async, RX, Executors label Feb 2, 2026

Navigation Menu

Uh oh!

Mark virtual thread tests as flaky - #10122

Mark virtual thread tests as flaky#10122
PerfectSlayer merged 1 commit into
masterfrom
bbujon/virtual-threads

PerfectSlayer commented Dec 9, 2025•
edited by atlassian Bot
Loading

Uh oh!

pr-commenterBot commented Dec 9, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

PerfectSlayer commented Dec 9, 2025• edited by atlassian BotLoading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Dec 9, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

PerfectSlayer commented Dec 9, 2025•
edited by atlassian Bot
Loading