Marked `Jetty10V1ForkedTest` as flaky. by AlexeyKuznetsov-DD · Pull Request #10014 · DataDog/dd-trace-java

AlexeyKuznetsov-DD · 2025-11-21T15:38:12Z

What Does This Do

Mark test datadog.trace.instrumentation.jetty10.Jetty10V1ForkedTest as flaky.

Motivation

Green CI.

Additional Notes

This PR is a followup for #9990

pr-commenter · 2025-11-21T16:27:53Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/jetty10-test-flaky
git_commit_date	1763731854	1763739274
git_commit_sha	`614cc72`	`149be2d`
release_version	1.57.0-SNAPSHOT~614cc721f6	1.57.0-SNAPSHOT~149be2d81a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763741362	1763741362
ci_job_id	1251016680	1251016680
ci_pipeline_id	83611236	83611236
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-plifxt2w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-plifxt2w 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 7 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Remote Config	better [-61.545µs; -11.712µs] or [-10.790%; -2.053%]	533.763µs	570.392µs

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.104 s) : 0, 1104347
Total [baseline] (10.951 s) : 0, 10950520
Agent [candidate] (1.104 s) : 0, 1104042
Total [candidate] (10.826 s) : 0, 10826125
section appsec
Agent [baseline] (1.29 s) : 0, 1290137
Total [baseline] (11.208 s) : 0, 11208381
Agent [candidate] (1.283 s) : 0, 1283278
Total [candidate] (11.085 s) : 0, 11085149
section iast
Agent [baseline] (1.243 s) : 0, 1242727
Total [baseline] (11.274 s) : 0, 11273871
Agent [candidate] (1.242 s) : 0, 1241616
Total [candidate] (11.218 s) : 0, 11217771
section profiling
Agent [baseline] (1.239 s) : 0, 1238935
Total [baseline] (11.203 s) : 0, 11203181
Agent [candidate] (1.241 s) : 0, 1241000
Total [candidate] (11.214 s) : 0, 11214257

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.104 s	-
Agent	appsec	1.29 s	185.79 ms (16.8%)
Agent	iast	1.243 s	138.38 ms (12.5%)
Agent	profiling	1.239 s	134.589 ms (12.2%)
Total	tracing	10.951 s	-
Total	appsec	11.208 s	257.861 ms (2.4%)
Total	iast	11.274 s	323.352 ms (3.0%)
Total	profiling	11.203 s	252.661 ms (2.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.104 s	-
Agent	appsec	1.283 s	179.236 ms (16.2%)
Agent	iast	1.242 s	137.574 ms (12.5%)
Agent	profiling	1.241 s	136.958 ms (12.4%)
Total	tracing	10.826 s	-
Total	appsec	11.085 s	259.023 ms (2.4%)
Total	iast	11.218 s	391.646 ms (3.6%)
Total	profiling	11.214 s	388.131 ms (3.6%)

gantt
title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.476 ms) : 0, 1476
crashtracking [candidate] (1.478 ms) : 0, 1478
BytebuddyAgent [baseline] (708.093 ms) : 0, 708093
BytebuddyAgent [candidate] (709.756 ms) : 0, 709756
GlobalTracer [baseline] (250.57 ms) : 0, 250570
GlobalTracer [candidate] (249.396 ms) : 0, 249396
AppSec [baseline] (32.248 ms) : 0, 32248
AppSec [candidate] (32.02 ms) : 0, 32020
Debugger [baseline] (64.393 ms) : 0, 64393
Debugger [candidate] (63.938 ms) : 0, 63938
Remote Config [baseline] (633.763 µs) : 0, 634
Remote Config [candidate] (623.746 µs) : 0, 624
Telemetry [baseline] (8.373 ms) : 0, 8373
Telemetry [candidate] (8.284 ms) : 0, 8284
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.753 ms) : 0, 3753
section appsec
crashtracking [baseline] (1.497 ms) : 0, 1497
crashtracking [candidate] (1.493 ms) : 0, 1493
BytebuddyAgent [baseline] (738.444 ms) : 0, 738444
BytebuddyAgent [candidate] (732.77 ms) : 0, 732770
GlobalTracer [baseline] (241.851 ms) : 0, 241851
GlobalTracer [candidate] (240.946 ms) : 0, 240946
AppSec [baseline] (174.304 ms) : 0, 174304
AppSec [candidate] (173.687 ms) : 0, 173687
Debugger [baseline] (61.184 ms) : 0, 61184
Debugger [candidate] (62.373 ms) : 0, 62373
Remote Config [baseline] (669.437 µs) : 0, 669
Remote Config [candidate] (663.779 µs) : 0, 664
Telemetry [baseline] (8.302 ms) : 0, 8302
Telemetry [candidate] (8.15 ms) : 0, 8150
Flare Poller [baseline] (3.929 ms) : 0, 3929
Flare Poller [candidate] (3.777 ms) : 0, 3777
IAST [baseline] (24.839 ms) : 0, 24839
IAST [candidate] (24.574 ms) : 0, 24574
section iast
crashtracking [baseline] (1.484 ms) : 0, 1484
crashtracking [candidate] (1.49 ms) : 0, 1490
BytebuddyAgent [baseline] (834.284 ms) : 0, 834284
BytebuddyAgent [candidate] (833.68 ms) : 0, 833680
GlobalTracer [baseline] (237.867 ms) : 0, 237867
GlobalTracer [candidate] (237.752 ms) : 0, 237752
AppSec [baseline] (33.839 ms) : 0, 33839
AppSec [candidate] (34.176 ms) : 0, 34176
Debugger [baseline] (61.01 ms) : 0, 61010
Debugger [candidate] (60.759 ms) : 0, 60759
Remote Config [baseline] (548.279 µs) : 0, 548
Remote Config [candidate] (528.163 µs) : 0, 528
Telemetry [baseline] (7.628 ms) : 0, 7628
Telemetry [candidate] (7.552 ms) : 0, 7552
Flare Poller [baseline] (3.455 ms) : 0, 3455
Flare Poller [candidate] (3.426 ms) : 0, 3426
IAST [baseline] (27.707 ms) : 0, 27707
IAST [candidate] (27.376 ms) : 0, 27376
section profiling
crashtracking [baseline] (1.443 ms) : 0, 1443
crashtracking [candidate] (1.439 ms) : 0, 1439
BytebuddyAgent [baseline] (737.263 ms) : 0, 737263
BytebuddyAgent [candidate] (740.612 ms) : 0, 740612
GlobalTracer [baseline] (224.734 ms) : 0, 224734
GlobalTracer [candidate] (223.571 ms) : 0, 223571
AppSec [baseline] (32.54 ms) : 0, 32540
AppSec [candidate] (32.566 ms) : 0, 32566
Debugger [baseline] (63.596 ms) : 0, 63596
Debugger [candidate] (63.485 ms) : 0, 63485
Remote Config [baseline] (660.088 µs) : 0, 660
Remote Config [candidate] (658.562 µs) : 0, 659
Telemetry [baseline] (8.041 ms) : 0, 8041
Telemetry [candidate] (8.01 ms) : 0, 8010
Flare Poller [baseline] (3.814 ms) : 0, 3814
Flare Poller [candidate] (3.799 ms) : 0, 3799
ProfilingAgent [baseline] (97.673 ms) : 0, 97673
ProfilingAgent [candidate] (97.474 ms) : 0, 97474
Profiling [baseline] (98.289 ms) : 0, 98289
Profiling [candidate] (98.061 ms) : 0, 98061

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.1 s) : 0, 1100048
Total [baseline] (8.853 s) : 0, 8852669
Agent [candidate] (1.111 s) : 0, 1110675
Total [candidate] (8.899 s) : 0, 8899076
section iast
Agent [baseline] (1.26 s) : 0, 1259871
Total [baseline] (9.661 s) : 0, 9661168
Agent [candidate] (1.248 s) : 0, 1248250
Total [candidate] (9.554 s) : 0, 9554160

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	iast	1.26 s	159.823 ms (14.5%)
Total	tracing	8.853 s	-
Total	iast	9.661 s	808.499 ms (9.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.111 s	-
Agent	iast	1.248 s	137.575 ms (12.4%)
Total	tracing	8.899 s	-
Total	iast	9.554 s	655.083 ms (7.4%)

gantt
title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.488 ms) : 0, 1488
crashtracking [candidate] (1.484 ms) : 0, 1484
BytebuddyAgent [baseline] (707.233 ms) : 0, 707233
BytebuddyAgent [candidate] (714.682 ms) : 0, 714682
GlobalTracer [baseline] (248.943 ms) : 0, 248943
GlobalTracer [candidate] (251.162 ms) : 0, 251162
AppSec [baseline] (32.029 ms) : 0, 32029
AppSec [candidate] (32.316 ms) : 0, 32316
Debugger [baseline] (62.89 ms) : 0, 62890
Debugger [candidate] (63.245 ms) : 0, 63245
Remote Config [baseline] (648.319 µs) : 0, 648
Remote Config [candidate] (632.566 µs) : 0, 633
Telemetry [baseline] (8.318 ms) : 0, 8318
Telemetry [candidate] (8.375 ms) : 0, 8375
Flare Poller [baseline] (3.718 ms) : 0, 3718
Flare Poller [candidate] (3.775 ms) : 0, 3775
section iast
crashtracking [baseline] (1.501 ms) : 0, 1501
crashtracking [candidate] (1.508 ms) : 0, 1508
BytebuddyAgent [baseline] (846.808 ms) : 0, 846808
BytebuddyAgent [candidate] (839.749 ms) : 0, 839749
GlobalTracer [baseline] (240.045 ms) : 0, 240045
GlobalTracer [candidate] (238.788 ms) : 0, 238788
AppSec [baseline] (35.353 ms) : 0, 35353
AppSec [candidate] (33.009 ms) : 0, 33009
Debugger [baseline] (61.717 ms) : 0, 61717
Debugger [candidate] (60.051 ms) : 0, 60051
Remote Config [baseline] (570.392 µs) : 0, 570
Remote Config [candidate] (533.763 µs) : 0, 534
Telemetry [baseline] (7.819 ms) : 0, 7819
Telemetry [candidate] (7.642 ms) : 0, 7642
Flare Poller [baseline] (3.592 ms) : 0, 3592
Flare Poller [candidate] (3.519 ms) : 0, 3519
IAST [baseline] (27.24 ms) : 0, 27240
IAST [candidate] (28.458 ms) : 0, 28458

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/jetty10-test-flaky
git_commit_date	1763731854	1763739274
git_commit_sha	`614cc72`	`149be2d`
release_version	1.57.0-SNAPSHOT~614cc721f6	1.57.0-SNAPSHOT~149be2d81a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763741927	1763741927
ci_job_id	1251016681	1251016681
ci_pipeline_id	83611236	83611236
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-3-32dk86tb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-3-32dk86tb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 18 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:code_origins:high_load	worse [+0.937ms; +1.576ms] or [+5.481%; +9.220%]	worse [+0.657ms; +1.960ms] or [+2.323%; +6.932%]	unstable [-43.420op/s; +12.295op/s] or [-16.268%; +4.606%]	18.346ms	29.583ms	251.344op/s	17.090ms	28.274ms	266.906op/s

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section baseline
no_agent (19.764 ms) : 19562, 19966
. : milestone, 19764,
appsec (18.553 ms) : 18363, 18742
. : milestone, 18553,
code_origins (17.481 ms) : 17305, 17657
. : milestone, 17481,
iast (17.94 ms) : 17761, 18120
. : milestone, 17940,
profiling (19.783 ms) : 19581, 19985
. : milestone, 19783,
tracing (17.496 ms) : 17326, 17667
. : milestone, 17496,
section candidate
no_agent (19.399 ms) : 19200, 19598
. : milestone, 19399,
appsec (18.759 ms) : 18570, 18948
. : milestone, 18759,
code_origins (18.565 ms) : 18381, 18750
. : milestone, 18565,
iast (18.142 ms) : 17957, 18327
. : milestone, 18142,
profiling (18.941 ms) : 18745, 19136
. : milestone, 18941,
tracing (17.706 ms) : 17530, 17882
. : milestone, 17706,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.764 ms [19.562 ms, 19.966 ms]	-
appsec	18.553 ms [18.363 ms, 18.742 ms]	-1.211 ms (-6.1%)
code_origins	17.481 ms [17.305 ms, 17.657 ms]	-2.283 ms (-11.6%)
iast	17.94 ms [17.761 ms, 18.12 ms]	-1.823 ms (-9.2%)
profiling	19.783 ms [19.581 ms, 19.985 ms]	19.324 µs (0.1%)
tracing	17.496 ms [17.326 ms, 17.667 ms]	-2.267 ms (-11.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.399 ms [19.2 ms, 19.598 ms]	-
appsec	18.759 ms [18.57 ms, 18.948 ms]	-639.747 µs (-3.3%)
code_origins	18.565 ms [18.381 ms, 18.75 ms]	-833.378 µs (-4.3%)
iast	18.142 ms [17.957 ms, 18.327 ms]	-1.257 ms (-6.5%)
profiling	18.941 ms [18.745 ms, 19.136 ms]	-458.13 µs (-2.4%)
tracing	17.706 ms [17.53 ms, 17.882 ms]	-1.693 ms (-8.7%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section baseline
no_agent (1.224 ms) : 1212, 1237
. : milestone, 1224,
iast (3.242 ms) : 3204, 3279
. : milestone, 3242,
iast_FULL (5.87 ms) : 5811, 5929
. : milestone, 5870,
iast_GLOBAL (3.677 ms) : 3623, 3732
. : milestone, 3677,
profiling (2.261 ms) : 2238, 2283
. : milestone, 2261,
tracing (1.851 ms) : 1835, 1868
. : milestone, 1851,
section candidate
no_agent (1.194 ms) : 1182, 1205
. : milestone, 1194,
iast (3.326 ms) : 3280, 3372
. : milestone, 3326,
iast_FULL (5.79 ms) : 5733, 5848
. : milestone, 5790,
iast_GLOBAL (3.604 ms) : 3552, 3655
. : milestone, 3604,
profiling (2.381 ms) : 2358, 2404
. : milestone, 2381,
tracing (1.795 ms) : 1781, 1810
. : milestone, 1795,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.224 ms [1.212 ms, 1.237 ms]	-
iast	3.242 ms [3.204 ms, 3.279 ms]	2.017 ms (164.8%)
iast_FULL	5.87 ms [5.811 ms, 5.929 ms]	4.645 ms (379.4%)
iast_GLOBAL	3.677 ms [3.623 ms, 3.732 ms]	2.453 ms (200.4%)
profiling	2.261 ms [2.238 ms, 2.283 ms]	1.036 ms (84.6%)
tracing	1.851 ms [1.835 ms, 1.868 ms]	626.983 µs (51.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.194 ms [1.182 ms, 1.205 ms]	-
iast	3.326 ms [3.28 ms, 3.372 ms]	2.132 ms (178.7%)
iast_FULL	5.79 ms [5.733 ms, 5.848 ms]	4.597 ms (385.1%)
iast_GLOBAL	3.604 ms [3.552 ms, 3.655 ms]	2.41 ms (201.9%)
profiling	2.381 ms [2.358 ms, 2.404 ms]	1.187 ms (99.5%)
tracing	1.795 ms [1.781 ms, 1.81 ms]	601.778 µs (50.4%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alexeyk/jetty10-test-flaky
git_commit_date	1763731854	1763739274
git_commit_sha	`614cc72`	`149be2d`
release_version	1.57.0-SNAPSHOT~614cc721f6	1.57.0-SNAPSHOT~149be2d81a

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763741609	1763741609
ci_job_id	1251016682	1251016682
ci_pipeline_id	83611236	83611236
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-4-rvukuja4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-4-rvukuja4 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section baseline
no_agent (14.713 s) : 14713000, 14713000
. : milestone, 14713000,
appsec (14.66 s) : 14660000, 14660000
. : milestone, 14660000,
iast (18.362 s) : 18362000, 18362000
. : milestone, 18362000,
iast_GLOBAL (17.8 s) : 17800000, 17800000
. : milestone, 17800000,
profiling (14.744 s) : 14744000, 14744000
. : milestone, 14744000,
tracing (14.998 s) : 14998000, 14998000
. : milestone, 14998000,
section candidate
no_agent (15.302 s) : 15302000, 15302000
. : milestone, 15302000,
appsec (15.216 s) : 15216000, 15216000
. : milestone, 15216000,
iast (18.261 s) : 18261000, 18261000
. : milestone, 18261000,
iast_GLOBAL (17.742 s) : 17742000, 17742000
. : milestone, 17742000,
profiling (14.764 s) : 14764000, 14764000
. : milestone, 14764000,
tracing (14.878 s) : 14878000, 14878000
. : milestone, 14878000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.713 s [14.713 s, 14.713 s]	-
appsec	14.66 s [14.66 s, 14.66 s]	-53.0 ms (-0.4%)
iast	18.362 s [18.362 s, 18.362 s]	3.649 s (24.8%)
iast_GLOBAL	17.8 s [17.8 s, 17.8 s]	3.087 s (21.0%)
profiling	14.744 s [14.744 s, 14.744 s]	31.0 ms (0.2%)
tracing	14.998 s [14.998 s, 14.998 s]	285.0 ms (1.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.302 s [15.302 s, 15.302 s]	-
appsec	15.216 s [15.216 s, 15.216 s]	-86.0 ms (-0.6%)
iast	18.261 s [18.261 s, 18.261 s]	2.959 s (19.3%)
iast_GLOBAL	17.742 s [17.742 s, 17.742 s]	2.44 s (15.9%)
profiling	14.764 s [14.764 s, 14.764 s]	-538.0 ms (-3.5%)
tracing	14.878 s [14.878 s, 14.878 s]	-424.0 ms (-2.8%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~149be2d81a, baseline=1.57.0-SNAPSHOT~614cc721f6
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
. : milestone, 1477,
appsec (3.733 ms) : 3513, 3952
. : milestone, 3733,
iast (2.233 ms) : 2168, 2298
. : milestone, 2233,
iast_GLOBAL (2.252 ms) : 2187, 2317
. : milestone, 2252,
profiling (2.08 ms) : 2027, 2132
. : milestone, 2080,
tracing (2.052 ms) : 2001, 2103
. : milestone, 2052,
section candidate
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (3.704 ms) : 3484, 3924
. : milestone, 3704,
iast (2.218 ms) : 2153, 2282
. : milestone, 2218,
iast_GLOBAL (2.267 ms) : 2202, 2332
. : milestone, 2267,
profiling (2.486 ms) : 2327, 2645
. : milestone, 2486,
tracing (2.06 ms) : 2008, 2111
. : milestone, 2060,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	3.733 ms [3.513 ms, 3.952 ms]	2.255 ms (152.6%)
iast	2.233 ms [2.168 ms, 2.298 ms]	755.61 µs (51.1%)
iast_GLOBAL	2.252 ms [2.187 ms, 2.317 ms]	774.53 µs (52.4%)
profiling	2.08 ms [2.027 ms, 2.132 ms]	602.081 µs (40.8%)
tracing	2.052 ms [2.001 ms, 2.103 ms]	574.249 µs (38.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	3.704 ms [3.484 ms, 3.924 ms]	2.226 ms (150.6%)
iast	2.218 ms [2.153 ms, 2.282 ms]	739.736 µs (50.1%)
iast_GLOBAL	2.267 ms [2.202 ms, 2.332 ms]	788.885 µs (53.4%)
profiling	2.486 ms [2.327 ms, 2.645 ms]	1.008 ms (68.2%)
tracing	2.06 ms [2.008 ms, 2.111 ms]	581.855 µs (39.4%)

Marked Jetty10V1ForkedTest as flaky.
149be2d

AlexeyKuznetsov-DD requested a review from sarahchen6 November 21, 2025 15:38

AlexeyKuznetsov-DD self-assigned this Nov 21, 2025

AlexeyKuznetsov-DD added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Nov 21, 2025

AlexeyKuznetsov-DD marked this pull request as ready for review November 21, 2025 15:38

AlexeyKuznetsov-DD requested a review from a team as a code owner November 21, 2025 15:38

AlexeyKuznetsov-DD requested a review from mhlidd November 21, 2025 15:38

PerfectSlayer approved these changes Nov 21, 2025
View reviewed changes

PerfectSlayer added tag: flaky test Flaky tests tag: flaky test/disabled Disabled flaky tests inst: jetty Jetty instrumentation and removed comp: testing Testing labels Nov 21, 2025

AlexeyKuznetsov-DD merged commit 9d80781 into masterNov 21, 2025
548 of 549 checks passed

AlexeyKuznetsov-DD deleted the alexeyk/jetty10-test-flaky branch November 21, 2025 16:45

github-actionsBot added this to the 1.57.0 milestone Nov 21, 2025

Navigation Menu

Uh oh!

Marked `Jetty10V1ForkedTest` as flaky. - #10014

Marked `Jetty10V1ForkedTest` as flaky.#10014
AlexeyKuznetsov-DD merged 1 commit into
masterfrom
alexeyk/jetty10-test-flaky

AlexeyKuznetsov-DD commented Nov 21, 2025

Uh oh!

pr-commenterBot commented Nov 21, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

AlexeyKuznetsov-DD commented Nov 21, 2025

What Does This Do

Motivation

Additional Notes

Uh oh!

pr-commenterBot commented Nov 21, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants