add flaky annotation by zarirhamza · Pull Request #9990 · DataDog/dd-trace-java

zarirhamza · 2025-11-17T20:59:22Z

What Does This Do

Annotates flaky test introduced in #9422

The issue is that the current test when AppSec is enabled, the conext is lost in a race condition causing flakiness

Motivation

Mark for future fixing

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

github-actions · 2025-11-17T20:59:32Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-11-17T21:43:14Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	zarir/flaky-test-ig-session
git_commit_date	1763407991	1763412987
git_commit_sha	`b6d4e4f`	`7834eee`
release_version	1.56.0-SNAPSHOT~b6d4e4fc4a	1.56.0-SNAPSHOT~7834eeeaee

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763414796	1763414796
ci_job_id	1240408466	1240408466
ci_pipeline_id	82810657	82810657
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-wv94hr1a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-wv94hr1a 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 5 unstable metrics.

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.095 s) : 0, 1094637
Total [baseline] (10.695 s) : 0, 10695097
Agent [candidate] (1.095 s) : 0, 1095447
Total [candidate] (10.826 s) : 0, 10825695
section appsec
Agent [baseline] (1.285 s) : 0, 1284502
Total [baseline] (10.992 s) : 0, 10991773
Agent [candidate] (1.274 s) : 0, 1273958
Total [candidate] (10.995 s) : 0, 10995388
section iast
Agent [baseline] (1.251 s) : 0, 1250807
Total [baseline] (11.197 s) : 0, 11197168
Agent [candidate] (1.231 s) : 0, 1230749
Total [candidate] (11.191 s) : 0, 11191417
section profiling
Agent [baseline] (1.227 s) : 0, 1226662
Total [baseline] (11.023 s) : 0, 11022509
Agent [candidate] (1.232 s) : 0, 1232232
Total [candidate] (11.053 s) : 0, 11052560

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.095 s	-
Agent	appsec	1.285 s	189.865 ms (17.3%)
Agent	iast	1.251 s	156.169 ms (14.3%)
Agent	profiling	1.227 s	132.025 ms (12.1%)
Total	tracing	10.695 s	-
Total	appsec	10.992 s	296.676 ms (2.8%)
Total	iast	11.197 s	502.071 ms (4.7%)
Total	profiling	11.023 s	327.412 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.095 s	-
Agent	appsec	1.274 s	178.512 ms (16.3%)
Agent	iast	1.231 s	135.302 ms (12.4%)
Agent	profiling	1.232 s	136.785 ms (12.5%)
Total	tracing	10.826 s	-
Total	appsec	10.995 s	169.693 ms (1.6%)
Total	iast	11.191 s	365.722 ms (3.4%)
Total	profiling	11.053 s	226.865 ms (2.1%)

gantt
title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.439 ms) : 0, 1439
crashtracking [candidate] (1.435 ms) : 0, 1435
BytebuddyAgent [baseline] (703.032 ms) : 0, 703032
BytebuddyAgent [candidate] (703.768 ms) : 0, 703768
GlobalTracer [baseline] (247.256 ms) : 0, 247256
GlobalTracer [candidate] (247.321 ms) : 0, 247321
AppSec [baseline] (31.989 ms) : 0, 31989
AppSec [candidate] (32.028 ms) : 0, 32028
Debugger [baseline] (63.941 ms) : 0, 63941
Debugger [candidate] (63.823 ms) : 0, 63823
Remote Config [baseline] (618.86 µs) : 0, 619
Remote Config [candidate] (620.299 µs) : 0, 620
Telemetry [baseline] (8.033 ms) : 0, 8033
Telemetry [candidate] (8.047 ms) : 0, 8047
Flare Poller [baseline] (3.577 ms) : 0, 3577
Flare Poller [candidate] (3.652 ms) : 0, 3652
section appsec
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.448 ms) : 0, 1448
BytebuddyAgent [baseline] (733.372 ms) : 0, 733372
BytebuddyAgent [candidate] (727.467 ms) : 0, 727467
GlobalTracer [baseline] (240.567 ms) : 0, 240567
GlobalTracer [candidate] (238.954 ms) : 0, 238954
IAST [baseline] (25.09 ms) : 0, 25090
IAST [candidate] (24.638 ms) : 0, 24638
AppSec [baseline] (174.631 ms) : 0, 174631
AppSec [candidate] (173.419 ms) : 0, 173419
Debugger [baseline] (61.466 ms) : 0, 61466
Debugger [candidate] (60.32 ms) : 0, 60320
Remote Config [baseline] (687.522 µs) : 0, 688
Remote Config [candidate] (711.081 µs) : 0, 711
Telemetry [baseline] (8.277 ms) : 0, 8277
Telemetry [candidate] (8.278 ms) : 0, 8278
Flare Poller [baseline] (3.823 ms) : 0, 3823
Flare Poller [candidate] (3.885 ms) : 0, 3885
section iast
crashtracking [baseline] (1.469 ms) : 0, 1469
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (839.403 ms) : 0, 839403
BytebuddyAgent [candidate] (824.762 ms) : 0, 824762
GlobalTracer [baseline] (238.916 ms) : 0, 238916
GlobalTracer [candidate] (236.506 ms) : 0, 236506
IAST [baseline] (28.848 ms) : 0, 28848
IAST [candidate] (28.114 ms) : 0, 28114
AppSec [baseline] (33.31 ms) : 0, 33310
AppSec [candidate] (32.706 ms) : 0, 32706
Debugger [baseline] (61.804 ms) : 0, 61804
Debugger [candidate] (60.796 ms) : 0, 60796
Remote Config [baseline] (556.055 µs) : 0, 556
Remote Config [candidate] (541.932 µs) : 0, 542
Telemetry [baseline] (7.796 ms) : 0, 7796
Telemetry [candidate] (7.627 ms) : 0, 7627
Flare Poller [baseline] (3.566 ms) : 0, 3566
Flare Poller [candidate] (3.496 ms) : 0, 3496
section profiling
crashtracking [baseline] (1.427 ms) : 0, 1427
crashtracking [candidate] (1.458 ms) : 0, 1458
BytebuddyAgent [baseline] (729.82 ms) : 0, 729820
BytebuddyAgent [candidate] (734.551 ms) : 0, 734551
GlobalTracer [baseline] (221.658 ms) : 0, 221658
GlobalTracer [candidate] (221.819 ms) : 0, 221819
AppSec [baseline] (32.075 ms) : 0, 32075
AppSec [candidate] (32.074 ms) : 0, 32074
Debugger [baseline] (62.888 ms) : 0, 62888
Debugger [candidate] (62.777 ms) : 0, 62777
Remote Config [baseline] (651.61 µs) : 0, 652
Remote Config [candidate] (657.908 µs) : 0, 658
Telemetry [baseline] (7.981 ms) : 0, 7981
Telemetry [candidate] (7.873 ms) : 0, 7873
Flare Poller [baseline] (3.779 ms) : 0, 3779
Flare Poller [candidate] (3.734 ms) : 0, 3734
ProfilingAgent [baseline] (96.778 ms) : 0, 96778
ProfilingAgent [candidate] (96.855 ms) : 0, 96855
Profiling [baseline] (97.365 ms) : 0, 97365
Profiling [candidate] (97.436 ms) : 0, 97436

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.099 s) : 0, 1098880
Total [baseline] (8.836 s) : 0, 8835691
Agent [candidate] (1.103 s) : 0, 1103328
Total [candidate] (8.862 s) : 0, 8861610
section iast
Agent [baseline] (1.234 s) : 0, 1233828
Total [baseline] (9.516 s) : 0, 9516049
Agent [candidate] (1.234 s) : 0, 1234313
Total [candidate] (9.503 s) : 0, 9503370

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.099 s	-
Agent	iast	1.234 s	134.948 ms (12.3%)
Total	tracing	8.836 s	-
Total	iast	9.516 s	680.358 ms (7.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.103 s	-
Agent	iast	1.234 s	130.985 ms (11.9%)
Total	tracing	8.862 s	-
Total	iast	9.503 s	641.76 ms (7.2%)

gantt
title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.463 ms) : 0, 1463
BytebuddyAgent [baseline] (706.127 ms) : 0, 706127
BytebuddyAgent [candidate] (708.84 ms) : 0, 708840
GlobalTracer [baseline] (248.228 ms) : 0, 248228
GlobalTracer [candidate] (249.542 ms) : 0, 249542
AppSec [baseline] (32.308 ms) : 0, 32308
AppSec [candidate] (32.533 ms) : 0, 32533
Debugger [baseline] (63.535 ms) : 0, 63535
Debugger [candidate] (63.587 ms) : 0, 63587
Remote Config [baseline] (632.072 µs) : 0, 632
Remote Config [candidate] (626.399 µs) : 0, 626
Telemetry [baseline] (8.165 ms) : 0, 8165
Telemetry [candidate] (8.253 ms) : 0, 8253
Flare Poller [baseline] (3.66 ms) : 0, 3660
Flare Poller [candidate] (3.677 ms) : 0, 3677
section iast
crashtracking [baseline] (1.451 ms) : 0, 1451
crashtracking [candidate] (1.459 ms) : 0, 1459
BytebuddyAgent [baseline] (827.533 ms) : 0, 827533
BytebuddyAgent [candidate] (827.276 ms) : 0, 827276
GlobalTracer [baseline] (237.036 ms) : 0, 237036
GlobalTracer [candidate] (237.235 ms) : 0, 237235
IAST [baseline] (26.617 ms) : 0, 26617
IAST [candidate] (26.54 ms) : 0, 26540
AppSec [baseline] (34.558 ms) : 0, 34558
AppSec [candidate] (34.719 ms) : 0, 34719
Debugger [baseline] (60.153 ms) : 0, 60153
Debugger [candidate] (60.483 ms) : 0, 60483
Remote Config [baseline] (540.012 µs) : 0, 540
Remote Config [candidate] (538.925 µs) : 0, 539
Telemetry [baseline] (7.713 ms) : 0, 7713
Telemetry [candidate] (7.645 ms) : 0, 7645
Flare Poller [baseline] (3.421 ms) : 0, 3421
Flare Poller [candidate] (3.495 ms) : 0, 3495

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	zarir/flaky-test-ig-session
git_commit_date	1763407991	1763412987
git_commit_sha	`b6d4e4f`	`7834eee`
release_version	1.56.0-SNAPSHOT~b6d4e4fc4a	1.56.0-SNAPSHOT~7834eeeaee

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763415285	1763415285
ci_job_id	1240408468	1240408468
ci_pipeline_id	82810657	82810657
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-2-9cye2m3h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-2-9cye2m3h 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 18 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:insecure-bank:iast:high_load	worse [+93.937µs; +193.894µs] or [+3.771%; +7.784%]	worse [+200.205µs; +559.091µs] or [+2.770%; +7.735%]	unstable [-225.479op/s; +68.354op/s] or [-15.758%; +4.777%]	2.635ms	7.607ms	1352.344op/s	2.491ms	7.228ms	1430.906op/s
scenario:load:petclinic:profiling:high_load	better [-2.022ms; -0.998ms] or [-10.415%; -5.139%]	better [-3.116ms; -1.172ms] or [-9.949%; -3.741%]	unstable [-6.104op/s; +40.104op/s] or [-2.567%; +16.868%]	17.907ms	29.180ms	254.750op/s	19.417ms	31.324ms	237.750op/s

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section baseline
no_agent (19.086 ms) : 18890, 19282
. : milestone, 19086,
appsec (18.778 ms) : 18591, 18964
. : milestone, 18778,
code_origins (17.928 ms) : 17750, 18105
. : milestone, 17928,
iast (17.951 ms) : 17771, 18131
. : milestone, 17951,
profiling (19.634 ms) : 19430, 19838
. : milestone, 19634,
tracing (17.597 ms) : 17421, 17773
. : milestone, 17597,
section candidate
no_agent (18.431 ms) : 18237, 18625
. : milestone, 18431,
appsec (18.974 ms) : 18781, 19167
. : milestone, 18974,
code_origins (17.769 ms) : 17594, 17944
. : milestone, 17769,
iast (18.015 ms) : 17836, 18195
. : milestone, 18015,
profiling (18.323 ms) : 18140, 18505
. : milestone, 18323,
tracing (17.577 ms) : 17403, 17750
. : milestone, 17577,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	19.086 ms [18.89 ms, 19.282 ms]	-
appsec	18.778 ms [18.591 ms, 18.964 ms]	-307.853 µs (-1.6%)
code_origins	17.928 ms [17.75 ms, 18.105 ms]	-1.158 ms (-6.1%)
iast	17.951 ms [17.771 ms, 18.131 ms]	-1.135 ms (-5.9%)
profiling	19.634 ms [19.43 ms, 19.838 ms]	548.704 µs (2.9%)
tracing	17.597 ms [17.421 ms, 17.773 ms]	-1.489 ms (-7.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.431 ms [18.237 ms, 18.625 ms]	-
appsec	18.974 ms [18.781 ms, 19.167 ms]	542.91 µs (2.9%)
code_origins	17.769 ms [17.594 ms, 17.944 ms]	-662.097 µs (-3.6%)
iast	18.015 ms [17.836 ms, 18.195 ms]	-415.502 µs (-2.3%)
profiling	18.323 ms [18.14 ms, 18.505 ms]	-108.295 µs (-0.6%)
tracing	17.577 ms [17.403 ms, 17.75 ms]	-854.309 µs (-4.6%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section baseline
no_agent (1.176 ms) : 1164, 1187
. : milestone, 1176,
iast (3.197 ms) : 3150, 3244
. : milestone, 3197,
iast_FULL (5.678 ms) : 5620, 5736
. : milestone, 5678,
iast_GLOBAL (3.693 ms) : 3630, 3756
. : milestone, 3693,
profiling (2.183 ms) : 2161, 2206
. : milestone, 2183,
tracing (1.802 ms) : 1787, 1817
. : milestone, 1802,
section candidate
no_agent (1.191 ms) : 1180, 1203
. : milestone, 1191,
iast (3.388 ms) : 3332, 3444
. : milestone, 3388,
iast_FULL (5.902 ms) : 5843, 5962
. : milestone, 5902,
iast_GLOBAL (3.739 ms) : 3675, 3803
. : milestone, 3739,
profiling (1.985 ms) : 1967, 2003
. : milestone, 1985,
tracing (1.819 ms) : 1804, 1835
. : milestone, 1819,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.176 ms [1.164 ms, 1.187 ms]	-
iast	3.197 ms [3.15 ms, 3.244 ms]	2.021 ms (171.9%)
iast_FULL	5.678 ms [5.62 ms, 5.736 ms]	4.503 ms (383.0%)
iast_GLOBAL	3.693 ms [3.63 ms, 3.756 ms]	2.517 ms (214.1%)
profiling	2.183 ms [2.161 ms, 2.206 ms]	1.008 ms (85.7%)
tracing	1.802 ms [1.787 ms, 1.817 ms]	626.544 µs (53.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.191 ms [1.18 ms, 1.203 ms]	-
iast	3.388 ms [3.332 ms, 3.444 ms]	2.197 ms (184.5%)
iast_FULL	5.902 ms [5.843 ms, 5.962 ms]	4.711 ms (395.5%)
iast_GLOBAL	3.739 ms [3.675 ms, 3.803 ms]	2.548 ms (213.9%)
profiling	1.985 ms [1.967 ms, 2.003 ms]	793.747 µs (66.6%)
tracing	1.819 ms [1.804 ms, 1.835 ms]	628.247 µs (52.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	zarir/flaky-test-ig-session
git_commit_date	1763407991	1763412987
git_commit_sha	`b6d4e4f`	`7834eee`
release_version	1.56.0-SNAPSHOT~b6d4e4fc4a	1.56.0-SNAPSHOT~7834eeeaee

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763415019	1763415019
ci_job_id	1240408469	1240408469
ci_pipeline_id	82810657	82810657
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-3-3yw907a6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-3-3yw907a6 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
. : milestone, 1477,
appsec (3.719 ms) : 3495, 3943
. : milestone, 3719,
iast (2.207 ms) : 2144, 2271
. : milestone, 2207,
iast_GLOBAL (2.253 ms) : 2189, 2318
. : milestone, 2253,
profiling (2.076 ms) : 2023, 2129
. : milestone, 2076,
tracing (2.021 ms) : 1971, 2071
. : milestone, 2021,
section candidate
no_agent (1.48 ms) : 1469, 1492
. : milestone, 1480,
appsec (3.702 ms) : 3483, 3922
. : milestone, 3702,
iast (2.194 ms) : 2131, 2258
. : milestone, 2194,
iast_GLOBAL (2.254 ms) : 2190, 2318
. : milestone, 2254,
profiling (2.065 ms) : 2013, 2117
. : milestone, 2065,
tracing (2.028 ms) : 1978, 2077
. : milestone, 2028,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.488 ms]	-
appsec	3.719 ms [3.495 ms, 3.943 ms]	2.242 ms (151.8%)
iast	2.207 ms [2.144 ms, 2.271 ms]	730.497 µs (49.5%)
iast_GLOBAL	2.253 ms [2.189 ms, 2.318 ms]	776.527 µs (52.6%)
profiling	2.076 ms [2.023 ms, 2.129 ms]	598.751 µs (40.5%)
tracing	2.021 ms [1.971 ms, 2.071 ms]	544.123 µs (36.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	3.702 ms [3.483 ms, 3.922 ms]	2.222 ms (150.1%)
iast	2.194 ms [2.131 ms, 2.258 ms]	713.96 µs (48.2%)
iast_GLOBAL	2.254 ms [2.19 ms, 2.318 ms]	773.76 µs (52.3%)
profiling	2.065 ms [2.013 ms, 2.117 ms]	584.774 µs (39.5%)
tracing	2.028 ms [1.978 ms, 2.077 ms]	547.36 µs (37.0%)

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7834eeeaee, baseline=1.56.0-SNAPSHOT~b6d4e4fc4a
dateFormat X
axisFormat %s
section baseline
no_agent (14.937 s) : 14937000, 14937000
. : milestone, 14937000,
appsec (14.632 s) : 14632000, 14632000
. : milestone, 14632000,
iast (18.441 s) : 18441000, 18441000
. : milestone, 18441000,
iast_GLOBAL (17.964 s) : 17964000, 17964000
. : milestone, 17964000,
profiling (15.064 s) : 15064000, 15064000
. : milestone, 15064000,
tracing (14.612 s) : 14612000, 14612000
. : milestone, 14612000,
section candidate
no_agent (15.538 s) : 15538000, 15538000
. : milestone, 15538000,
appsec (14.905 s) : 14905000, 14905000
. : milestone, 14905000,
iast (18.312 s) : 18312000, 18312000
. : milestone, 18312000,
iast_GLOBAL (18.024 s) : 18024000, 18024000
. : milestone, 18024000,
profiling (14.896 s) : 14896000, 14896000
. : milestone, 14896000,
tracing (14.686 s) : 14686000, 14686000
. : milestone, 14686000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.937 s [14.937 s, 14.937 s]	-
appsec	14.632 s [14.632 s, 14.632 s]	-305.0 ms (-2.0%)
iast	18.441 s [18.441 s, 18.441 s]	3.504 s (23.5%)
iast_GLOBAL	17.964 s [17.964 s, 17.964 s]	3.027 s (20.3%)
profiling	15.064 s [15.064 s, 15.064 s]	127.0 ms (0.9%)
tracing	14.612 s [14.612 s, 14.612 s]	-325.0 ms (-2.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.538 s [15.538 s, 15.538 s]	-
appsec	14.905 s [14.905 s, 14.905 s]	-633.0 ms (-4.1%)
iast	18.312 s [18.312 s, 18.312 s]	2.774 s (17.9%)
iast_GLOBAL	18.024 s [18.024 s, 18.024 s]	2.486 s (16.0%)
profiling	14.896 s [14.896 s, 14.896 s]	-642.0 ms (-4.1%)
tracing	14.686 s [14.686 s, 14.686 s]	-852.0 ms (-5.5%)

add flaky annotation
7834eee

zarirhamza requested a review from a team as a code owner November 17, 2025 20:59

zarirhamza requested a review from amarziali November 17, 2025 20:59

zarirhamza enabled auto-merge (squash) November 17, 2025 20:59

zarirhamza added tag: flaky test Flaky tests comp: context propagation Trace context propagation labels Nov 17, 2025

AlexeyKuznetsov-DD approved these changes Nov 17, 2025
View reviewed changes

zarirhamza added the type: refactoring label Nov 17, 2025

zarirhamza merged commit 0ba9af0 into masterNov 17, 2025
706 of 712 checks passed

zarirhamza deleted the zarir/flaky-test-ig-session branch November 17, 2025 21:54

github-actionsBot added this to the 1.56.0 milestone Nov 17, 2025

PerfectSlayer added tag: no release notes Changes to exclude from release notes tag: flaky test/disabled Disabled flaky tests and removed type: refactoring labels Nov 20, 2025

AlexeyKuznetsov-DD mentioned this pull request Nov 21, 2025
Marked Jetty10V1ForkedTest as flaky. #10014
Merged

Navigation Menu

Uh oh!

add flaky annotation - #9990

add flaky annotation#9990
zarirhamza merged 1 commit into
masterfrom
zarir/flaky-test-ig-session

zarirhamza commented Nov 17, 2025

Uh oh!

github-actionsBot commented Nov 17, 2025•
edited
Loading

Uh oh!

pr-commenterBot commented Nov 17, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

zarirhamza commented Nov 17, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actionsBot commented Nov 17, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenterBot commented Nov 17, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

github-actionsBot commented Nov 17, 2025•
edited
Loading