Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 by mhlidd · Pull Request #8537 · DataDog/dd-trace-java

mhlidd · 2025-03-11T17:40:41Z

What Does This Do

Help fix CI system-tests failures that were recently fixed.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-03-11T18:19:40Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/update_system_tests_hash
git_commit_date	1741707364	1741714757
git_commit_sha	`f8c6b49`	`9577564`
release_version	1.48.0-SNAPSHOT~f8c6b49f18	1.48.0-SNAPSHOT~9577564f7f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741717270	1741717270
ci_job_id	842955516	842955516
ci_pipeline_id	58465015	58465015
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2wkmbgws-project-304-concurrent-0-2t1i830n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2wkmbgws-project-304-concurrent-0-2t1i830n 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044833
Total [baseline] (8.711 s) : 0, 8710651
Agent [candidate] (1.043 s) : 0, 1042606
Total [candidate] (8.685 s) : 0, 8685421
section iast
Agent [baseline] (1.172 s) : 0, 1172072
Total [baseline] (9.25 s) : 0, 9249589
Agent [candidate] (1.188 s) : 0, 1187707
Total [candidate] (9.275 s) : 0, 9274916
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.173 s) : 0, 1173493
Total [baseline] (9.228 s) : 0, 9227541
Agent [candidate] (1.175 s) : 0, 1174795
Total [candidate] (9.239 s) : 0, 9238916
section iast_TELEMETRY_OFF
Agent [baseline] (1.179 s) : 0, 1178819
Total [baseline] (9.269 s) : 0, 9268518
Agent [candidate] (1.169 s) : 0, 1168912
Total [candidate] (9.272 s) : 0, 9271895

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	iast	1.172 s	127.24 ms (12.2%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.173 s	128.66 ms (12.3%)
Agent	iast_TELEMETRY_OFF	1.179 s	133.987 ms (12.8%)
Total	tracing	8.711 s	-
Total	iast	9.25 s	538.938 ms (6.2%)
Total	iast_HARDCODED_SECRET_DISABLED	9.228 s	516.89 ms (5.9%)
Total	iast_TELEMETRY_OFF	9.269 s	557.867 ms (6.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.043 s	-
Agent	iast	1.188 s	145.101 ms (13.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.175 s	132.188 ms (12.7%)
Agent	iast_TELEMETRY_OFF	1.169 s	126.306 ms (12.1%)
Total	tracing	8.685 s	-
Total	iast	9.275 s	589.495 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.239 s	553.495 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.272 s	586.474 ms (6.8%)

gantt
title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.124 ms) : 0, 720124
BytebuddyAgent [candidate] (718.841 ms) : 0, 718841
GlobalTracer [baseline] (239.963 ms) : 0, 239963
GlobalTracer [candidate] (239.546 ms) : 0, 239546
AppSec [baseline] (55.268 ms) : 0, 55268
AppSec [candidate] (55.055 ms) : 0, 55055
Remote Config [baseline] (686.077 µs) : 0, 686
Remote Config [candidate] (682.442 µs) : 0, 682
Telemetry [baseline] (13.842 ms) : 0, 13842
Telemetry [candidate] (13.494 ms) : 0, 13494
section iast
BytebuddyAgent [baseline] (837.852 ms) : 0, 837852
BytebuddyAgent [candidate] (850.532 ms) : 0, 850532
GlobalTracer [baseline] (230.535 ms) : 0, 230535
GlobalTracer [candidate] (232.686 ms) : 0, 232686
IAST [baseline] (22.788 ms) : 0, 22788
IAST [candidate] (23.23 ms) : 0, 23230
AppSec [baseline] (56.676 ms) : 0, 56676
AppSec [candidate] (56.736 ms) : 0, 56736
Remote Config [baseline] (617.601 µs) : 0, 618
Remote Config [candidate] (622.703 µs) : 0, 623
Telemetry [baseline] (8.677 ms) : 0, 8677
Telemetry [candidate] (8.78 ms) : 0, 8780
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (839.054 ms) : 0, 839054
BytebuddyAgent [candidate] (839.294 ms) : 0, 839294
GlobalTracer [baseline] (230.465 ms) : 0, 230465
GlobalTracer [candidate] (231.317 ms) : 0, 231317
IAST [baseline] (23.03 ms) : 0, 23030
IAST [candidate] (22.845 ms) : 0, 22845
AppSec [baseline] (56.732 ms) : 0, 56732
AppSec [candidate] (57.098 ms) : 0, 57098
Remote Config [baseline] (605.193 µs) : 0, 605
Remote Config [candidate] (593.47 µs) : 0, 593
Telemetry [baseline] (8.697 ms) : 0, 8697
Telemetry [candidate] (8.711 ms) : 0, 8711
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (841.171 ms) : 0, 841171
BytebuddyAgent [candidate] (835.022 ms) : 0, 835022
GlobalTracer [baseline] (232.413 ms) : 0, 232413
GlobalTracer [candidate] (230.389 ms) : 0, 230389
IAST [baseline] (22.913 ms) : 0, 22913
IAST [candidate] (22.402 ms) : 0, 22402
AppSec [baseline] (57.802 ms) : 0, 57802
AppSec [candidate] (56.939 ms) : 0, 56939
Remote Config [baseline] (629.875 µs) : 0, 630
Remote Config [candidate] (602.936 µs) : 0, 603
Telemetry [baseline] (8.879 ms) : 0, 8879
Telemetry [candidate] (8.63 ms) : 0, 8630

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1039536
Total [baseline] (10.468 s) : 0, 10468350
Agent [candidate] (1.046 s) : 0, 1045703
Total [candidate] (10.574 s) : 0, 10573938
section appsec
Agent [baseline] (1.191 s) : 0, 1190716
Total [baseline] (10.766 s) : 0, 10765854
Agent [candidate] (1.183 s) : 0, 1182949
Total [candidate] (10.765 s) : 0, 10764577
section iast
Agent [baseline] (1.182 s) : 0, 1181701
Total [baseline] (11.144 s) : 0, 11143815
Agent [candidate] (1.171 s) : 0, 1171324
Total [candidate] (10.995 s) : 0, 10995272
section profiling
Agent [baseline] (1.269 s) : 0, 1268661
Total [baseline] (10.899 s) : 0, 10899446
Agent [candidate] (1.269 s) : 0, 1269204
Total [candidate] (10.854 s) : 0, 10853624

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	appsec	1.191 s	151.18 ms (14.5%)
Agent	iast	1.182 s	142.166 ms (13.7%)
Agent	profiling	1.269 s	229.125 ms (22.0%)
Total	tracing	10.468 s	-
Total	appsec	10.766 s	297.504 ms (2.8%)
Total	iast	11.144 s	675.465 ms (6.5%)
Total	profiling	10.899 s	431.096 ms (4.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.046 s	-
Agent	appsec	1.183 s	137.246 ms (13.1%)
Agent	iast	1.171 s	125.621 ms (12.0%)
Agent	profiling	1.269 s	223.501 ms (21.4%)
Total	tracing	10.574 s	-
Total	appsec	10.765 s	190.639 ms (1.8%)
Total	iast	10.995 s	421.334 ms (4.0%)
Total	profiling	10.854 s	279.686 ms (2.6%)

gantt
title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.587 ms) : 0, 717587
BytebuddyAgent [candidate] (719.755 ms) : 0, 719755
GlobalTracer [baseline] (239.526 ms) : 0, 239526
GlobalTracer [candidate] (240.514 ms) : 0, 240514
AppSec [baseline] (55.405 ms) : 0, 55405
AppSec [candidate] (55.539 ms) : 0, 55539
Remote Config [baseline] (682.392 µs) : 0, 682
Remote Config [candidate] (699.95 µs) : 0, 700
Telemetry [baseline] (11.477 ms) : 0, 11477
Telemetry [candidate] (14.288 ms) : 0, 14288
section appsec
BytebuddyAgent [baseline] (741.731 ms) : 0, 741731
BytebuddyAgent [candidate] (735.954 ms) : 0, 735954
GlobalTracer [baseline] (237.158 ms) : 0, 237158
GlobalTracer [candidate] (236.088 ms) : 0, 236088
IAST [baseline] (21.774 ms) : 0, 21774
IAST [candidate] (21.56 ms) : 0, 21560
AppSec [baseline] (175.985 ms) : 0, 175985
AppSec [candidate] (175.976 ms) : 0, 175976
Remote Config [baseline] (661.795 µs) : 0, 662
Remote Config [candidate] (655.523 µs) : 0, 656
Telemetry [baseline] (9.314 ms) : 0, 9314
Telemetry [candidate] (8.631 ms) : 0, 8631
section iast
BytebuddyAgent [baseline] (845.197 ms) : 0, 845197
BytebuddyAgent [candidate] (837.578 ms) : 0, 837578
GlobalTracer [baseline] (232.277 ms) : 0, 232277
GlobalTracer [candidate] (230.718 ms) : 0, 230718
IAST [baseline] (23.011 ms) : 0, 23011
IAST [candidate] (22.547 ms) : 0, 22547
AppSec [baseline] (56.861 ms) : 0, 56861
AppSec [candidate] (56.377 ms) : 0, 56377
Remote Config [baseline] (614.754 µs) : 0, 615
Remote Config [candidate] (599.914 µs) : 0, 600
Telemetry [baseline] (8.816 ms) : 0, 8816
Telemetry [candidate] (8.649 ms) : 0, 8649
section profiling
BytebuddyAgent [baseline] (715.064 ms) : 0, 715064
BytebuddyAgent [candidate] (715.253 ms) : 0, 715253
GlobalTracer [baseline] (350.634 ms) : 0, 350634
GlobalTracer [candidate] (352.441 ms) : 0, 352441
AppSec [baseline] (55.544 ms) : 0, 55544
AppSec [candidate] (54.373 ms) : 0, 54373
Remote Config [baseline] (681.747 µs) : 0, 682
Remote Config [candidate] (678.369 µs) : 0, 678
Telemetry [baseline] (9.012 ms) : 0, 9012
Telemetry [candidate] (9.066 ms) : 0, 9066
ProfilingAgent [baseline] (97.06 ms) : 0, 97060
ProfilingAgent [candidate] (96.733 ms) : 0, 96733
Profiling [baseline] (97.084 ms) : 0, 97084
Profiling [candidate] (96.759 ms) : 0, 96759

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-03-11T17:51:29	2025-03-11T17:59:15
git_branch	master	mhlidd/update_system_tests_hash
git_commit_date	1741707364	1741714757
git_commit_sha	`f8c6b49`	`9577564`
release_version	1.48.0-SNAPSHOT~f8c6b49f18	1.48.0-SNAPSHOT~9577564f7f
start_time	2025-03-11T17:51:15	2025-03-11T17:59:01

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741716353	1741716353
ci_job_id	842955517	842955517
ci_pipeline_id	58465015	58465015
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2wkmbgws-project-304-concurrent-1-cr6e89qm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2wkmbgws-project-304-concurrent-1-cr6e89qm 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section baseline
no_agent (1.358 ms) : 1339, 1377
. : milestone, 1358,
appsec (1.742 ms) : 1718, 1766
. : milestone, 1742,
appsec_no_iast (1.738 ms) : 1712, 1763
. : milestone, 1738,
code_origins (1.696 ms) : 1669, 1723
. : milestone, 1696,
iast (1.518 ms) : 1494, 1542
. : milestone, 1518,
profiling (1.537 ms) : 1512, 1562
. : milestone, 1537,
tracing (1.514 ms) : 1489, 1538
. : milestone, 1514,
section candidate
no_agent (1.354 ms) : 1334, 1375
. : milestone, 1354,
appsec (1.746 ms) : 1723, 1770
. : milestone, 1746,
appsec_no_iast (1.775 ms) : 1750, 1799
. : milestone, 1775,
code_origins (1.676 ms) : 1648, 1703
. : milestone, 1676,
iast (1.52 ms) : 1495, 1545
. : milestone, 1520,
profiling (1.531 ms) : 1508, 1554
. : milestone, 1531,
tracing (1.484 ms) : 1459, 1510
. : milestone, 1484,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.358 ms [1.339 ms, 1.377 ms]	-
appsec	1.742 ms [1.718 ms, 1.766 ms]	383.798 µs (28.3%)
appsec_no_iast	1.738 ms [1.712 ms, 1.763 ms]	379.235 µs (27.9%)
code_origins	1.696 ms [1.669 ms, 1.723 ms]	337.721 µs (24.9%)
iast	1.518 ms [1.494 ms, 1.542 ms]	159.947 µs (11.8%)
profiling	1.537 ms [1.512 ms, 1.562 ms]	178.754 µs (13.2%)
tracing	1.514 ms [1.489 ms, 1.538 ms]	155.485 µs (11.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.334 ms, 1.375 ms]	-
appsec	1.746 ms [1.723 ms, 1.77 ms]	392.11 µs (29.0%)
appsec_no_iast	1.775 ms [1.75 ms, 1.799 ms]	420.433 µs (31.0%)
code_origins	1.676 ms [1.648 ms, 1.703 ms]	321.52 µs (23.7%)
iast	1.52 ms [1.495 ms, 1.545 ms]	165.7 µs (12.2%)
profiling	1.531 ms [1.508 ms, 1.554 ms]	177.003 µs (13.1%)
tracing	1.484 ms [1.459 ms, 1.51 ms]	130.274 µs (9.6%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section baseline
no_agent (394.825 µs) : 375, 415
. : milestone, 395,
iast (513.516 µs) : 492, 535
. : milestone, 514,
iast_FULL (734.871 µs) : 712, 757
. : milestone, 735,
iast_GLOBAL (563.189 µs) : 541, 585
. : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (517.232 µs) : 496, 539
. : milestone, 517,
iast_INACTIVE (465.488 µs) : 444, 487
. : milestone, 465,
iast_TELEMETRY_OFF (503.309 µs) : 481, 525
. : milestone, 503,
tracing (467.033 µs) : 445, 489
. : milestone, 467,
section candidate
no_agent (389.532 µs) : 370, 409
. : milestone, 390,
iast (512.121 µs) : 490, 534
. : milestone, 512,
iast_FULL (729.336 µs) : 707, 751
. : milestone, 729,
iast_GLOBAL (568.028 µs) : 545, 591
. : milestone, 568,
iast_HARDCODED_SECRET_DISABLED (518.012 µs) : 496, 540
. : milestone, 518,
iast_INACTIVE (469.555 µs) : 447, 492
. : milestone, 470,
iast_TELEMETRY_OFF (511.854 µs) : 489, 535
. : milestone, 512,
tracing (466.229 µs) : 444, 488
. : milestone, 466,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	394.825 µs [374.82 µs, 414.831 µs]	-
iast	513.516 µs [491.576 µs, 535.457 µs]	118.691 µs (30.1%)
iast_FULL	734.871 µs [712.465 µs, 757.276 µs]	340.045 µs (86.1%)
iast_GLOBAL	563.189 µs [541.342 µs, 585.035 µs]	168.363 µs (42.6%)
iast_HARDCODED_SECRET_DISABLED	517.232 µs [495.717 µs, 538.748 µs]	122.407 µs (31.0%)
iast_INACTIVE	465.488 µs [444.271 µs, 486.704 µs]	70.662 µs (17.9%)
iast_TELEMETRY_OFF	503.309 µs [481.397 µs, 525.221 µs]	108.484 µs (27.5%)
tracing	467.033 µs [445.138 µs, 488.927 µs]	72.207 µs (18.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	389.532 µs [369.817 µs, 409.247 µs]	-
iast	512.121 µs [490.352 µs, 533.889 µs]	122.589 µs (31.5%)
iast_FULL	729.336 µs [707.389 µs, 751.283 µs]	339.804 µs (87.2%)
iast_GLOBAL	568.028 µs [545.12 µs, 590.935 µs]	178.496 µs (45.8%)
iast_HARDCODED_SECRET_DISABLED	518.012 µs [496.04 µs, 539.985 µs]	128.481 µs (33.0%)
iast_INACTIVE	469.555 µs [446.721 µs, 492.389 µs]	80.023 µs (20.5%)
iast_TELEMETRY_OFF	511.854 µs [489.193 µs, 534.516 µs]	122.323 µs (31.4%)
tracing	466.229 µs [444.32 µs, 488.138 µs]	76.697 µs (19.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mhlidd/update_system_tests_hash
git_commit_date	1741707364	1741714757
git_commit_sha	`f8c6b49`	`9577564`
release_version	1.48.0-SNAPSHOT~f8c6b49f18	1.48.0-SNAPSHOT~9577564f7f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1741716885	1741716885
ci_job_id	842955518	842955518
ci_pipeline_id	58465015	58465015
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2wkmbgws-project-304-concurrent-2-psmz22n4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2wkmbgws-project-304-concurrent-2-psmz22n4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section baseline
no_agent (15.57 s) : 15570000, 15570000
. : milestone, 15570000,
appsec (15.017 s) : 15017000, 15017000
. : milestone, 15017000,
iast (19.091 s) : 19091000, 19091000
. : milestone, 19091000,
iast_GLOBAL (17.626 s) : 17626000, 17626000
. : milestone, 17626000,
profiling (15.173 s) : 15173000, 15173000
. : milestone, 15173000,
tracing (15.082 s) : 15082000, 15082000
. : milestone, 15082000,
section candidate
no_agent (15.209 s) : 15209000, 15209000
. : milestone, 15209000,
appsec (14.977 s) : 14977000, 14977000
. : milestone, 14977000,
iast (18.475 s) : 18475000, 18475000
. : milestone, 18475000,
iast_GLOBAL (17.68 s) : 17680000, 17680000
. : milestone, 17680000,
profiling (15.192 s) : 15192000, 15192000
. : milestone, 15192000,
tracing (14.908 s) : 14908000, 14908000
. : milestone, 14908000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.57 s [15.57 s, 15.57 s]	-
appsec	15.017 s [15.017 s, 15.017 s]	-553.0 ms (-3.6%)
iast	19.091 s [19.091 s, 19.091 s]	3.521 s (22.6%)
iast_GLOBAL	17.626 s [17.626 s, 17.626 s]	2.056 s (13.2%)
profiling	15.173 s [15.173 s, 15.173 s]	-397.0 ms (-2.5%)
tracing	15.082 s [15.082 s, 15.082 s]	-488.0 ms (-3.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.209 s [15.209 s, 15.209 s]	-
appsec	14.977 s [14.977 s, 14.977 s]	-232.0 ms (-1.5%)
iast	18.475 s [18.475 s, 18.475 s]	3.266 s (21.5%)
iast_GLOBAL	17.68 s [17.68 s, 17.68 s]	2.471 s (16.2%)
profiling	15.192 s [15.192 s, 15.192 s]	-17.0 ms (-0.1%)
tracing	14.908 s [14.908 s, 14.908 s]	-301.0 ms (-2.0%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~9577564f7f, baseline=1.48.0-SNAPSHOT~f8c6b49f18
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (2.341 ms) : 2296, 2387
. : milestone, 2341,
iast (2.124 ms) : 2067, 2181
. : milestone, 2124,
iast_GLOBAL (2.162 ms) : 2105, 2219
. : milestone, 2162,
profiling (1.989 ms) : 1943, 2035
. : milestone, 1989,
tracing (1.959 ms) : 1916, 2003
. : milestone, 1959,
section candidate
no_agent (1.47 ms) : 1458, 1481
. : milestone, 1470,
appsec (2.351 ms) : 2306, 2397
. : milestone, 2351,
iast (2.126 ms) : 2069, 2183
. : milestone, 2126,
iast_GLOBAL (2.168 ms) : 2111, 2226
. : milestone, 2168,
profiling (1.976 ms) : 1930, 2021
. : milestone, 1976,
tracing (1.954 ms) : 1910, 1998
. : milestone, 1954,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.459 ms, 1.482 ms]	-
appsec	2.341 ms [2.296 ms, 2.387 ms]	870.417 µs (59.2%)
iast	2.124 ms [2.067 ms, 2.181 ms]	653.259 µs (44.4%)
iast_GLOBAL	2.162 ms [2.105 ms, 2.219 ms]	690.959 µs (47.0%)
profiling	1.989 ms [1.943 ms, 2.035 ms]	518.159 µs (35.2%)
tracing	1.959 ms [1.916 ms, 2.003 ms]	488.524 µs (33.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.458 ms, 1.481 ms]	-
appsec	2.351 ms [2.306 ms, 2.397 ms]	881.53 µs (60.0%)
iast	2.126 ms [2.069 ms, 2.183 ms]	655.816 µs (44.6%)
iast_GLOBAL	2.168 ms [2.111 ms, 2.226 ms]	698.383 µs (47.5%)
profiling	1.976 ms [1.93 ms, 2.021 ms]	505.743 µs (34.4%)
tracing	1.954 ms [1.91 ms, 1.998 ms]	483.811 µs (32.9%)

github-actions · 2025-03-11T19:05:30Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1
9577564

mhlidd marked this pull request as ready for review March 11, 2025 19:05

mhlidd requested a review from a team as a code owner March 11, 2025 19:05

mhlidd requested review from manuel-alvarez-alvarez and nayeem-kamal March 11, 2025 19:05

nayeem-kamal approved these changes Mar 11, 2025
View reviewed changes

mhlidd added comp: testing Testing tag: no release notes Changes to exclude from release notes labels Mar 11, 2025

mhlidd merged commit 3c27cfc into masterMar 11, 2025

mhlidd deleted the mhlidd/update_system_tests_hash branch March 11, 2025 19:07

github-actionsBot added this to the 1.48.0 milestone Mar 11, 2025

mtoffl01 pushed a commit that referenced this pull request Mar 24, 2025
Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 (#8537)
9a4458a

Navigation Menu

Uh oh!

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1 - #8537

Update system-tests to 5aee0ed598fd984344cf0da0048b27bdb2eb4da1#8537
mhlidd merged 1 commit into
masterfrom
mhlidd/update_system_tests_hash

mhlidd commented Mar 11, 2025

Uh oh!

pr-commenterBot commented Mar 11, 2025•
edited
Loading

Uh oh!

github-actionsBot commented Mar 11, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

mhlidd commented Mar 11, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Mar 11, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

github-actionsBot commented Mar 11, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

pr-commenterBot commented Mar 11, 2025•
edited
Loading