Don't skip muzzle and test_published_artifacts for the nightly Gitlab build by randomanderson · Pull Request #8449 · DataDog/dd-trace-java

randomanderson · 2025-02-26T02:56:33Z

What Does This Do

Don't skip muzzle and test_published_artifacts for the nightly Gitlab build

Motivation

Test should run nightly. Skipping them broke the pipeline because required was not also skipped

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-02-26T03:37:55Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	landerson/always-run-gitlab
git_commit_date	1740507766	1740538514
git_commit_sha	`5a2c959`	`d18f83a`
release_version	1.47.0-SNAPSHOT~5a2c959566	1.47.0-SNAPSHOT~d18f83ab18

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740541028	1740541028
ci_job_id	823196149	823196149
ci_pipeline_id	56978174	56978174
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2rtlzjgm-project-304-concurrent-0-cl1ksdg8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2rtlzjgm-project-304-concurrent-0-cl1ksdg8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 4 unstable metrics.

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043628
Total [baseline] (10.43 s) : 0, 10430000
Agent [candidate] (1.045 s) : 0, 1044623
Total [candidate] (10.444 s) : 0, 10444464
section appsec
Agent [baseline] (1.181 s) : 0, 1180645
Total [baseline] (10.74 s) : 0, 10740354
Agent [candidate] (1.189 s) : 0, 1188676
Total [candidate] (10.743 s) : 0, 10742500
section iast
Agent [baseline] (1.172 s) : 0, 1171735
Total [baseline] (10.969 s) : 0, 10969491
Agent [candidate] (1.171 s) : 0, 1170931
Total [candidate] (10.977 s) : 0, 10976645
section profiling
Agent [baseline] (1.264 s) : 0, 1263553
Total [baseline] (10.877 s) : 0, 10876689
Agent [candidate] (1.262 s) : 0, 1261834
Total [candidate] (10.856 s) : 0, 10856494

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.044 s	-
Agent	appsec	1.181 s	137.017 ms (13.1%)
Agent	iast	1.172 s	128.107 ms (12.3%)
Agent	profiling	1.264 s	219.925 ms (21.1%)
Total	tracing	10.43 s	-
Total	appsec	10.74 s	310.354 ms (3.0%)
Total	iast	10.969 s	539.491 ms (5.2%)
Total	profiling	10.877 s	446.689 ms (4.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.045 s	-
Agent	appsec	1.189 s	144.053 ms (13.8%)
Agent	iast	1.171 s	126.308 ms (12.1%)
Agent	profiling	1.262 s	217.211 ms (20.8%)
Total	tracing	10.444 s	-
Total	appsec	10.743 s	298.036 ms (2.9%)
Total	iast	10.977 s	532.181 ms (5.1%)
Total	profiling	10.856 s	412.03 ms (3.9%)

gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.067 ms) : 0, 720067
BytebuddyAgent [candidate] (721.329 ms) : 0, 721329
GlobalTracer [baseline] (239.97 ms) : 0, 239970
GlobalTracer [candidate] (239.971 ms) : 0, 239971
AppSec [baseline] (56.217 ms) : 0, 56217
AppSec [candidate] (56.066 ms) : 0, 56066
Remote Config [baseline] (715.46 µs) : 0, 715
Remote Config [candidate] (706.117 µs) : 0, 706
Telemetry [baseline] (11.645 ms) : 0, 11645
Telemetry [candidate] (11.595 ms) : 0, 11595
section appsec
BytebuddyAgent [baseline] (733.543 ms) : 0, 733543
BytebuddyAgent [candidate] (739.032 ms) : 0, 739032
GlobalTracer [baseline] (235.674 ms) : 0, 235674
GlobalTracer [candidate] (237.329 ms) : 0, 237329
AppSec [baseline] (176.758 ms) : 0, 176758
AppSec [candidate] (177.437 ms) : 0, 177437
Remote Config [baseline] (665.228 µs) : 0, 665
Remote Config [candidate] (666.601 µs) : 0, 667
Telemetry [baseline] (8.278 ms) : 0, 8278
Telemetry [candidate] (8.362 ms) : 0, 8362
IAST [baseline] (21.599 ms) : 0, 21599
IAST [candidate] (21.804 ms) : 0, 21804
section iast
BytebuddyAgent [baseline] (837.303 ms) : 0, 837303
BytebuddyAgent [candidate] (836.573 ms) : 0, 836573
GlobalTracer [baseline] (230.141 ms) : 0, 230141
GlobalTracer [candidate] (230.25 ms) : 0, 230250
AppSec [baseline] (57.17 ms) : 0, 57170
AppSec [candidate] (56.979 ms) : 0, 56979
Remote Config [baseline] (618.274 µs) : 0, 618
Remote Config [candidate] (619.91 µs) : 0, 620
Telemetry [baseline] (8.712 ms) : 0, 8712
Telemetry [candidate] (8.735 ms) : 0, 8735
IAST [baseline] (22.786 ms) : 0, 22786
IAST [candidate] (22.798 ms) : 0, 22798
section profiling
BytebuddyAgent [baseline] (710.145 ms) : 0, 710145
BytebuddyAgent [candidate] (709.963 ms) : 0, 709963
GlobalTracer [baseline] (350.782 ms) : 0, 350782
GlobalTracer [candidate] (350.525 ms) : 0, 350525
AppSec [baseline] (55.871 ms) : 0, 55871
AppSec [candidate] (54.872 ms) : 0, 54872
Remote Config [baseline] (690.875 µs) : 0, 691
Remote Config [candidate] (675.489 µs) : 0, 675
Telemetry [baseline] (9.018 ms) : 0, 9018
Telemetry [candidate] (9.056 ms) : 0, 9056
ProfilingAgent [baseline] (96.704 ms) : 0, 96704
ProfilingAgent [candidate] (96.342 ms) : 0, 96342
Profiling [baseline] (96.728 ms) : 0, 96728
Profiling [candidate] (96.366 ms) : 0, 96366

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.047 s) : 0, 1046599
Total [baseline] (8.697 s) : 0, 8697253
Agent [candidate] (1.041 s) : 0, 1040815
Total [candidate] (8.664 s) : 0, 8664475
section iast
Agent [baseline] (1.17 s) : 0, 1169721
Total [baseline] (9.21 s) : 0, 9210418
Agent [candidate] (1.176 s) : 0, 1176496
Total [candidate] (9.251 s) : 0, 9251026
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.17 s) : 0, 1170091
Total [baseline] (9.203 s) : 0, 9203267
Agent [candidate] (1.172 s) : 0, 1171532
Total [candidate] (9.201 s) : 0, 9200503
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1165837
Total [baseline] (9.228 s) : 0, 9228334
Agent [candidate] (1.166 s) : 0, 1165741
Total [candidate] (9.243 s) : 0, 9243425

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.047 s	-
Agent	iast	1.17 s	123.122 ms (11.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.17 s	123.492 ms (11.8%)
Agent	iast_TELEMETRY_OFF	1.166 s	119.238 ms (11.4%)
Total	tracing	8.697 s	-
Total	iast	9.21 s	513.166 ms (5.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.203 s	506.014 ms (5.8%)
Total	iast_TELEMETRY_OFF	9.228 s	531.081 ms (6.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.041 s	-
Agent	iast	1.176 s	135.681 ms (13.0%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.172 s	130.716 ms (12.6%)
Agent	iast_TELEMETRY_OFF	1.166 s	124.926 ms (12.0%)
Total	tracing	8.664 s	-
Total	iast	9.251 s	586.552 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.201 s	536.029 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.243 s	578.951 ms (6.7%)

gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.187 ms) : 0, 722187
BytebuddyAgent [candidate] (716.424 ms) : 0, 716424
GlobalTracer [baseline] (240.319 ms) : 0, 240319
GlobalTracer [candidate] (238.887 ms) : 0, 238887
AppSec [baseline] (56.837 ms) : 0, 56837
AppSec [candidate] (55.642 ms) : 0, 55642
Remote Config [baseline] (715.52 µs) : 0, 716
Remote Config [candidate] (702.81 µs) : 0, 703
Telemetry [baseline] (11.505 ms) : 0, 11505
Telemetry [candidate] (14.324 ms) : 0, 14324
section iast
BytebuddyAgent [baseline] (835.968 ms) : 0, 835968
BytebuddyAgent [candidate] (842.256 ms) : 0, 842256
GlobalTracer [baseline] (229.713 ms) : 0, 229713
GlobalTracer [candidate] (229.774 ms) : 0, 229774
AppSec [baseline] (56.855 ms) : 0, 56855
AppSec [candidate] (57.343 ms) : 0, 57343
Remote Config [baseline] (615.964 µs) : 0, 616
Remote Config [candidate] (620.204 µs) : 0, 620
Telemetry [baseline] (8.733 ms) : 0, 8733
Telemetry [candidate] (8.742 ms) : 0, 8742
IAST [baseline] (22.91 ms) : 0, 22910
IAST [candidate] (22.71 ms) : 0, 22710
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.832 ms) : 0, 834832
BytebuddyAgent [candidate] (836.518 ms) : 0, 836518
GlobalTracer [baseline] (230.527 ms) : 0, 230527
GlobalTracer [candidate] (229.897 ms) : 0, 229897
AppSec [baseline] (57.437 ms) : 0, 57437
AppSec [candidate] (57.486 ms) : 0, 57486
Remote Config [baseline] (624.997 µs) : 0, 625
Remote Config [candidate] (621.652 µs) : 0, 622
Telemetry [baseline] (8.835 ms) : 0, 8835
Telemetry [candidate] (8.809 ms) : 0, 8809
IAST [baseline] (22.91 ms) : 0, 22910
IAST [candidate] (23.172 ms) : 0, 23172
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.264 ms) : 0, 833264
BytebuddyAgent [candidate] (833.28 ms) : 0, 833280
GlobalTracer [baseline] (229.731 ms) : 0, 229731
GlobalTracer [candidate] (229.79 ms) : 0, 229790
AppSec [baseline] (53.501 ms) : 0, 53501
AppSec [candidate] (55.085 ms) : 0, 55085
Remote Config [baseline] (618.75 µs) : 0, 619
Remote Config [candidate] (609.732 µs) : 0, 610
Telemetry [baseline] (8.551 ms) : 0, 8551
Telemetry [candidate] (8.463 ms) : 0, 8463
IAST [baseline] (25.291 ms) : 0, 25291
IAST [candidate] (23.576 ms) : 0, 23576

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-02-26T03:07:23	2025-02-26T03:15:05
git_branch	master	landerson/always-run-gitlab
git_commit_date	1740507766	1740538514
git_commit_sha	`5a2c959`	`d18f83a`
release_version	1.47.0-SNAPSHOT~5a2c959566	1.47.0-SNAPSHOT~d18f83ab18
start_time	2025-02-26T03:07:09	2025-02-26T03:14:52

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1740540103	1740540103
ci_job_id	823196150	823196150
ci_pipeline_id	56978174	56978174
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2rtlzjgm-project-304-concurrent-1-zvxmplty 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2rtlzjgm-project-304-concurrent-1-zvxmplty 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section baseline
no_agent (379.157 µs) : 359, 399
. : milestone, 379,
iast (507.654 µs) : 486, 529
. : milestone, 508,
iast_FULL (727.888 µs) : 706, 750
. : milestone, 728,
iast_GLOBAL (552.035 µs) : 530, 574
. : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (505.476 µs) : 484, 527
. : milestone, 505,
iast_INACTIVE (462.589 µs) : 441, 484
. : milestone, 463,
iast_TELEMETRY_OFF (498.506 µs) : 475, 522
. : milestone, 499,
tracing (455.72 µs) : 435, 477
. : milestone, 456,
section candidate
no_agent (375.994 µs) : 355, 397
. : milestone, 376,
iast (504.012 µs) : 482, 526
. : milestone, 504,
iast_FULL (724.054 µs) : 702, 746
. : milestone, 724,
iast_GLOBAL (555.812 µs) : 534, 577
. : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (508.101 µs) : 486, 530
. : milestone, 508,
iast_INACTIVE (463.611 µs) : 442, 485
. : milestone, 464,
iast_TELEMETRY_OFF (496.539 µs) : 473, 520
. : milestone, 497,
tracing (454.239 µs) : 433, 475
. : milestone, 454,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.157 µs [359.431 µs, 398.884 µs]	-
iast	507.654 µs [486.189 µs, 529.119 µs]	128.497 µs (33.9%)
iast_FULL	727.888 µs [705.676 µs, 750.101 µs]	348.731 µs (92.0%)
iast_GLOBAL	552.035 µs [530.264 µs, 573.805 µs]	172.877 µs (45.6%)
iast_HARDCODED_SECRET_DISABLED	505.476 µs [483.846 µs, 527.106 µs]	126.319 µs (33.3%)
iast_INACTIVE	462.589 µs [440.76 µs, 484.419 µs]	83.432 µs (22.0%)
iast_TELEMETRY_OFF	498.506 µs [474.774 µs, 522.238 µs]	119.349 µs (31.5%)
tracing	455.72 µs [434.705 µs, 476.736 µs]	76.563 µs (20.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	375.994 µs [355.171 µs, 396.816 µs]	-
iast	504.012 µs [481.676 µs, 526.347 µs]	128.018 µs (34.0%)
iast_FULL	724.054 µs [702.364 µs, 745.744 µs]	348.061 µs (92.6%)
iast_GLOBAL	555.812 µs [534.152 µs, 577.471 µs]	179.818 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED	508.101 µs [485.759 µs, 530.444 µs]	132.108 µs (35.1%)
iast_INACTIVE	463.611 µs [442.345 µs, 484.877 µs]	87.618 µs (23.3%)
iast_TELEMETRY_OFF	496.539 µs [473.229 µs, 519.849 µs]	120.546 µs (32.1%)
tracing	454.239 µs [433.167 µs, 475.31 µs]	78.245 µs (20.8%)

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1364
. : milestone, 1345,
appsec (1.76 ms) : 1737, 1784
. : milestone, 1760,
appsec_no_iast (1.766 ms) : 1742, 1790
. : milestone, 1766,
code_origins (1.68 ms) : 1647, 1713
. : milestone, 1680,
iast (1.519 ms) : 1495, 1542
. : milestone, 1519,
profiling (1.49 ms) : 1466, 1513
. : milestone, 1490,
tracing (1.488 ms) : 1463, 1513
. : milestone, 1488,
section candidate
no_agent (1.352 ms) : 1332, 1371
. : milestone, 1352,
appsec (1.769 ms) : 1746, 1793
. : milestone, 1769,
appsec_no_iast (1.768 ms) : 1744, 1792
. : milestone, 1768,
code_origins (1.705 ms) : 1673, 1738
. : milestone, 1705,
iast (1.5 ms) : 1475, 1524
. : milestone, 1500,
profiling (1.519 ms) : 1496, 1542
. : milestone, 1519,
tracing (1.483 ms) : 1458, 1507
. : milestone, 1483,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.345 ms [1.326 ms, 1.364 ms]	-
appsec	1.76 ms [1.737 ms, 1.784 ms]	415.395 µs (30.9%)
appsec_no_iast	1.766 ms [1.742 ms, 1.79 ms]	421.346 µs (31.3%)
code_origins	1.68 ms [1.647 ms, 1.713 ms]	334.786 µs (24.9%)
iast	1.519 ms [1.495 ms, 1.542 ms]	173.613 µs (12.9%)
profiling	1.49 ms [1.466 ms, 1.513 ms]	144.787 µs (10.8%)
tracing	1.488 ms [1.463 ms, 1.513 ms]	143.082 µs (10.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.352 ms [1.332 ms, 1.371 ms]	-
appsec	1.769 ms [1.746 ms, 1.793 ms]	417.729 µs (30.9%)
appsec_no_iast	1.768 ms [1.744 ms, 1.792 ms]	416.635 µs (30.8%)
code_origins	1.705 ms [1.673 ms, 1.738 ms]	353.731 µs (26.2%)
iast	1.5 ms [1.475 ms, 1.524 ms]	147.958 µs (10.9%)
profiling	1.519 ms [1.496 ms, 1.542 ms]	167.05 µs (12.4%)
tracing	1.483 ms [1.458 ms, 1.507 ms]	131.045 µs (9.7%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	landerson/always-run-gitlab
git_commit_date	1740507766	1740538514
git_commit_sha	`5a2c959`	`d18f83a`
release_version	1.47.0-SNAPSHOT~5a2c959566	1.47.0-SNAPSHOT~d18f83ab18

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1740540597	1740540597
ci_job_id	823196151	823196151
ci_pipeline_id	56978174	56978174
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-2rtlzjgm-project-304-concurrent-2-y757y52l 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-2rtlzjgm-project-304-concurrent-2-y757y52l 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section baseline
no_agent (14.954 s) : 14954000, 14954000
. : milestone, 14954000,
appsec (14.957 s) : 14957000, 14957000
. : milestone, 14957000,
iast (19.043 s) : 19043000, 19043000
. : milestone, 19043000,
iast_GLOBAL (17.761 s) : 17761000, 17761000
. : milestone, 17761000,
profiling (15.615 s) : 15615000, 15615000
. : milestone, 15615000,
tracing (15.01 s) : 15010000, 15010000
. : milestone, 15010000,
section candidate
no_agent (14.972 s) : 14972000, 14972000
. : milestone, 14972000,
appsec (15.107 s) : 15107000, 15107000
. : milestone, 15107000,
iast (18.977 s) : 18977000, 18977000
. : milestone, 18977000,
iast_GLOBAL (18.06 s) : 18060000, 18060000
. : milestone, 18060000,
profiling (15.433 s) : 15433000, 15433000
. : milestone, 15433000,
tracing (14.831 s) : 14831000, 14831000
. : milestone, 14831000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.954 s [14.954 s, 14.954 s]	-
appsec	14.957 s [14.957 s, 14.957 s]	3.0 ms (0.0%)
iast	19.043 s [19.043 s, 19.043 s]	4.089 s (27.3%)
iast_GLOBAL	17.761 s [17.761 s, 17.761 s]	2.807 s (18.8%)
profiling	15.615 s [15.615 s, 15.615 s]	661.0 ms (4.4%)
tracing	15.01 s [15.01 s, 15.01 s]	56.0 ms (0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.972 s [14.972 s, 14.972 s]	-
appsec	15.107 s [15.107 s, 15.107 s]	135.0 ms (0.9%)
iast	18.977 s [18.977 s, 18.977 s]	4.005 s (26.7%)
iast_GLOBAL	18.06 s [18.06 s, 18.06 s]	3.088 s (20.6%)
profiling	15.433 s [15.433 s, 15.433 s]	461.0 ms (3.1%)
tracing	14.831 s [14.831 s, 14.831 s]	-141.0 ms (-0.9%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~d18f83ab18, baseline=1.47.0-SNAPSHOT~5a2c959566
dateFormat X
axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
. : milestone, 1470,
appsec (2.37 ms) : 2326, 2413
. : milestone, 2370,
iast (2.11 ms) : 2055, 2165
. : milestone, 2110,
iast_GLOBAL (2.157 ms) : 2101, 2212
. : milestone, 2157,
profiling (2.422 ms) : 2254, 2591
. : milestone, 2422,
tracing (1.95 ms) : 1908, 1992
. : milestone, 1950,
section candidate
no_agent (1.472 ms) : 1461, 1483
. : milestone, 1472,
appsec (2.359 ms) : 2316, 2402
. : milestone, 2359,
iast (2.112 ms) : 2058, 2167
. : milestone, 2112,
iast_GLOBAL (2.15 ms) : 2094, 2205
. : milestone, 2150,
profiling (1.973 ms) : 1929, 2017
. : milestone, 1973,
tracing (1.957 ms) : 1914, 1999
. : milestone, 1957,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.47 ms [1.459 ms, 1.482 ms]	-
appsec	2.37 ms [2.326 ms, 2.413 ms]	899.665 µs (61.2%)
iast	2.11 ms [2.055 ms, 2.165 ms]	639.909 µs (43.5%)
iast_GLOBAL	2.157 ms [2.101 ms, 2.212 ms]	686.336 µs (46.7%)
profiling	2.422 ms [2.254 ms, 2.591 ms]	952.061 µs (64.8%)
tracing	1.95 ms [1.908 ms, 1.992 ms]	479.569 µs (32.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.483 ms]	-
appsec	2.359 ms [2.316 ms, 2.402 ms]	887.395 µs (60.3%)
iast	2.112 ms [2.058 ms, 2.167 ms]	640.282 µs (43.5%)
iast_GLOBAL	2.15 ms [2.094 ms, 2.205 ms]	677.569 µs (46.0%)
profiling	1.973 ms [1.929 ms, 2.017 ms]	500.835 µs (34.0%)
tracing	1.957 ms [1.914 ms, 1.999 ms]	484.717 µs (32.9%)

Don't skip muzzle and test_published_artifacts for the nightly
d18f83a

randomanderson added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Feb 26, 2025

randomanderson requested a review from a team as a code owner February 26, 2025 02:56

randomanderson requested a review from mcculls February 26, 2025 02:56

randomanderson enabled auto-merge (squash) February 26, 2025 13:51

mcculls approved these changes Feb 28, 2025
View reviewed changes

randomanderson merged commit 08e0fa3 into masterFeb 28, 2025

randomanderson deleted the landerson/always-run-gitlab branch February 28, 2025 12:09

github-actionsBot added this to the 1.47.0 milestone Feb 28, 2025

Navigation Menu

Uh oh!

Don't skip muzzle and test_published_artifacts for the nightly Gitlab build - #8449

Don't skip muzzle and test_published_artifacts for the nightly Gitlab build#8449
randomanderson merged 1 commit into
masterfrom
landerson/always-run-gitlab

randomanderson commented Feb 26, 2025

Uh oh!

pr-commenterBot commented Feb 26, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

randomanderson commented Feb 26, 2025

What Does This Do

Motivation

Contributor Checklist

Uh oh!

pr-commenterBot commented Feb 26, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants