Skip to content

Increase again Maven smoke tests timeout - #8997

Merged
bric3 merged 1 commit into
masterfrom
increase-again-maven-smoke-test-timeout
Jun 17, 2025
Merged

Increase again Maven smoke tests timeout#8997
bric3 merged 1 commit into
masterfrom
increase-again-maven-smoke-test-timeout

Conversation

@bric3

Copy link
Copy Markdown
Contributor

What Does This Do

Bumps the command timeout to 120s. Follow up to #8993.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@bric3
bric3 requested a review from a team as a code ownerJune 16, 2025 19:19
@bric3
bric3 requested a review from MariovidoJune 16, 2025 19:19
@github-actions

github-actionsBot commented Jun 16, 2025

Copy link
Copy Markdown
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@bric3
bric3force-pushed the increase-again-maven-smoke-test-timeout branch from ad9052e to ed8bcb6CompareJune 16, 2025 19:20
@pr-commenter

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterincrease-again-maven-smoke-test-timeout
git_commit_date17501016161750101648
git_commit_sha3e93f43ed8bcb6
release_version1.50.0-SNAPSHOT~3e93f43e631.50.0-SNAPSHOT~ed8bcb6aa6
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17501038201750103820
ci_job_id984490156984490156
ci_pipeline_id6790336167903361
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-z87jatgw-project-304-concurrent-0-6qebyjgm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-z87jatgw-project-304-concurrent-0-6qebyjgm 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone
variantiastiast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1038940
Total [baseline] (8.561 s) : 0, 8560933
Agent [candidate] (1.027 s) : 0, 1026617
Total [candidate] (8.548 s) : 0, 8548219
section iast
Agent [baseline] (1.172 s) : 0, 1171648
Total [baseline] (9.273 s) : 0, 9272878
Agent [candidate] (1.156 s) : 0, 1156433
Total [candidate] (9.233 s) : 0, 9232954
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.153 s) : 0, 1153383
Total [baseline] (9.175 s) : 0, 9175209
Agent [candidate] (1.153 s) : 0, 1153074
Total [candidate] (9.193 s) : 0, 9193422
section iast_TELEMETRY_OFF
Agent [baseline] (1.153 s) : 0, 1153142
Total [baseline] (9.244 s) : 0, 9243880
Agent [candidate] (1.16 s) : 0, 1160155
Total [candidate] (9.224 s) : 0, 9224050
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.039 s-
Agentiast1.172 s132.708 ms (12.8%)
Agentiast_HARDCODED_SECRET_DISABLED1.153 s114.444 ms (11.0%)
Agentiast_TELEMETRY_OFF1.153 s114.202 ms (11.0%)
Totaltracing8.561 s-
Totaliast9.273 s711.946 ms (8.3%)
Totaliast_HARDCODED_SECRET_DISABLED9.175 s614.276 ms (7.2%)
Totaliast_TELEMETRY_OFF9.244 s682.948 ms (8.0%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.027 s-
Agentiast1.156 s129.816 ms (12.6%)
Agentiast_HARDCODED_SECRET_DISABLED1.153 s126.457 ms (12.3%)
Agentiast_TELEMETRY_OFF1.16 s133.538 ms (13.0%)
Totaltracing8.548 s-
Totaliast9.233 s684.734 ms (8.0%)
Totaliast_HARDCODED_SECRET_DISABLED9.193 s645.203 ms (7.5%)
Totaliast_TELEMETRY_OFF9.224 s675.831 ms (7.9%)
gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.677 ms) : 0, 692677
BytebuddyAgent [candidate] (684.464 ms) : 0, 684464
GlobalTracer [baseline] (242.363 ms) : 0, 242363
GlobalTracer [candidate] (241.559 ms) : 0, 241559
AppSec [baseline] (60.327 ms) : 0, 60327
AppSec [candidate] (60.475 ms) : 0, 60475
Debugger [baseline] (6.269 ms) : 0, 6269
Debugger [candidate] (6.127 ms) : 0, 6127
Remote Config [baseline] (766.446 µs) : 0, 766
Remote Config [candidate] (739.766 µs) : 0, 740
Telemetry [baseline] (12.755 ms) : 0, 12755
Telemetry [candidate] (9.824 ms) : 0, 9824
section iast
BytebuddyAgent [baseline] (816.694 ms) : 0, 816694
BytebuddyAgent [candidate] (804.934 ms) : 0, 804934
GlobalTracer [baseline] (234.052 ms) : 0, 234052
GlobalTracer [candidate] (231.379 ms) : 0, 231379
IAST [baseline] (29.801 ms) : 0, 29801
IAST [candidate] (26.269 ms) : 0, 26269
AppSec [baseline] (52.736 ms) : 0, 52736
AppSec [candidate] (55.795 ms) : 0, 55795
Debugger [baseline] (6.088 ms) : 0, 6088
Debugger [candidate] (6.046 ms) : 0, 6046
Remote Config [baseline] (611.141 µs) : 0, 611
Remote Config [candidate] (608.977 µs) : 0, 609
Telemetry [baseline] (8.027 ms) : 0, 8027
Telemetry [candidate] (8.003 ms) : 0, 8003
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.579 ms) : 0, 802579
BytebuddyAgent [candidate] (802.272 ms) : 0, 802272
GlobalTracer [baseline] (231.16 ms) : 0, 231160
GlobalTracer [candidate] (230.995 ms) : 0, 230995
IAST [baseline] (27.777 ms) : 0, 27777
IAST [candidate] (26.082 ms) : 0, 26082
AppSec [baseline] (53.879 ms) : 0, 53879
AppSec [candidate] (55.89 ms) : 0, 55890
Debugger [baseline] (5.988 ms) : 0, 5988
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (592.605 µs) : 0, 593
Remote Config [candidate] (588.543 µs) : 0, 589
Telemetry [baseline] (7.935 ms) : 0, 7935
Telemetry [candidate] (7.87 ms) : 0, 7870
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (801.414 ms) : 0, 801414
BytebuddyAgent [candidate] (808.103 ms) : 0, 808103
GlobalTracer [baseline] (232.095 ms) : 0, 232095
GlobalTracer [candidate] (232.947 ms) : 0, 232947
IAST [baseline] (29.759 ms) : 0, 29759
IAST [candidate] (28.168 ms) : 0, 28168
AppSec [baseline] (51.765 ms) : 0, 51765
AppSec [candidate] (52.228 ms) : 0, 52228
Debugger [baseline] (6.079 ms) : 0, 6079
Debugger [candidate] (6.068 ms) : 0, 6068
Remote Config [baseline] (605.398 µs) : 0, 605
Remote Config [candidate] (588.332 µs) : 0, 588
Telemetry [baseline] (7.967 ms) : 0, 7967
Telemetry [candidate] (7.769 ms) : 0, 7769
Loading
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.028 s) : 0, 1028407
Total [baseline] (10.684 s) : 0, 10684221
Agent [candidate] (1.027 s) : 0, 1026848
Total [candidate] (10.648 s) : 0, 10648249
section appsec
Agent [baseline] (1.182 s) : 0, 1182055
Total [baseline] (10.707 s) : 0, 10706649
Agent [candidate] (1.18 s) : 0, 1180499
Total [candidate] (10.707 s) : 0, 10707161
section iast
Agent [baseline] (1.166 s) : 0, 1165912
Total [baseline] (10.892 s) : 0, 10891665
Agent [candidate] (1.157 s) : 0, 1157326
Total [candidate] (10.911 s) : 0, 10910745
section profiling
Agent [baseline] (1.289 s) : 0, 1288548
Total [baseline] (11.172 s) : 0, 11171731
Agent [candidate] (1.269 s) : 0, 1269383
Total [candidate] (10.917 s) : 0, 10916833
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.028 s-
Agentappsec1.182 s153.647 ms (14.9%)
Agentiast1.166 s137.504 ms (13.4%)
Agentprofiling1.289 s260.141 ms (25.3%)
Totaltracing10.684 s-
Totalappsec10.707 s22.429 ms (0.2%)
Totaliast10.892 s207.444 ms (1.9%)
Totalprofiling11.172 s487.51 ms (4.6%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.027 s-
Agentappsec1.18 s153.651 ms (15.0%)
Agentiast1.157 s130.478 ms (12.7%)
Agentprofiling1.269 s242.534 ms (23.6%)
Totaltracing10.648 s-
Totalappsec10.707 s58.912 ms (0.6%)
Totaliast10.911 s262.495 ms (2.5%)
Totalprofiling10.917 s268.584 ms (2.5%)
gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.895 ms) : 0, 684895
BytebuddyAgent [candidate] (684.912 ms) : 0, 684912
GlobalTracer [baseline] (242.483 ms) : 0, 242483
GlobalTracer [candidate] (241.471 ms) : 0, 241471
AppSec [baseline] (60.731 ms) : 0, 60731
AppSec [candidate] (59.675 ms) : 0, 59675
Debugger [baseline] (6.871 ms) : 0, 6871
Debugger [candidate] (6.81 ms) : 0, 6810
Remote Config [baseline] (747.699 µs) : 0, 748
Remote Config [candidate] (751.36 µs) : 0, 751
Telemetry [baseline] (9.035 ms) : 0, 9035
Telemetry [candidate] (9.695 ms) : 0, 9695
section appsec
BytebuddyAgent [baseline] (707.359 ms) : 0, 707359
BytebuddyAgent [candidate] (707.135 ms) : 0, 707135
GlobalTracer [baseline] (235.917 ms) : 0, 235917
GlobalTracer [candidate] (235.45 ms) : 0, 235450
IAST [baseline] (21.772 ms) : 0, 21772
IAST [candidate] (21.758 ms) : 0, 21758
AppSec [baseline] (179.62 ms) : 0, 179620
AppSec [candidate] (178.918 ms) : 0, 178918
Debugger [baseline] (5.904 ms) : 0, 5904
Debugger [candidate] (5.861 ms) : 0, 5861
Remote Config [baseline] (612.24 µs) : 0, 612
Remote Config [candidate] (611.191 µs) : 0, 611
Telemetry [baseline] (7.335 ms) : 0, 7335
Telemetry [candidate] (7.282 ms) : 0, 7282
section iast
BytebuddyAgent [baseline] (812.165 ms) : 0, 812165
BytebuddyAgent [candidate] (804.949 ms) : 0, 804949
GlobalTracer [baseline] (233.301 ms) : 0, 233301
GlobalTracer [candidate] (231.995 ms) : 0, 231995
IAST [baseline] (28.959 ms) : 0, 28959
IAST [candidate] (26.909 ms) : 0, 26909
AppSec [baseline] (53.339 ms) : 0, 53339
AppSec [candidate] (55.204 ms) : 0, 55204
Debugger [baseline] (5.995 ms) : 0, 5995
Debugger [candidate] (6.098 ms) : 0, 6098
Remote Config [baseline] (594.612 µs) : 0, 595
Remote Config [candidate] (607.771 µs) : 0, 608
Telemetry [baseline] (7.922 ms) : 0, 7922
Telemetry [candidate] (7.992 ms) : 0, 7992
section profiling
BytebuddyAgent [baseline] (684.684 ms) : 0, 684684
BytebuddyAgent [candidate] (674.662 ms) : 0, 674662
GlobalTracer [baseline] (364.703 ms) : 0, 364703
GlobalTracer [candidate] (359.762 ms) : 0, 359762
AppSec [baseline] (64.906 ms) : 0, 64906
AppSec [candidate] (64.54 ms) : 0, 64540
Debugger [baseline] (6.179 ms) : 0, 6179
Debugger [candidate] (6.194 ms) : 0, 6194
Remote Config [baseline] (656.865 µs) : 0, 657
Remote Config [candidate] (647.055 µs) : 0, 647
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.182 ms) : 0, 8182
ProfilingAgent [baseline] (107.776 ms) : 0, 107776
ProfilingAgent [candidate] (104.536 ms) : 0, 104536
Profiling [baseline] (107.801 ms) : 0, 107801
Profiling [candidate] (104.56 ms) : 0, 104560
Loading

Load

Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section baseline
no_agent (12.484 ms) : 12370, 12599
. : milestone, 12484,
appsec (73.323 ms) : 72326, 74319
. : milestone, 73323,
code_origins (88.693 ms) : 86949, 90438
. : milestone, 88693,
iast (81.615 ms) : 80383, 82847
. : milestone, 81615,
profiling (64.228 ms) : 63343, 65113
. : milestone, 64228,
tracing (53.829 ms) : 53021, 54637
. : milestone, 53829,
section candidate
no_agent (12.22 ms) : 12111, 12329
. : milestone, 12220,
appsec (64.948 ms) : 63736, 66160
. : milestone, 64948,
code_origins (79.976 ms) : 77284, 82667
. : milestone, 79976,
iast (73.637 ms) : 71995, 75278
. : milestone, 73637,
profiling (56.732 ms) : 55740, 57724
. : milestone, 56732,
tracing (48.263 ms) : 47470, 49056
. : milestone, 48263,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent12.484 ms [12.37 ms, 12.599 ms]-
appsec73.323 ms [72.326 ms, 74.319 ms]60.839 ms (487.3%)
code_origins88.693 ms [86.949 ms, 90.438 ms]76.209 ms (610.4%)
iast81.615 ms [80.383 ms, 82.847 ms]69.131 ms (553.8%)
profiling64.228 ms [63.343 ms, 65.113 ms]51.744 ms (414.5%)
tracing53.829 ms [53.021 ms, 54.637 ms]41.345 ms (331.2%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent12.22 ms [12.111 ms, 12.329 ms]-
appsec64.948 ms [63.736 ms, 66.16 ms]52.729 ms (431.5%)
code_origins79.976 ms [77.284 ms, 82.667 ms]67.756 ms (554.5%)
iast73.637 ms [71.995 ms, 75.278 ms]61.417 ms (502.6%)
profiling56.732 ms [55.74 ms, 57.724 ms]44.513 ms (364.3%)
tracing48.263 ms [47.47 ms, 49.056 ms]36.043 ms (295.0%)

Dacapo

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterincrease-again-maven-smoke-test-timeout
git_commit_date17501016161750101648
git_commit_sha3e93f43ed8bcb6
release_version1.50.0-SNAPSHOT~3e93f43e631.50.0-SNAPSHOT~ed8bcb6aa6
See matching parameters
BaselineCandidate
applicationbiojavabiojava
ci_job_date17501036511750103651
ci_job_id984490160984490160
ci_pipeline_id6790336167903361
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-z87jatgw-project-304-concurrent-2-n7wn9sd8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-z87jatgw-project-304-concurrent-2-n7wn9sd8 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variantappsecappsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (2.412 ms) : 2363, 2461
. : milestone, 2412,
iast (2.202 ms) : 2141, 2263
. : milestone, 2202,
iast_GLOBAL (2.243 ms) : 2181, 2304
. : milestone, 2243,
profiling (2.062 ms) : 2011, 2113
. : milestone, 2062,
tracing (2.023 ms) : 1975, 2070
. : milestone, 2023,
section candidate
no_agent (1.484 ms) : 1473, 1496
. : milestone, 1484,
appsec (2.416 ms) : 2367, 2464
. : milestone, 2416,
iast (2.196 ms) : 2135, 2258
. : milestone, 2196,
iast_GLOBAL (2.239 ms) : 2178, 2300
. : milestone, 2239,
profiling (2.039 ms) : 1990, 2088
. : milestone, 2039,
tracing (2.008 ms) : 1960, 2055
. : milestone, 2008,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.478 ms [1.466 ms, 1.489 ms]-
appsec2.412 ms [2.363 ms, 2.461 ms]934.644 µs (63.3%)
iast2.202 ms [2.141 ms, 2.263 ms]724.976 µs (49.1%)
iast_GLOBAL2.243 ms [2.181 ms, 2.304 ms]765.181 µs (51.8%)
profiling2.062 ms [2.011 ms, 2.113 ms]584.481 µs (39.6%)
tracing2.023 ms [1.975 ms, 2.07 ms]545.154 µs (36.9%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.484 ms [1.473 ms, 1.496 ms]-
appsec2.416 ms [2.367 ms, 2.464 ms]931.328 µs (62.7%)
iast2.196 ms [2.135 ms, 2.258 ms]712.072 µs (48.0%)
iast_GLOBAL2.239 ms [2.178 ms, 2.3 ms]754.544 µs (50.8%)
profiling2.039 ms [1.99 ms, 2.088 ms]554.763 µs (37.4%)
tracing2.008 ms [1.96 ms, 2.055 ms]523.146 µs (35.2%)
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ed8bcb6aa6, baseline=1.50.0-SNAPSHOT~3e93f43e63
dateFormat X
axisFormat %s
section baseline
no_agent (14.958 s) : 14958000, 14958000
. : milestone, 14958000,
appsec (14.647 s) : 14647000, 14647000
. : milestone, 14647000,
iast (18.743 s) : 18743000, 18743000
. : milestone, 18743000,
iast_GLOBAL (17.93 s) : 17930000, 17930000
. : milestone, 17930000,
profiling (15.616 s) : 15616000, 15616000
. : milestone, 15616000,
tracing (14.943 s) : 14943000, 14943000
. : milestone, 14943000,
section candidate
no_agent (15.513 s) : 15513000, 15513000
. : milestone, 15513000,
appsec (14.83 s) : 14830000, 14830000
. : milestone, 14830000,
iast (18.783 s) : 18783000, 18783000
. : milestone, 18783000,
iast_GLOBAL (18.015 s) : 18015000, 18015000
. : milestone, 18015000,
profiling (15.099 s) : 15099000, 15099000
. : milestone, 15099000,
tracing (14.959 s) : 14959000, 14959000
. : milestone, 14959000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent14.958 s [14.958 s, 14.958 s]-
appsec14.647 s [14.647 s, 14.647 s]-311.0 ms (-2.1%)
iast18.743 s [18.743 s, 18.743 s]3.785 s (25.3%)
iast_GLOBAL17.93 s [17.93 s, 17.93 s]2.972 s (19.9%)
profiling15.616 s [15.616 s, 15.616 s]658.0 ms (4.4%)
tracing14.943 s [14.943 s, 14.943 s]-15.0 ms (-0.1%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.513 s [15.513 s, 15.513 s]-
appsec14.83 s [14.83 s, 14.83 s]-683.0 ms (-4.4%)
iast18.783 s [18.783 s, 18.783 s]3.27 s (21.1%)
iast_GLOBAL18.015 s [18.015 s, 18.015 s]2.502 s (16.1%)
profiling15.099 s [15.099 s, 15.099 s]-414.0 ms (-2.7%)
tracing14.959 s [14.959 s, 14.959 s]-554.0 ms (-3.6%)

@bric3bric3 added the tag: no release notes Changes to exclude from release notes label Jun 17, 2025
@bric3
bric3 merged commit 5ee43c6 into masterJun 17, 2025
@bric3
bric3 deleted the increase-again-maven-smoke-test-timeout branch June 17, 2025 06:39
@github-actionsgithub-actionsBot added this to the 1.50.0 milestone Jun 17, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: no release notesChanges to exclude from release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@bric3@sarahchen6