Skip to content

Dummy - #9041

Closed
jbachorik wants to merge 1 commit into
masterfrom
jb/test_check
Closed

Dummy#9041
jbachorik wants to merge 1 commit into
masterfrom
jb/test_check

Conversation

@jbachorik

Copy link
Copy Markdown
Contributor

No description provided.

@pr-commenter

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterjb/test_check
git_commit_date17509319821750945949
git_commit_sha0f9b46cc8cad11
release_version1.51.0-SNAPSHOT~0f9b46c7521.51.0-SNAPSHOT~c8cad11de4
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17509478711750947871
ci_job_id10002400861000240086
ci_pipeline_id6886173768861737
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-iun2vzqu-project-304-concurrent-0-4wzg12r4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-iun2vzqu-project-304-concurrent-0-4wzg12r4 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 9 unstable metrics.

Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.003 s) : 0, 1003300
Total [baseline] (10.788 s) : 0, 10788190
Agent [candidate] (999.98 ms) : 0, 999980
Total [candidate] (10.729 s) : 0, 10728539
section appsec
Agent [baseline] (1.177 s) : 0, 1176597
Total [baseline] (10.77 s) : 0, 10769854
Agent [candidate] (1.18 s) : 0, 1179772
Total [candidate] (10.744 s) : 0, 10744192
section iast
Agent [baseline] (1.133 s) : 0, 1133257
Total [baseline] (10.877 s) : 0, 10876940
Agent [candidate] (1.141 s) : 0, 1140664
Total [candidate] (10.829 s) : 0, 10829052
section profiling
Agent [baseline] (1.245 s) : 0, 1244521
Total [baseline] (11.034 s) : 0, 11034250
Agent [candidate] (1.251 s) : 0, 1251393
Total [candidate] (11.057 s) : 0, 11056718
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.003 s-
Agentappsec1.177 s173.297 ms (17.3%)
Agentiast1.133 s129.958 ms (13.0%)
Agentprofiling1.245 s241.221 ms (24.0%)
Totaltracing10.788 s-
Totalappsec10.77 s-18.336 ms (-0.2%)
Totaliast10.877 s88.75 ms (0.8%)
Totalprofiling11.034 s246.06 ms (2.3%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing999.98 ms-
Agentappsec1.18 s179.791 ms (18.0%)
Agentiast1.141 s140.684 ms (14.1%)
Agentprofiling1.251 s251.412 ms (25.1%)
Totaltracing10.729 s-
Totalappsec10.744 s15.652 ms (0.1%)
Totaliast10.829 s100.512 ms (0.9%)
Totalprofiling11.057 s328.179 ms (3.1%)
gantt
title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (692.912 ms) : 0, 692912
BytebuddyAgent [candidate] (690.334 ms) : 0, 690334
GlobalTracer [baseline] (243.903 ms) : 0, 243903
GlobalTracer [candidate] (243.176 ms) : 0, 243176
AppSec [baseline] (30.538 ms) : 0, 30538
AppSec [candidate] (30.458 ms) : 0, 30458
Debugger [baseline] (6.052 ms) : 0, 6052
Debugger [candidate] (6.108 ms) : 0, 6108
Remote Config [baseline] (674.671 µs) : 0, 675
Remote Config [candidate] (683.738 µs) : 0, 684
Telemetry [baseline] (8.247 ms) : 0, 8247
Telemetry [candidate] (8.248 ms) : 0, 8248
section appsec
BytebuddyAgent [baseline] (711.794 ms) : 0, 711794
BytebuddyAgent [candidate] (715.978 ms) : 0, 715978
GlobalTracer [baseline] (236.697 ms) : 0, 236697
GlobalTracer [candidate] (236.166 ms) : 0, 236166
IAST [baseline] (22.097 ms) : 0, 22097
IAST [candidate] (22.149 ms) : 0, 22149
AppSec [baseline] (170.653 ms) : 0, 170653
AppSec [candidate] (170.001 ms) : 0, 170001
Debugger [baseline] (5.817 ms) : 0, 5817
Debugger [candidate] (5.813 ms) : 0, 5813
Remote Config [baseline] (606.298 µs) : 0, 606
Remote Config [candidate] (603.552 µs) : 0, 604
Telemetry [baseline] (8.128 ms) : 0, 8128
Telemetry [candidate] (8.115 ms) : 0, 8115
section iast
BytebuddyAgent [baseline] (809.229 ms) : 0, 809229
BytebuddyAgent [candidate] (815.054 ms) : 0, 815054
GlobalTracer [baseline] (233.27 ms) : 0, 233270
GlobalTracer [candidate] (234.231 ms) : 0, 234231
IAST [baseline] (24.655 ms) : 0, 24655
IAST [candidate] (28.156 ms) : 0, 28156
AppSec [baseline] (30.881 ms) : 0, 30881
AppSec [candidate] (27.801 ms) : 0, 27801
Debugger [baseline] (5.804 ms) : 0, 5804
Debugger [candidate] (5.851 ms) : 0, 5851
Remote Config [baseline] (577.76 µs) : 0, 578
Remote Config [candidate] (583.509 µs) : 0, 584
Telemetry [baseline] (7.954 ms) : 0, 7954
Telemetry [candidate] (8.01 ms) : 0, 8010
section profiling
BytebuddyAgent [baseline] (678.144 ms) : 0, 678144
BytebuddyAgent [candidate] (684.374 ms) : 0, 684374
GlobalTracer [baseline] (361.681 ms) : 0, 361681
GlobalTracer [candidate] (362.056 ms) : 0, 362056
AppSec [baseline] (31.524 ms) : 0, 31524
AppSec [candidate] (32.427 ms) : 0, 32427
Debugger [baseline] (10.511 ms) : 0, 10511
Debugger [candidate] (11.322 ms) : 0, 11322
Remote Config [baseline] (1.413 ms) : 0, 1413
Remote Config [candidate] (659.947 µs) : 0, 660
Telemetry [baseline] (8.795 ms) : 0, 8795
Telemetry [candidate] (8.718 ms) : 0, 8718
ProfilingAgent [baseline] (103.075 ms) : 0, 103075
ProfilingAgent [candidate] (102.997 ms) : 0, 102997
Profiling [baseline] (103.102 ms) : 0, 103102
Profiling [candidate] (103.021 ms) : 0, 103021
Loading
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (997.106 ms) : 0, 997106
Total [baseline] (8.557 s) : 0, 8557476
Agent [candidate] (1.003 s) : 0, 1002694
Total [candidate] (8.572 s) : 0, 8571744
section iast
Agent [baseline] (1.14 s) : 0, 1139828
Total [baseline] (9.301 s) : 0, 9301053
Agent [candidate] (1.148 s) : 0, 1147618
Total [candidate] (9.33 s) : 0, 9330447
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing997.106 ms-
Agentiast1.14 s142.721 ms (14.3%)
Totaltracing8.557 s-
Totaliast9.301 s743.577 ms (8.7%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.003 s-
Agentiast1.148 s144.923 ms (14.5%)
Totaltracing8.572 s-
Totaliast9.33 s758.703 ms (8.9%)
gantt
title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.244 ms) : 0, 688244
BytebuddyAgent [candidate] (693.055 ms) : 0, 693055
GlobalTracer [baseline] (242.561 ms) : 0, 242561
GlobalTracer [candidate] (243.355 ms) : 0, 243355
AppSec [baseline] (30.41 ms) : 0, 30410
AppSec [candidate] (30.376 ms) : 0, 30376
Debugger [baseline] (6.056 ms) : 0, 6056
Debugger [candidate] (6.078 ms) : 0, 6078
Remote Config [baseline] (672.75 µs) : 0, 673
Remote Config [candidate] (676.451 µs) : 0, 676
Telemetry [baseline] (8.31 ms) : 0, 8310
Telemetry [candidate] (8.248 ms) : 0, 8248
section iast
BytebuddyAgent [baseline] (814.164 ms) : 0, 814164
BytebuddyAgent [candidate] (820.639 ms) : 0, 820639
GlobalTracer [baseline] (233.958 ms) : 0, 233958
GlobalTracer [candidate] (235.681 ms) : 0, 235681
IAST [baseline] (26.579 ms) : 0, 26579
IAST [candidate] (27.229 ms) : 0, 27229
AppSec [baseline] (29.654 ms) : 0, 29654
AppSec [candidate] (28.523 ms) : 0, 28523
Debugger [baseline] (5.852 ms) : 0, 5852
Debugger [candidate] (5.901 ms) : 0, 5901
Remote Config [baseline] (598.107 µs) : 0, 598
Remote Config [candidate] (589.273 µs) : 0, 589
Telemetry [baseline] (8.049 ms) : 0, 8049
Telemetry [candidate] (8.039 ms) : 0, 8039
Loading

Load

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterjb/test_check
git_commit_date17509319821750945949
git_commit_sha0f9b46cc8cad11
release_version1.51.0-SNAPSHOT~0f9b46c7521.51.0-SNAPSHOT~c8cad11de4
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17509474621750947462
ci_job_id10002400871000240087
ci_pipeline_id6886173768861737
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-cpksuxk1-project-304-concurrent-0-w8xgy4i1 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-cpksuxk1-project-304-concurrent-0-w8xgy4i1 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 10 metrics, 12 unstable metrics.

scenarioΔ mean http_req_durationΔ mean throughputcandidate mean http_req_durationcandidate mean throughputbaseline mean http_req_durationbaseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_loadworse
[+430.252µs; +820.212µs] or [+4.379%; +8.347%]
unstable
[-86.246op/s; +30.184op/s] or [-18.242%; +6.384%]
10.452ms444.750op/s9.826ms472.781op/s
scenario:load:petclinic:tracing:high_loadworse
[+0.902ms; +1.706ms] or [+2.064%; +3.906%]
unstable
[-9.079op/s; +5.587op/s] or [-8.480%; +5.218%]
44.983ms105.316op/s43.679ms107.062op/s
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section baseline
no_agent (36.455 ms) : 36171, 36739
. : milestone, 36455,
appsec (47.942 ms) : 47522, 48363
. : milestone, 47942,
code_origins (44.541 ms) : 44169, 44913
. : milestone, 44541,
iast (43.065 ms) : 42678, 43453
. : milestone, 43065,
profiling (47.986 ms) : 47558, 48415
. : milestone, 47986,
tracing (43.679 ms) : 43303, 44056
. : milestone, 43679,
section candidate
no_agent (37.052 ms) : 36748, 37355
. : milestone, 37052,
appsec (48.262 ms) : 47832, 48692
. : milestone, 48262,
code_origins (44.191 ms) : 43828, 44555
. : milestone, 44191,
iast (43.705 ms) : 43317, 44093
. : milestone, 43705,
profiling (47.343 ms) : 46915, 47772
. : milestone, 47343,
tracing (44.983 ms) : 44612, 45354
. : milestone, 44983,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent36.455 ms [36.171 ms, 36.739 ms]-
appsec47.942 ms [47.522 ms, 48.363 ms]11.487 ms (31.5%)
code_origins44.541 ms [44.169 ms, 44.913 ms]8.086 ms (22.2%)
iast43.065 ms [42.678 ms, 43.453 ms]6.61 ms (18.1%)
profiling47.986 ms [47.558 ms, 48.415 ms]11.531 ms (31.6%)
tracing43.679 ms [43.303 ms, 44.056 ms]7.224 ms (19.8%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent37.052 ms [36.748 ms, 37.355 ms]-
appsec48.262 ms [47.832 ms, 48.692 ms]11.211 ms (30.3%)
code_origins44.191 ms [43.828 ms, 44.555 ms]7.14 ms (19.3%)
iast43.705 ms [43.317 ms, 44.093 ms]6.653 ms (18.0%)
profiling47.343 ms [46.915 ms, 47.772 ms]10.292 ms (27.8%)
tracing44.983 ms [44.612 ms, 45.354 ms]7.932 ms (21.4%)
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section baseline
no_agent (4.479 ms) : 4428, 4530
. : milestone, 4479,
iast (9.294 ms) : 9132, 9456
. : milestone, 9294,
iast_FULL (13.59 ms) : 13320, 13860
. : milestone, 13590,
iast_GLOBAL (9.826 ms) : 9647, 10006
. : milestone, 9826,
profiling (8.199 ms) : 8067, 8332
. : milestone, 8199,
tracing (7.658 ms) : 7538, 7777
. : milestone, 7658,
section candidate
no_agent (4.378 ms) : 4329, 4427
. : milestone, 4378,
iast (9.266 ms) : 9115, 9417
. : milestone, 9266,
iast_FULL (13.631 ms) : 13363, 13899
. : milestone, 13631,
iast_GLOBAL (10.452 ms) : 10269, 10634
. : milestone, 10452,
profiling (8.422 ms) : 8295, 8549
. : milestone, 8422,
tracing (7.766 ms) : 7645, 7886
. : milestone, 7766,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent4.479 ms [4.428 ms, 4.53 ms]-
iast9.294 ms [9.132 ms, 9.456 ms]4.815 ms (107.5%)
iast_FULL13.59 ms [13.32 ms, 13.86 ms]9.111 ms (203.4%)
iast_GLOBAL9.826 ms [9.647 ms, 10.006 ms]5.347 ms (119.4%)
profiling8.199 ms [8.067 ms, 8.332 ms]3.72 ms (83.1%)
tracing7.658 ms [7.538 ms, 7.777 ms]3.179 ms (71.0%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent4.378 ms [4.329 ms, 4.427 ms]-
iast9.266 ms [9.115 ms, 9.417 ms]4.888 ms (111.7%)
iast_FULL13.631 ms [13.363 ms, 13.899 ms]9.253 ms (211.4%)
iast_GLOBAL10.452 ms [10.269 ms, 10.634 ms]6.074 ms (138.7%)
profiling8.422 ms [8.295 ms, 8.549 ms]4.044 ms (92.4%)
tracing7.766 ms [7.645 ms, 7.886 ms]3.388 ms (77.4%)

Dacapo

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterjb/test_check
git_commit_date17509319821750945949
git_commit_sha0f9b46cc8cad11
release_version1.51.0-SNAPSHOT~0f9b46c7521.51.0-SNAPSHOT~c8cad11de4
See matching parameters
BaselineCandidate
applicationbiojavabiojava
ci_job_date17509480471750948047
ci_job_id10002400881000240088
ci_pipeline_id6886173768861737
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-wutn71ym-project-304-concurrent-0-g4j8m1oz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-wutn71ym-project-304-concurrent-0-g4j8m1oz 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.402 ms) : 2353, 2451
. : milestone, 2402,
iast (2.184 ms) : 2122, 2245
. : milestone, 2184,
iast_GLOBAL (2.231 ms) : 2170, 2293
. : milestone, 2231,
profiling (2.036 ms) : 1986, 2086
. : milestone, 2036,
tracing (2.005 ms) : 1957, 2053
. : milestone, 2005,
section candidate
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (2.396 ms) : 2347, 2445
. : milestone, 2396,
iast (2.182 ms) : 2121, 2243
. : milestone, 2182,
iast_GLOBAL (2.231 ms) : 2170, 2293
. : milestone, 2231,
profiling (2.024 ms) : 1975, 2073
. : milestone, 2024,
tracing (2.0 ms) : 1952, 2047
. : milestone, 2000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.472 ms [1.461 ms, 1.484 ms]-
appsec2.402 ms [2.353 ms, 2.451 ms]930.099 µs (63.2%)
iast2.184 ms [2.122 ms, 2.245 ms]711.689 µs (48.3%)
iast_GLOBAL2.231 ms [2.17 ms, 2.293 ms]759.143 µs (51.6%)
profiling2.036 ms [1.986 ms, 2.086 ms]564.337 µs (38.3%)
tracing2.005 ms [1.957 ms, 2.053 ms]533.032 µs (36.2%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.473 ms [1.462 ms, 1.485 ms]-
appsec2.396 ms [2.347 ms, 2.445 ms]922.947 µs (62.7%)
iast2.182 ms [2.121 ms, 2.243 ms]709.096 µs (48.1%)
iast_GLOBAL2.231 ms [2.17 ms, 2.293 ms]758.146 µs (51.5%)
profiling2.024 ms [1.975 ms, 2.073 ms]550.656 µs (37.4%)
tracing2.0 ms [1.952 ms, 2.047 ms]526.703 µs (35.8%)
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~c8cad11de4, baseline=1.51.0-SNAPSHOT~0f9b46c752
dateFormat X
axisFormat %s
section baseline
no_agent (15.633 s) : 15633000, 15633000
. : milestone, 15633000,
appsec (14.993 s) : 14993000, 14993000
. : milestone, 14993000,
iast (18.487 s) : 18487000, 18487000
. : milestone, 18487000,
iast_GLOBAL (18.069 s) : 18069000, 18069000
. : milestone, 18069000,
profiling (15.197 s) : 15197000, 15197000
. : milestone, 15197000,
tracing (14.808 s) : 14808000, 14808000
. : milestone, 14808000,
section candidate
no_agent (15.528 s) : 15528000, 15528000
. : milestone, 15528000,
appsec (14.745 s) : 14745000, 14745000
. : milestone, 14745000,
iast (18.843 s) : 18843000, 18843000
. : milestone, 18843000,
iast_GLOBAL (18.091 s) : 18091000, 18091000
. : milestone, 18091000,
profiling (15.332 s) : 15332000, 15332000
. : milestone, 15332000,
tracing (14.792 s) : 14792000, 14792000
. : milestone, 14792000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.633 s [15.633 s, 15.633 s]-
appsec14.993 s [14.993 s, 14.993 s]-640.0 ms (-4.1%)
iast18.487 s [18.487 s, 18.487 s]2.854 s (18.3%)
iast_GLOBAL18.069 s [18.069 s, 18.069 s]2.436 s (15.6%)
profiling15.197 s [15.197 s, 15.197 s]-436.0 ms (-2.8%)
tracing14.808 s [14.808 s, 14.808 s]-825.0 ms (-5.3%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.528 s [15.528 s, 15.528 s]-
appsec14.745 s [14.745 s, 14.745 s]-783.0 ms (-5.0%)
iast18.843 s [18.843 s, 18.843 s]3.315 s (21.3%)
iast_GLOBAL18.091 s [18.091 s, 18.091 s]2.563 s (16.5%)
profiling15.332 s [15.332 s, 15.332 s]-196.0 ms (-1.3%)
tracing14.792 s [14.792 s, 14.792 s]-736.0 ms (-4.7%)

@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.

@github-actionsgithub-actionsBot added the tag: stale Stale pull requests label Oct 1, 2025
@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been closed because it has not had activity over the past quarter. Feel free to reopen the PR if you are still working on it.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tag: staleStale pull requests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@jbachorik