Skip to content

Set up crash-tracking JVM flags automatically (for Hotspot) - #8738

Closed
jbachorik wants to merge 1 commit into
masterfrom
jb/crash_tracking_magic
Closed

Set up crash-tracking JVM flags automatically (for Hotspot)#8738
jbachorik wants to merge 1 commit into
masterfrom
jb/crash_tracking_magic

Conversation

@jbachorik

@jbachorikjbachorik commented Apr 25, 2025

Copy link
Copy Markdown
Contributor

What Does This Do

Use the vmstructs based access to JVM flags which is available via ddprof-java library. Using this approach we can even set some flags - the effectiveness depends on whether JVM caches the flag value or not. For the 'OnError' and 'OnOutOfMemoryError' JVM flags the value is not cached and that means we can actually set it up early in the startup.

Motivation

Make the crash-tracking as easy to onboard as possible.

Additional Notes

Contributor Checklist

Jira ticket: PROF-10707

@jbachorik
jbachorikforce-pushed the jb/crash_tracking_magic branch from 9d19300 to a1931a3CompareApril 25, 2025 18:39
@pr-commenter

pr-commenterBot commented Apr 25, 2025

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterjb/crash_tracking_magic
git_commit_date17455828231745606365
git_commit_sha75634fea1931a3
release_version1.49.0-SNAPSHOT~75634fe4231.49.0-SNAPSHOT~a1931a32e9
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17456095891745609589
ci_job_id913522539913522539
ci_pipeline_id6338543263385432
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-u-qwygag-project-304-concurrent-0-z5n1wc23 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-u-qwygag-project-304-concurrent-0-z5n1wc23 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone
variantiastiast

Summary

Found 10 performance improvements and 17 performance regressions! Performance is the same for 35 metrics, 9 unstable metrics.

scenarioΔ mean execution_timecandidate mean execution_timebaseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.startworse
[+213.116ms; +222.246ms] or [+18.774%; +19.579%]
1.353s1.135s
scenario:startup:insecure-bank:iast:BytebuddyAgentworse
[+61.352ms; +67.512ms] or [+7.783%; +8.564%]
852.720ms788.288ms
scenario:startup:insecure-bank:iast:GlobalTracerbetter
[-38.408ms; -33.927ms] or [-16.732%; -14.780%]
193.384ms229.552ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.startworse
[+219.479ms; +228.173ms] or [+19.345%; +20.112%]
1.358s1.135s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:BytebuddyAgentworse
[+60.427ms; +66.528ms] or [+7.667%; +8.441%]
851.604ms788.126ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:GlobalTracerbetter
[-38.375ms; -33.848ms] or [-16.718%; -14.746%]
193.424ms229.536ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.startworse
[+219.169ms; +226.495ms] or [+19.329%; +19.975%]
1.357s1.134s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:BytebuddyAgentworse
[+62.827ms; +67.496ms] or [+7.979%; +8.572%]
852.592ms787.430ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:GlobalTracerbetter
[-38.864ms; -37.442ms] or [-16.854%; -16.238%]
192.434ms230.587ms
scenario:startup:insecure-bank:tracing:Agent.startworse
[+208.205ms; +238.829ms] or [+20.641%; +23.677%]
1.232s1.009s
scenario:startup:insecure-bank:tracing:BytebuddyAgentworse
[+63.130ms; +84.098ms] or [+9.409%; +12.534%]
744.598ms670.983ms
scenario:startup:insecure-bank:tracing:GlobalTracerbetter
[-45.076ms; -39.496ms] or [-18.748%; -16.427%]
198.144ms240.430ms
scenario:startup:petclinic:appsec:Agent.startworse
[+220.108ms; +239.678ms] or [+19.160%; +20.864%]
1.379s1.149s
scenario:startup:petclinic:appsec:BytebuddyAgentworse
[+64.898ms; +76.698ms] or [+9.431%; +11.145%]
758.957ms688.159ms
scenario:startup:petclinic:appsec:GlobalTracerbetter
[-41.559ms; -38.037ms] or [-17.577%; -16.088%]
196.636ms236.434ms
scenario:startup:petclinic:appsec:AppSecbetter
[-6.904ms; -4.784ms] or [-3.920%; -2.716%]
170.296ms176.139ms
scenario:startup:petclinic:iast:Agent.startworse
[+206.053ms; +239.095ms] or [+17.981%; +20.864%]
1.369s1.146s
scenario:startup:petclinic:iast:BytebuddyAgentworse
[+43.654ms; +69.688ms] or [+5.478%; +8.746%]
853.509ms796.838ms
scenario:startup:petclinic:iast:GlobalTracerbetter
[-40.709ms; -34.053ms] or [-17.584%; -14.709%]
194.128ms231.509ms
scenario:startup:petclinic:iast:AppSecbetter
[-8.782ms; -3.990ms] or [-15.525%; -7.054%]
50.182ms56.569ms
scenario:startup:petclinic:profiling:Agent.startworse
[+120.992ms; +155.816ms] or [+9.667%; +12.450%]
1.390s1.252s
scenario:startup:petclinic:profiling:BytebuddyAgentworse
[+87.862ms; +108.130ms] or [+13.304%; +16.373%]
758.399ms660.403ms
scenario:startup:petclinic:profiling:GlobalTracerbetter
[-151.055ms; -144.981ms] or [-40.376%; -38.753%]
226.100ms374.118ms
scenario:startup:petclinic:profiling:Remote Configworse
[+13.405µs; +52.522µs] or [+2.096%; +8.213%]
672.423µs639.460µs
scenario:startup:petclinic:tracing:Agent.startworse
[+223.824ms; +232.212ms] or [+22.193%; +23.024%]
1.237s1.009s
scenario:startup:petclinic:tracing:BytebuddyAgentworse
[+65.422ms; +70.295ms] or [+9.752%; +10.479%]
738.688ms670.830ms
scenario:startup:petclinic:tracing:GlobalTracerbetter
[-44.037ms; -42.299ms] or [-18.364%; -17.640%]
196.629ms239.797ms
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.009 s) : 0, 1008550
Total [baseline] (10.446 s) : 0, 10445919
Agent [candidate] (1.237 s) : 0, 1236568
Total [candidate] (10.654 s) : 0, 10654313
section appsec
Agent [baseline] (1.149 s) : 0, 1148772
Total [baseline] (10.724 s) : 0, 10723857
Agent [candidate] (1.379 s) : 0, 1378665
Total [candidate] (10.875 s) : 0, 10875143
section iast
Agent [baseline] (1.146 s) : 0, 1145981
Total [baseline] (10.849 s) : 0, 10848881
Agent [candidate] (1.369 s) : 0, 1368555
Total [candidate] (11.08 s) : 0, 11079507
section profiling
Agent [baseline] (1.252 s) : 0, 1251581
Total [baseline] (10.772 s) : 0, 10771698
Agent [candidate] (1.39 s) : 0, 1389985
Total [candidate] (11.086 s) : 0, 11085668
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.009 s-
Agentappsec1.149 s140.222 ms (13.9%)
Agentiast1.146 s137.431 ms (13.6%)
Agentprofiling1.252 s243.031 ms (24.1%)
Totaltracing10.446 s-
Totalappsec10.724 s277.938 ms (2.7%)
Totaliast10.849 s402.962 ms (3.9%)
Totalprofiling10.772 s325.779 ms (3.1%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.237 s-
Agentappsec1.379 s142.097 ms (11.5%)
Agentiast1.369 s131.987 ms (10.7%)
Agentprofiling1.39 s153.416 ms (12.4%)
Totaltracing10.654 s-
Totalappsec10.875 s220.83 ms (2.1%)
Totaliast11.08 s425.194 ms (4.0%)
Totalprofiling11.086 s431.355 ms (4.0%)
gantt
title petclinic - break down per module: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.83 ms) : 0, 670830
BytebuddyAgent [candidate] (738.688 ms) : 0, 738688
GlobalTracer [baseline] (239.797 ms) : 0, 239797
GlobalTracer [candidate] (196.629 ms) : 0, 196629
AppSec [baseline] (54.694 ms) : 0, 54694
AppSec [candidate] (55.086 ms) : 0, 55086
Debugger [baseline] (6.111 ms) : 0, 6111
Debugger [candidate] (6.201 ms) : 0, 6201
Remote Config [baseline] (705.341 µs) : 0, 705
Remote Config [candidate] (677.155 µs) : 0, 677
Telemetry [baseline] (12.964 ms) : 0, 12964
Telemetry [candidate] (15.655 ms) : 0, 15655
section appsec
BytebuddyAgent [baseline] (688.159 ms) : 0, 688159
BytebuddyAgent [candidate] (758.957 ms) : 0, 758957
GlobalTracer [baseline] (236.434 ms) : 0, 236434
GlobalTracer [candidate] (196.636 ms) : 0, 196636
AppSec [baseline] (176.139 ms) : 0, 176139
AppSec [candidate] (170.296 ms) : 0, 170296
Debugger [baseline] (5.85 ms) : 0, 5850
Debugger [candidate] (5.975 ms) : 0, 5975
Remote Config [baseline] (639.127 µs) : 0, 639
Remote Config [candidate] (635.434 µs) : 0, 635
Telemetry [baseline] (7.366 ms) : 0, 7366
Telemetry [candidate] (7.444 ms) : 0, 7444
IAST [baseline] (21.746 ms) : 0, 21746
IAST [candidate] (21.305 ms) : 0, 21305
section iast
BytebuddyAgent [baseline] (796.838 ms) : 0, 796838
BytebuddyAgent [candidate] (853.509 ms) : 0, 853509
GlobalTracer [baseline] (231.509 ms) : 0, 231509
GlobalTracer [candidate] (194.128 ms) : 0, 194128
AppSec [baseline] (56.569 ms) : 0, 56569
AppSec [candidate] (50.182 ms) : 0, 50182
Debugger [baseline] (5.938 ms) : 0, 5938
Debugger [candidate] (5.887 ms) : 0, 5887
Remote Config [baseline] (587.771 µs) : 0, 588
Remote Config [candidate] (583.377 µs) : 0, 583
Telemetry [baseline] (7.942 ms) : 0, 7942
Telemetry [candidate] (7.781 ms) : 0, 7781
IAST [baseline] (23.12 ms) : 0, 23120
IAST [candidate] (26.553 ms) : 0, 26553
section profiling
ProfilingAgent [baseline] (97.857 ms) : 0, 97857
ProfilingAgent [candidate] (98.683 ms) : 0, 98683
BytebuddyAgent [baseline] (660.403 ms) : 0, 660403
BytebuddyAgent [candidate] (758.399 ms) : 0, 758399
GlobalTracer [baseline] (374.118 ms) : 0, 374118
GlobalTracer [candidate] (226.1 ms) : 0, 226100
AppSec [baseline] (54.287 ms) : 0, 54287
AppSec [candidate] (61.61 ms) : 0, 61610
Debugger [baseline] (6.098 ms) : 0, 6098
Debugger [candidate] (6.237 ms) : 0, 6237
Remote Config [baseline] (639.46 µs) : 0, 639
Remote Config [candidate] (672.423 µs) : 0, 672
Telemetry [baseline] (8.173 ms) : 0, 8173
Telemetry [candidate] (8.384 ms) : 0, 8384
Profiling [baseline] (97.881 ms) : 0, 97881
Profiling [candidate] (98.708 ms) : 0, 98708
Loading
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.009 s) : 0, 1008712
Total [baseline] (8.644 s) : 0, 8643839
Agent [candidate] (1.232 s) : 0, 1232229
Total [candidate] (8.834 s) : 0, 8834450
section iast
Agent [baseline] (1.135 s) : 0, 1135140
Total [baseline] (9.239 s) : 0, 9238565
Agent [candidate] (1.353 s) : 0, 1352821
Total [candidate] (9.391 s) : 0, 9391034
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.135 s) : 0, 1134526
Total [baseline] (9.165 s) : 0, 9164555
Agent [candidate] (1.358 s) : 0, 1358352
Total [candidate] (9.337 s) : 0, 9337172
section iast_TELEMETRY_OFF
Agent [baseline] (1.134 s) : 0, 1133897
Total [baseline] (9.175 s) : 0, 9175067
Agent [candidate] (1.357 s) : 0, 1356729
Total [candidate] (9.425 s) : 0, 9424948
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.009 s-
Agentiast1.135 s126.427 ms (12.5%)
Agentiast_HARDCODED_SECRET_DISABLED1.135 s125.814 ms (12.5%)
Agentiast_TELEMETRY_OFF1.134 s125.184 ms (12.4%)
Totaltracing8.644 s-
Totaliast9.239 s594.727 ms (6.9%)
Totaliast_HARDCODED_SECRET_DISABLED9.165 s520.716 ms (6.0%)
Totaliast_TELEMETRY_OFF9.175 s531.228 ms (6.1%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.232 s-
Agentiast1.353 s120.592 ms (9.8%)
Agentiast_HARDCODED_SECRET_DISABLED1.358 s126.123 ms (10.2%)
Agentiast_TELEMETRY_OFF1.357 s124.5 ms (10.1%)
Totaltracing8.834 s-
Totaliast9.391 s556.584 ms (6.3%)
Totaliast_HARDCODED_SECRET_DISABLED9.337 s502.722 ms (5.7%)
Totaliast_TELEMETRY_OFF9.425 s590.498 ms (6.7%)
gantt
title insecure-bank - break down per module: candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (670.983 ms) : 0, 670983
BytebuddyAgent [candidate] (744.598 ms) : 0, 744598
GlobalTracer [baseline] (240.43 ms) : 0, 240430
GlobalTracer [candidate] (198.144 ms) : 0, 198144
AppSec [baseline] (54.79 ms) : 0, 54790
AppSec [candidate] (55.324 ms) : 0, 55324
Debugger [baseline] (6.162 ms) : 0, 6162
Debugger [candidate] (6.208 ms) : 0, 6208
Remote Config [baseline] (720.204 µs) : 0, 720
Remote Config [candidate] (681.548 µs) : 0, 682
Telemetry [baseline] (12.278 ms) : 0, 12278
Telemetry [candidate] (15.467 ms) : 0, 15467
section iast
BytebuddyAgent [baseline] (788.288 ms) : 0, 788288
BytebuddyAgent [candidate] (852.72 ms) : 0, 852720
GlobalTracer [baseline] (229.552 ms) : 0, 229552
GlobalTracer [candidate] (193.384 ms) : 0, 193384
IAST [baseline] (22.742 ms) : 0, 22742
IAST [candidate] (24.245 ms) : 0, 24245
AppSec [baseline] (56.756 ms) : 0, 56756
AppSec [candidate] (53.824 ms) : 0, 53824
Debugger [baseline] (5.964 ms) : 0, 5964
Debugger [candidate] (5.927 ms) : 0, 5927
Remote Config [baseline] (588.64 µs) : 0, 589
Remote Config [candidate] (600.927 µs) : 0, 601
Telemetry [baseline] (7.931 ms) : 0, 7931
Telemetry [candidate] (7.713 ms) : 0, 7713
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (788.126 ms) : 0, 788126
BytebuddyAgent [candidate] (851.604 ms) : 0, 851604
GlobalTracer [baseline] (229.536 ms) : 0, 229536
GlobalTracer [candidate] (193.424 ms) : 0, 193424
IAST [baseline] (22.754 ms) : 0, 22754
IAST [candidate] (25.075 ms) : 0, 25075
AppSec [baseline] (56.373 ms) : 0, 56373
AppSec [candidate] (52.737 ms) : 0, 52737
Debugger [baseline] (5.866 ms) : 0, 5866
Debugger [candidate] (5.946 ms) : 0, 5946
Remote Config [baseline] (602.718 µs) : 0, 603
Remote Config [candidate] (593.56 µs) : 0, 594
Telemetry [baseline] (7.876 ms) : 0, 7876
Telemetry [candidate] (7.808 ms) : 0, 7808
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (787.43 ms) : 0, 787430
BytebuddyAgent [candidate] (852.592 ms) : 0, 852592
GlobalTracer [baseline] (230.587 ms) : 0, 230587
GlobalTracer [candidate] (192.434 ms) : 0, 192434
IAST [baseline] (22.255 ms) : 0, 22255
IAST [candidate] (23.877 ms) : 0, 23877
AppSec [baseline] (56.126 ms) : 0, 56126
AppSec [candidate] (53.577 ms) : 0, 53577
Debugger [baseline] (5.833 ms) : 0, 5833
Debugger [candidate] (5.967 ms) : 0, 5967
Remote Config [baseline] (593.19 µs) : 0, 593
Remote Config [candidate] (623.676 µs) : 0, 624
Telemetry [baseline] (7.677 ms) : 0, 7677
Telemetry [candidate] (7.907 ms) : 0, 7907
Loading

Load

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
end_time2025-04-25T19:03:162025-04-25T19:11:03
git_branchmasterjb/crash_tracking_magic
git_commit_date17455828231745606365
git_commit_sha75634fea1931a3
release_version1.49.0-SNAPSHOT~75634fe4231.49.0-SNAPSHOT~a1931a32e9
start_time2025-04-25T19:03:022025-04-25T19:10:48
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17456086621745608662
ci_job_id913522540913522540
ci_pipeline_id6338543263385432
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zdcpjxrd-project-304-concurrent-0-yz5cwhrt 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zdcpjxrd-project-304-concurrent-0-yz5cwhrt 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variantiastiast

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 18 unstable metrics.

scenarioΔ mean http_req_durationΔ mean throughputcandidate mean http_req_durationcandidate mean throughputbaseline mean http_req_durationbaseline mean throughput
scenario:load:petclinic:profilingbetter
[-101.347µs; -49.981µs] or [-6.448%; -3.180%]
unstable
[-446.569op/s; +674.489op/s] or [-15.072%; +22.764%]
1.496ms3076.923op/s1.572ms2962.963op/s
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section baseline
no_agent (388.158 µs) : 368, 408
. : milestone, 388,
iast (522.447 µs) : 499, 546
. : milestone, 522,
iast_FULL (742.709 µs) : 720, 766
. : milestone, 743,
iast_GLOBAL (566.374 µs) : 543, 589
. : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (532.64 µs) : 509, 556
. : milestone, 533,
iast_INACTIVE (475.116 µs) : 452, 499
. : milestone, 475,
iast_TELEMETRY_OFF (511.042 µs) : 489, 533
. : milestone, 511,
tracing (466.122 µs) : 443, 489
. : milestone, 466,
section candidate
no_agent (381.053 µs) : 361, 401
. : milestone, 381,
iast (533.595 µs) : 510, 557
. : milestone, 534,
iast_FULL (734.042 µs) : 711, 757
. : milestone, 734,
iast_GLOBAL (573.9 µs) : 550, 597
. : milestone, 574,
iast_HARDCODED_SECRET_DISABLED (521.962 µs) : 499, 545
. : milestone, 522,
iast_INACTIVE (478.644 µs) : 456, 501
. : milestone, 479,
iast_TELEMETRY_OFF (518.729 µs) : 496, 542
. : milestone, 519,
tracing (467.769 µs) : 447, 489
. : milestone, 468,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent388.158 µs [368.459 µs, 407.857 µs]-
iast522.447 µs [499.283 µs, 545.612 µs]134.289 µs (34.6%)
iast_FULL742.709 µs [719.597 µs, 765.82 µs]354.551 µs (91.3%)
iast_GLOBAL566.374 µs [543.461 µs, 589.288 µs]178.216 µs (45.9%)
iast_HARDCODED_SECRET_DISABLED532.64 µs [509.378 µs, 555.903 µs]144.482 µs (37.2%)
iast_INACTIVE475.116 µs [451.665 µs, 498.567 µs]86.958 µs (22.4%)
iast_TELEMETRY_OFF511.042 µs [488.627 µs, 533.456 µs]122.884 µs (31.7%)
tracing466.122 µs [443.173 µs, 489.072 µs]77.964 µs (20.1%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent381.053 µs [361.014 µs, 401.091 µs]-
iast533.595 µs [510.044 µs, 557.147 µs]152.543 µs (40.0%)
iast_FULL734.042 µs [710.975 µs, 757.108 µs]352.989 µs (92.6%)
iast_GLOBAL573.9 µs [550.427 µs, 597.372 µs]192.847 µs (50.6%)
iast_HARDCODED_SECRET_DISABLED521.962 µs [498.982 µs, 544.941 µs]140.909 µs (37.0%)
iast_INACTIVE478.644 µs [456.055 µs, 501.233 µs]97.591 µs (25.6%)
iast_TELEMETRY_OFF518.729 µs [495.665 µs, 541.793 µs]137.676 µs (36.1%)
tracing467.769 µs [446.579 µs, 488.958 µs]86.716 µs (22.8%)
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section baseline
no_agent (1.358 ms) : 1338, 1377
. : milestone, 1358,
appsec (1.725 ms) : 1702, 1749
. : milestone, 1725,
appsec_no_iast (1.743 ms) : 1720, 1766
. : milestone, 1743,
code_origins (1.688 ms) : 1662, 1714
. : milestone, 1688,
iast (1.516 ms) : 1491, 1540
. : milestone, 1516,
profiling (1.572 ms) : 1547, 1597
. : milestone, 1572,
tracing (1.494 ms) : 1469, 1519
. : milestone, 1494,
section candidate
no_agent (1.375 ms) : 1356, 1393
. : milestone, 1375,
appsec (1.748 ms) : 1724, 1772
. : milestone, 1748,
appsec_no_iast (1.739 ms) : 1716, 1763
. : milestone, 1739,
code_origins (1.686 ms) : 1659, 1714
. : milestone, 1686,
iast (1.519 ms) : 1495, 1543
. : milestone, 1519,
profiling (1.496 ms) : 1473, 1519
. : milestone, 1496,
tracing (1.488 ms) : 1465, 1512
. : milestone, 1488,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.358 ms [1.338 ms, 1.377 ms]-
appsec1.725 ms [1.702 ms, 1.749 ms]367.683 µs (27.1%)
appsec_no_iast1.743 ms [1.72 ms, 1.766 ms]385.563 µs (28.4%)
code_origins1.688 ms [1.662 ms, 1.714 ms]330.265 µs (24.3%)
iast1.516 ms [1.491 ms, 1.54 ms]158.206 µs (11.7%)
profiling1.572 ms [1.547 ms, 1.597 ms]214.009 µs (15.8%)
tracing1.494 ms [1.469 ms, 1.519 ms]136.044 µs (10.0%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.375 ms [1.356 ms, 1.393 ms]-
appsec1.748 ms [1.724 ms, 1.772 ms]373.623 µs (27.2%)
appsec_no_iast1.739 ms [1.716 ms, 1.763 ms]364.916 µs (26.5%)
code_origins1.686 ms [1.659 ms, 1.714 ms]311.712 µs (22.7%)
iast1.519 ms [1.495 ms, 1.543 ms]144.179 µs (10.5%)
profiling1.496 ms [1.473 ms, 1.519 ms]121.538 µs (8.8%)
tracing1.488 ms [1.465 ms, 1.512 ms]113.683 µs (8.3%)

Dacapo

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterjb/crash_tracking_magic
git_commit_date17455828231745606365
git_commit_sha75634fea1931a3
release_version1.49.0-SNAPSHOT~75634fe4231.49.0-SNAPSHOT~a1931a32e9
See matching parameters
BaselineCandidate
applicationbiojavabiojava
ci_job_date17456091501745609150
ci_job_id913522541913522541
ci_pipeline_id6338543263385432
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-u-qwygag-project-304-concurrent-1-7whjk72b 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-u-qwygag-project-304-concurrent-1-7whjk72b 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variantappsecappsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section baseline
no_agent (15.53 s) : 15530000, 15530000
. : milestone, 15530000,
appsec (14.936 s) : 14936000, 14936000
. : milestone, 14936000,
iast (18.747 s) : 18747000, 18747000
. : milestone, 18747000,
iast_GLOBAL (18.278 s) : 18278000, 18278000
. : milestone, 18278000,
profiling (15.504 s) : 15504000, 15504000
. : milestone, 15504000,
tracing (15.104 s) : 15104000, 15104000
. : milestone, 15104000,
section candidate
no_agent (15.063 s) : 15063000, 15063000
. : milestone, 15063000,
appsec (14.981 s) : 14981000, 14981000
. : milestone, 14981000,
iast (19.119 s) : 19119000, 19119000
. : milestone, 19119000,
iast_GLOBAL (18.046 s) : 18046000, 18046000
. : milestone, 18046000,
profiling (15.027 s) : 15027000, 15027000
. : milestone, 15027000,
tracing (14.716 s) : 14716000, 14716000
. : milestone, 14716000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.53 s [15.53 s, 15.53 s]-
appsec14.936 s [14.936 s, 14.936 s]-594.0 ms (-3.8%)
iast18.747 s [18.747 s, 18.747 s]3.217 s (20.7%)
iast_GLOBAL18.278 s [18.278 s, 18.278 s]2.748 s (17.7%)
profiling15.504 s [15.504 s, 15.504 s]-26.0 ms (-0.2%)
tracing15.104 s [15.104 s, 15.104 s]-426.0 ms (-2.7%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.063 s [15.063 s, 15.063 s]-
appsec14.981 s [14.981 s, 14.981 s]-82.0 ms (-0.5%)
iast19.119 s [19.119 s, 19.119 s]4.056 s (26.9%)
iast_GLOBAL18.046 s [18.046 s, 18.046 s]2.983 s (19.8%)
profiling15.027 s [15.027 s, 15.027 s]-36.0 ms (-0.2%)
tracing14.716 s [14.716 s, 14.716 s]-347.0 ms (-2.3%)
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.49.0-SNAPSHOT~a1931a32e9, baseline=1.49.0-SNAPSHOT~75634fe423
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
. : milestone, 1471,
appsec (2.374 ms) : 2327, 2420
. : milestone, 2374,
iast (2.15 ms) : 2091, 2208
. : milestone, 2150,
iast_GLOBAL (2.193 ms) : 2134, 2252
. : milestone, 2193,
profiling (1.997 ms) : 1950, 2044
. : milestone, 1997,
tracing (1.975 ms) : 1930, 2020
. : milestone, 1975,
section candidate
no_agent (1.473 ms) : 1462, 1485
. : milestone, 1473,
appsec (2.364 ms) : 2318, 2410
. : milestone, 2364,
iast (2.157 ms) : 2098, 2216
. : milestone, 2157,
iast_GLOBAL (2.196 ms) : 2137, 2255
. : milestone, 2196,
profiling (1.992 ms) : 1946, 2039
. : milestone, 1992,
tracing (1.975 ms) : 1930, 2020
. : milestone, 1975,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.471 ms [1.46 ms, 1.483 ms]-
appsec2.374 ms [2.327 ms, 2.42 ms]902.461 µs (61.3%)
iast2.15 ms [2.091 ms, 2.208 ms]678.626 µs (46.1%)
iast_GLOBAL2.193 ms [2.134 ms, 2.252 ms]721.964 µs (49.1%)
profiling1.997 ms [1.95 ms, 2.044 ms]525.622 µs (35.7%)
tracing1.975 ms [1.93 ms, 2.02 ms]503.678 µs (34.2%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.473 ms [1.462 ms, 1.485 ms]-
appsec2.364 ms [2.318 ms, 2.41 ms]890.848 µs (60.5%)
iast2.157 ms [2.098 ms, 2.216 ms]684.077 µs (46.4%)
iast_GLOBAL2.196 ms [2.137 ms, 2.255 ms]722.656 µs (49.1%)
profiling1.992 ms [1.946 ms, 2.039 ms]519.255 µs (35.2%)
tracing1.975 ms [1.93 ms, 2.02 ms]502.063 µs (34.1%)

@jbachorikjbachorik added type: feature Enhancements and improvements comp: crash tracking Crash Tracking labels May 27, 2025
@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.

@github-actionsgithub-actionsBot added the tag: stale Stale pull requests label Sep 1, 2025
@github-actions

Copy link
Copy Markdown
Contributor

This pull request has been closed because it has not had activity over the past quarter. Feel free to reopen the PR if you are still working on it.

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: crash trackingCrash Trackingtag: staleStale pull requeststype: featureEnhancements and improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

@jbachorik