Skip to content

Enable the quarkus-native smoke test - #8783

Merged
ygree merged 2 commits into
masterfrom
ygree/enable-quarkus-native-smoke-test
May 8, 2025
Merged

Enable the quarkus-native smoke test#8783
ygree merged 2 commits into
masterfrom
ygree/enable-quarkus-native-smoke-test

Conversation

@ygree

@ygreeygree commented May 7, 2025

Copy link
Copy Markdown
Contributor

What Does This Do

Enables the quarkus-native smoke test

Motivation

quarkus-native smoke test was broken but unnoticed because it never runs on the CI.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@ygreeygree self-assigned this May 7, 2025
@ygree
ygree requested a review from a team as a code ownerMay 7, 2025 18:29
@ygree
ygree requested a review from dougqhMay 7, 2025 18:29
@ygreeygree added comp: testing Testing tag: no release notes Changes to exclude from release notes labels May 7, 2025
@ygree
ygree marked this pull request as draft May 7, 2025 18:42
@ygree
ygree marked this pull request as ready for review May 7, 2025 18:42
@pr-commenter

pr-commenterBot commented May 7, 2025•
edited
Loading

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterygree/enable-quarkus-native-smoke-test
git_commit_date17466921711746721991
git_commit_shad5d53cda3d432e
release_version1.50.0-SNAPSHOT~d5d53cd5531.50.0-SNAPSHOT~a3d432e98f
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17467250041746725004
ci_job_id930138934930138934
ci_pipeline_id6455125664551256
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-psrqmy6d-project-304-concurrent-0-g7tu7q2w 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-psrqmy6d-project-304-concurrent-0-g7tu7q2w 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone
variantiastiast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 14 unstable metrics.

Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020367
Total [baseline] (8.662 s) : 0, 8661608
Agent [candidate] (1.031 s) : 0, 1030942
Total [candidate] (8.697 s) : 0, 8696856
section iast
Agent [baseline] (1.145 s) : 0, 1145354
Total [baseline] (9.235 s) : 0, 9234964
Agent [candidate] (1.148 s) : 0, 1148426
Total [candidate] (9.243 s) : 0, 9242667
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.148 s) : 0, 1148301
Total [baseline] (9.194 s) : 0, 9194283
Agent [candidate] (1.15 s) : 0, 1149555
Total [candidate] (9.21 s) : 0, 9210195
section iast_TELEMETRY_OFF
Agent [baseline] (1.15 s) : 0, 1150467
Total [baseline] (9.232 s) : 0, 9232326
Agent [candidate] (1.155 s) : 0, 1154676
Total [candidate] (9.205 s) : 0, 9204659
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.02 s-
Agentiast1.145 s124.987 ms (12.2%)
Agentiast_HARDCODED_SECRET_DISABLED1.148 s127.934 ms (12.5%)
Agentiast_TELEMETRY_OFF1.15 s130.1 ms (12.8%)
Totaltracing8.662 s-
Totaliast9.235 s573.356 ms (6.6%)
Totaliast_HARDCODED_SECRET_DISABLED9.194 s532.675 ms (6.1%)
Totaliast_TELEMETRY_OFF9.232 s570.718 ms (6.6%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.031 s-
Agentiast1.148 s117.485 ms (11.4%)
Agentiast_HARDCODED_SECRET_DISABLED1.15 s118.613 ms (11.5%)
Agentiast_TELEMETRY_OFF1.155 s123.735 ms (12.0%)
Totaltracing8.697 s-
Totaliast9.243 s545.81 ms (6.3%)
Totaliast_HARDCODED_SECRET_DISABLED9.21 s513.339 ms (5.9%)
Totaliast_TELEMETRY_OFF9.205 s507.803 ms (5.8%)
gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.005 ms) : 0, 682005
BytebuddyAgent [candidate] (688.642 ms) : 0, 688642
GlobalTracer [baseline] (240.003 ms) : 0, 240003
GlobalTracer [candidate] (242.972 ms) : 0, 242972
AppSec [baseline] (54.382 ms) : 0, 54382
AppSec [candidate] (56.639 ms) : 0, 56639
Debugger [baseline] (9.127 ms) : 0, 9127
Debugger [candidate] (7.765 ms) : 0, 7765
Remote Config [baseline] (693.392 µs) : 0, 693
Remote Config [candidate] (699.501 µs) : 0, 700
Telemetry [baseline] (10.575 ms) : 0, 10575
Telemetry [candidate] (10.622 ms) : 0, 10622
section iast
BytebuddyAgent [baseline] (800.035 ms) : 0, 800035
BytebuddyAgent [candidate] (800.247 ms) : 0, 800247
GlobalTracer [baseline] (229.486 ms) : 0, 229486
GlobalTracer [candidate] (231.202 ms) : 0, 231202
AppSec [baseline] (50.114 ms) : 0, 50114
AppSec [candidate] (48.871 ms) : 0, 48871
Debugger [baseline] (5.858 ms) : 0, 5858
Debugger [candidate] (5.934 ms) : 0, 5934
Remote Config [baseline] (590.283 µs) : 0, 590
Remote Config [candidate] (593.338 µs) : 0, 593
Telemetry [baseline] (7.854 ms) : 0, 7854
Telemetry [candidate] (7.891 ms) : 0, 7891
IAST [baseline] (26.517 ms) : 0, 26517
IAST [candidate] (29.517 ms) : 0, 29517
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.783 ms) : 0, 800783
BytebuddyAgent [candidate] (801.867 ms) : 0, 801867
GlobalTracer [baseline] (230.314 ms) : 0, 230314
GlobalTracer [candidate] (230.592 ms) : 0, 230592
AppSec [baseline] (52.377 ms) : 0, 52377
AppSec [candidate] (52.313 ms) : 0, 52313
Debugger [baseline] (5.962 ms) : 0, 5962
Debugger [candidate] (5.938 ms) : 0, 5938
Remote Config [baseline] (606.561 µs) : 0, 607
Remote Config [candidate] (579.725 µs) : 0, 580
Telemetry [baseline] (7.975 ms) : 0, 7975
Telemetry [candidate] (7.972 ms) : 0, 7972
IAST [baseline] (24.348 ms) : 0, 24348
IAST [candidate] (25.195 ms) : 0, 25195
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (803.052 ms) : 0, 803052
BytebuddyAgent [candidate] (805.081 ms) : 0, 805081
GlobalTracer [baseline] (231.372 ms) : 0, 231372
GlobalTracer [candidate] (231.856 ms) : 0, 231856
AppSec [baseline] (55.806 ms) : 0, 55806
AppSec [candidate] (55.922 ms) : 0, 55922
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (6.097 ms) : 0, 6097
Remote Config [baseline] (594.208 µs) : 0, 594
Remote Config [candidate] (610.6 µs) : 0, 611
Telemetry [baseline] (7.725 ms) : 0, 7725
Telemetry [candidate] (7.97 ms) : 0, 7970
IAST [baseline] (22.32 ms) : 0, 22320
IAST [candidate] (23.549 ms) : 0, 23549
Loading
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.026 s) : 0, 1025804
Total [baseline] (10.458 s) : 0, 10457849
Agent [candidate] (1.018 s) : 0, 1017532
Total [candidate] (10.406 s) : 0, 10406090
section appsec
Agent [baseline] (1.166 s) : 0, 1165961
Total [baseline] (10.707 s) : 0, 10707383
Agent [candidate] (1.159 s) : 0, 1159114
Total [candidate] (10.66 s) : 0, 10659751
section iast
Agent [baseline] (1.151 s) : 0, 1151137
Total [baseline] (10.945 s) : 0, 10945488
Agent [candidate] (1.148 s) : 0, 1148377
Total [candidate] (10.858 s) : 0, 10857661
section profiling
Agent [baseline] (1.286 s) : 0, 1286213
Total [baseline] (10.8 s) : 0, 10799885
Agent [candidate] (1.282 s) : 0, 1282417
Total [candidate] (10.807 s) : 0, 10806749
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.026 s-
Agentappsec1.166 s140.157 ms (13.7%)
Agentiast1.151 s125.333 ms (12.2%)
Agentprofiling1.286 s260.409 ms (25.4%)
Totaltracing10.458 s-
Totalappsec10.707 s249.534 ms (2.4%)
Totaliast10.945 s487.638 ms (4.7%)
Totalprofiling10.8 s342.036 ms (3.3%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.018 s-
Agentappsec1.159 s141.583 ms (13.9%)
Agentiast1.148 s130.845 ms (12.9%)
Agentprofiling1.282 s264.885 ms (26.0%)
Totaltracing10.406 s-
Totalappsec10.66 s253.662 ms (2.4%)
Totaliast10.858 s451.571 ms (4.3%)
Totalprofiling10.807 s400.66 ms (3.9%)
gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.752 ms) : 0, 686752
BytebuddyAgent [candidate] (681.492 ms) : 0, 681492
GlobalTracer [baseline] (241.376 ms) : 0, 241376
GlobalTracer [candidate] (239.415 ms) : 0, 239415
AppSec [baseline] (55.378 ms) : 0, 55378
AppSec [candidate] (55.248 ms) : 0, 55248
Debugger [baseline] (9.022 ms) : 0, 9022
Debugger [candidate] (8.999 ms) : 0, 8999
Remote Config [baseline] (690.756 µs) : 0, 691
Remote Config [candidate] (683.588 µs) : 0, 684
Telemetry [baseline] (9.019 ms) : 0, 9019
Telemetry [candidate] (8.27 ms) : 0, 8270
section appsec
BytebuddyAgent [baseline] (703.869 ms) : 0, 703869
BytebuddyAgent [candidate] (699.252 ms) : 0, 699252
GlobalTracer [baseline] (237.467 ms) : 0, 237467
GlobalTracer [candidate] (236.174 ms) : 0, 236174
AppSec [baseline] (175.828 ms) : 0, 175828
AppSec [candidate] (175.177 ms) : 0, 175177
Debugger [baseline] (5.978 ms) : 0, 5978
Debugger [candidate] (6.275 ms) : 0, 6275
Remote Config [baseline] (624.066 µs) : 0, 624
Remote Config [candidate] (617.815 µs) : 0, 618
Telemetry [baseline] (7.815 ms) : 0, 7815
Telemetry [candidate] (7.353 ms) : 0, 7353
IAST [baseline] (21.571 ms) : 0, 21571
IAST [candidate] (21.599 ms) : 0, 21599
section iast
BytebuddyAgent [baseline] (803.111 ms) : 0, 803111
BytebuddyAgent [candidate] (801.448 ms) : 0, 801448
GlobalTracer [baseline] (231.239 ms) : 0, 231239
GlobalTracer [candidate] (230.373 ms) : 0, 230373
AppSec [baseline] (48.779 ms) : 0, 48779
AppSec [candidate] (51.293 ms) : 0, 51293
Debugger [baseline] (5.945 ms) : 0, 5945
Debugger [candidate] (5.924 ms) : 0, 5924
Remote Config [baseline] (611.812 µs) : 0, 612
Remote Config [candidate] (595.141 µs) : 0, 595
Telemetry [baseline] (7.966 ms) : 0, 7966
Telemetry [candidate] (7.92 ms) : 0, 7920
IAST [baseline] (26.886 ms) : 0, 26886
IAST [candidate] (25.102 ms) : 0, 25102
section profiling
BytebuddyAgent [baseline] (677.079 ms) : 0, 677079
BytebuddyAgent [candidate] (673.36 ms) : 0, 673360
GlobalTracer [baseline] (379.61 ms) : 0, 379610
GlobalTracer [candidate] (379.471 ms) : 0, 379471
AppSec [baseline] (54.663 ms) : 0, 54663
AppSec [candidate] (54.033 ms) : 0, 54033
Debugger [baseline] (6.127 ms) : 0, 6127
Debugger [candidate] (6.152 ms) : 0, 6152
Remote Config [baseline] (653.127 µs) : 0, 653
Remote Config [candidate] (665.259 µs) : 0, 665
Telemetry [baseline] (8.104 ms) : 0, 8104
Telemetry [candidate] (8.136 ms) : 0, 8136
ProfilingAgent [baseline] (109.196 ms) : 0, 109196
ProfilingAgent [candidate] (110.048 ms) : 0, 110048
Profiling [baseline] (109.221 ms) : 0, 109221
Profiling [candidate] (110.074 ms) : 0, 110074
Loading

Load

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
end_time2025-05-08T16:51:512025-05-08T16:59:35
git_branchmasterygree/enable-quarkus-native-smoke-test
git_commit_date17466921711746721991
git_commit_shad5d53cda3d432e
release_version1.50.0-SNAPSHOT~d5d53cd5531.50.0-SNAPSHOT~a3d432e98f
start_time2025-05-08T16:51:372025-05-08T16:59:21
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17467239701746723970
ci_job_id930138936930138936
ci_pipeline_id6455125664551256
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-brbdd7pm-project-304-concurrent-0-68j2vocn 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-brbdd7pm-project-304-concurrent-0-68j2vocn 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variantiastiast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section baseline
no_agent (378.411 µs) : 358, 399
. : milestone, 378,
iast (519.265 µs) : 497, 541
. : milestone, 519,
iast_FULL (730.0 µs) : 708, 752
. : milestone, 730,
iast_GLOBAL (559.983 µs) : 538, 582
. : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (513.022 µs) : 491, 535
. : milestone, 513,
iast_INACTIVE (460.564 µs) : 439, 482
. : milestone, 461,
iast_TELEMETRY_OFF (504.787 µs) : 482, 528
. : milestone, 505,
tracing (459.575 µs) : 437, 482
. : milestone, 460,
section candidate
no_agent (377.945 µs) : 358, 398
. : milestone, 378,
iast (512.84 µs) : 491, 535
. : milestone, 513,
iast_FULL (728.673 µs) : 707, 751
. : milestone, 729,
iast_GLOBAL (553.663 µs) : 532, 576
. : milestone, 554,
iast_HARDCODED_SECRET_DISABLED (510.69 µs) : 488, 534
. : milestone, 511,
iast_INACTIVE (465.016 µs) : 442, 488
. : milestone, 465,
iast_TELEMETRY_OFF (507.857 µs) : 485, 531
. : milestone, 508,
tracing (455.967 µs) : 434, 478
. : milestone, 456,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent378.411 µs [358.169 µs, 398.654 µs]-
iast519.265 µs [497.056 µs, 541.474 µs]140.854 µs (37.2%)
iast_FULL730.0 µs [708.316 µs, 751.684 µs]351.588 µs (92.9%)
iast_GLOBAL559.983 µs [538.119 µs, 581.846 µs]181.571 µs (48.0%)
iast_HARDCODED_SECRET_DISABLED513.022 µs [491.25 µs, 534.794 µs]134.611 µs (35.6%)
iast_INACTIVE460.564 µs [439.042 µs, 482.086 µs]82.152 µs (21.7%)
iast_TELEMETRY_OFF504.787 µs [481.531 µs, 528.043 µs]126.376 µs (33.4%)
tracing459.575 µs [437.038 µs, 482.112 µs]81.164 µs (21.4%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent377.945 µs [358.289 µs, 397.601 µs]-
iast512.84 µs [490.831 µs, 534.85 µs]134.896 µs (35.7%)
iast_FULL728.673 µs [706.827 µs, 750.518 µs]350.728 µs (92.8%)
iast_GLOBAL553.663 µs [531.679 µs, 575.647 µs]175.718 µs (46.5%)
iast_HARDCODED_SECRET_DISABLED510.69 µs [487.684 µs, 533.697 µs]132.746 µs (35.1%)
iast_INACTIVE465.016 µs [441.798 µs, 488.234 µs]87.072 µs (23.0%)
iast_TELEMETRY_OFF507.857 µs [485.024 µs, 530.69 µs]129.913 µs (34.4%)
tracing455.967 µs [434.05 µs, 477.884 µs]78.022 µs (20.6%)
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section baseline
no_agent (1.371 ms) : 1351, 1392
. : milestone, 1371,
appsec (1.727 ms) : 1704, 1751
. : milestone, 1727,
appsec_no_iast (1.721 ms) : 1698, 1745
. : milestone, 1721,
code_origins (1.681 ms) : 1655, 1708
. : milestone, 1681,
iast (1.513 ms) : 1489, 1537
. : milestone, 1513,
profiling (1.527 ms) : 1504, 1550
. : milestone, 1527,
tracing (1.49 ms) : 1465, 1514
. : milestone, 1490,
section candidate
no_agent (1.359 ms) : 1339, 1379
. : milestone, 1359,
appsec (1.718 ms) : 1695, 1741
. : milestone, 1718,
appsec_no_iast (1.732 ms) : 1709, 1755
. : milestone, 1732,
code_origins (1.672 ms) : 1646, 1699
. : milestone, 1672,
iast (1.514 ms) : 1490, 1537
. : milestone, 1514,
profiling (1.523 ms) : 1499, 1547
. : milestone, 1523,
tracing (1.478 ms) : 1453, 1503
. : milestone, 1478,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.371 ms [1.351 ms, 1.392 ms]-
appsec1.727 ms [1.704 ms, 1.751 ms]356.015 µs (26.0%)
appsec_no_iast1.721 ms [1.698 ms, 1.745 ms]350.033 µs (25.5%)
code_origins1.681 ms [1.655 ms, 1.708 ms]309.758 µs (22.6%)
iast1.513 ms [1.489 ms, 1.537 ms]141.553 µs (10.3%)
profiling1.527 ms [1.504 ms, 1.55 ms]155.394 µs (11.3%)
tracing1.49 ms [1.465 ms, 1.514 ms]118.431 µs (8.6%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.359 ms [1.339 ms, 1.379 ms]-
appsec1.718 ms [1.695 ms, 1.741 ms]358.969 µs (26.4%)
appsec_no_iast1.732 ms [1.709 ms, 1.755 ms]372.647 µs (27.4%)
code_origins1.672 ms [1.646 ms, 1.699 ms]313.464 µs (23.1%)
iast1.514 ms [1.49 ms, 1.537 ms]154.553 µs (11.4%)
profiling1.523 ms [1.499 ms, 1.547 ms]164.11 µs (12.1%)
tracing1.478 ms [1.453 ms, 1.503 ms]118.983 µs (8.8%)

Dacapo

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterygree/enable-quarkus-native-smoke-test
git_commit_date17466921711746721991
git_commit_shad5d53cda3d432e
release_version1.50.0-SNAPSHOT~d5d53cd5531.50.0-SNAPSHOT~a3d432e98f
See matching parameters
BaselineCandidate
applicationbiojavabiojava
ci_job_date17467246441746724644
ci_job_id930138937930138937
ci_pipeline_id6455125664551256
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-psrqmy6d-project-304-concurrent-1-tiv0spu6 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-psrqmy6d-project-304-concurrent-1-tiv0spu6 6.8.0-1027-aws #29~22.04.1-Ubuntu SMP Sun Mar 30 07:45:38 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variantappsecappsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1460, 1483
. : milestone, 1471,
appsec (2.379 ms) : 2332, 2426
. : milestone, 2379,
iast (2.157 ms) : 2097, 2216
. : milestone, 2157,
iast_GLOBAL (2.194 ms) : 2135, 2254
. : milestone, 2194,
profiling (2.014 ms) : 1966, 2061
. : milestone, 2014,
tracing (1.978 ms) : 1932, 2024
. : milestone, 1978,
section candidate
no_agent (1.467 ms) : 1456, 1479
. : milestone, 1467,
appsec (2.37 ms) : 2323, 2417
. : milestone, 2370,
iast (2.149 ms) : 2089, 2208
. : milestone, 2149,
iast_GLOBAL (2.197 ms) : 2137, 2256
. : milestone, 2197,
profiling (2.023 ms) : 1975, 2072
. : milestone, 2023,
tracing (1.987 ms) : 1940, 2033
. : milestone, 1987,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.471 ms [1.46 ms, 1.483 ms]-
appsec2.379 ms [2.332 ms, 2.426 ms]907.991 µs (61.7%)
iast2.157 ms [2.097 ms, 2.216 ms]685.578 µs (46.6%)
iast_GLOBAL2.194 ms [2.135 ms, 2.254 ms]722.938 µs (49.1%)
profiling2.014 ms [1.966 ms, 2.061 ms]542.229 µs (36.9%)
tracing1.978 ms [1.932 ms, 2.024 ms]506.783 µs (34.4%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.467 ms [1.456 ms, 1.479 ms]-
appsec2.37 ms [2.323 ms, 2.417 ms]902.798 µs (61.5%)
iast2.149 ms [2.089 ms, 2.208 ms]681.195 µs (46.4%)
iast_GLOBAL2.197 ms [2.137 ms, 2.256 ms]729.325 µs (49.7%)
profiling2.023 ms [1.975 ms, 2.072 ms]555.961 µs (37.9%)
tracing1.987 ms [1.94 ms, 2.033 ms]519.409 µs (35.4%)
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~a3d432e98f, baseline=1.50.0-SNAPSHOT~d5d53cd553
dateFormat X
axisFormat %s
section baseline
no_agent (14.974 s) : 14974000, 14974000
. : milestone, 14974000,
appsec (15.003 s) : 15003000, 15003000
. : milestone, 15003000,
iast (18.982 s) : 18982000, 18982000
. : milestone, 18982000,
iast_GLOBAL (17.871 s) : 17871000, 17871000
. : milestone, 17871000,
profiling (14.815 s) : 14815000, 14815000
. : milestone, 14815000,
tracing (15.031 s) : 15031000, 15031000
. : milestone, 15031000,
section candidate
no_agent (14.928 s) : 14928000, 14928000
. : milestone, 14928000,
appsec (14.989 s) : 14989000, 14989000
. : milestone, 14989000,
iast (18.803 s) : 18803000, 18803000
. : milestone, 18803000,
iast_GLOBAL (18.107 s) : 18107000, 18107000
. : milestone, 18107000,
profiling (15.055 s) : 15055000, 15055000
. : milestone, 15055000,
tracing (15.055 s) : 15055000, 15055000
. : milestone, 15055000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent14.974 s [14.974 s, 14.974 s]-
appsec15.003 s [15.003 s, 15.003 s]29.0 ms (0.2%)
iast18.982 s [18.982 s, 18.982 s]4.008 s (26.8%)
iast_GLOBAL17.871 s [17.871 s, 17.871 s]2.897 s (19.3%)
profiling14.815 s [14.815 s, 14.815 s]-159.0 ms (-1.1%)
tracing15.031 s [15.031 s, 15.031 s]57.0 ms (0.4%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent14.928 s [14.928 s, 14.928 s]-
appsec14.989 s [14.989 s, 14.989 s]61.0 ms (0.4%)
iast18.803 s [18.803 s, 18.803 s]3.875 s (26.0%)
iast_GLOBAL18.107 s [18.107 s, 18.107 s]3.179 s (21.3%)
profiling15.055 s [15.055 s, 15.055 s]127.0 ms (0.9%)
tracing15.055 s [15.055 s, 15.055 s]127.0 ms (0.9%)

mcculls
mcculls approved these changes May 7, 2025
View reviewed changes

@mccullsmcculls left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good catch!

@ygree
ygree enabled auto-merge (squash) May 8, 2025 00:55
@ygreeygree mentioned this pull request May 8, 2025
Merged
@ygree
ygree merged commit d8111df into masterMay 8, 2025
@ygree
ygree deleted the ygree/enable-quarkus-native-smoke-test branch May 8, 2025 22:51
@github-actionsgithub-actionsBot added this to the 1.50.0 milestone May 8, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mccullsmccullsmcculls approved these changes
@dougqhdougqhAwaiting requested review from dougqhdougqh is a code owner automatically assigned from DataDog/apm-java

Assignees

@ygreeygree

Labels

comp: testingTestingtag: no release notesChanges to exclude from release notes

Projects

None yet

Milestone

1.50.0

Development

Successfully merging this pull request may close these issues.

2 participants

@ygree@mcculls