Skip to content

Revert "Add In-Product Enablement (#8461)" - #8509

Merged
jpbempel merged 2 commits into
masterfrom
jpbempel/revert-inproduct
Mar 4, 2025
Merged

Revert "Add In-Product Enablement (#8461)"#8509
jpbempel merged 2 commits into
masterfrom
jpbempel/revert-inproduct

Conversation

@jpbempel

Copy link
Copy Markdown
Member

This reverts commit dceca28.

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@jpbempel
jpbempel requested review from a team as code ownersMarch 4, 2025 20:32
@jpbempel
jpbempel requested review from evanchooly and smola and removed request for a teamMarch 4, 2025 20:32
@github-actions

github-actionsBot commented Mar 4, 2025

Copy link
Copy Markdown
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@mccullsmcculls added the comp: debugger Dynamic Instrumentation label Mar 4, 2025
@pr-commenter

Copy link
Copy Markdown

Debugger benchmarks

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
ci_job_date17411212531741121623
end_time2025-03-04T20:48:512025-03-04T20:55:01
git_branchmasterjpbempel/revert-inproduct
git_commit_sha951960b0e7e060
start_time2025-03-04T20:47:342025-03-04T20:53:44
See matching parameters
BaselineCandidate
ci_job_id832677389832677389
ci_pipeline_id5771005457710054
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date17411206651741120665

Summary

Found 0 performance improvements and 5 performance regressions! Performance is the same for 4 metrics, 6 unstable metrics.

scenarioΔ mean agg_http_req_duration_minΔ mean agg_http_req_duration_p50Δ mean agg_http_req_duration_p75Δ mean agg_http_req_duration_p99Δ mean throughput
scenario:loopworse
[+1.313ms; +1.341ms] or [+13.168%; +13.453%]
worse
[+1.331ms; +1.405ms] or [+13.143%; +13.876%]
worse
[+1.278ms; +1.385ms] or [+12.493%; +13.542%]
worse
[+1.147ms; +2.033ms] or [+10.827%; +19.185%]
worse
[-12.170op/s; -9.591op/s] or [-12.535%; -9.879%]
See unchanged results
scenarioΔ mean agg_http_req_duration_minΔ mean agg_http_req_duration_p50Δ mean agg_http_req_duration_p75Δ mean agg_http_req_duration_p99Δ mean throughput
scenario:noprobeunstable
[-37.828µs; +33.481µs] or [-13.500%; +11.949%]
unstable
[-56.273µs; +43.910µs] or [-17.347%; +13.536%]
unstable
[-66.642µs; +55.423µs] or [-19.660%; +16.351%]
unstable
[-461.301µs; +215.518µs] or [-63.174%; +29.514%]
same
scenario:basicsamesamesameunstable
[-54.448µs; +47.091µs] or [-10.251%; +8.866%]
unstable
[-236.034op/s; +107.829op/s] or [-9.205%; +4.205%]
Request duration reports for reports
gantt
title reports - request duration [CI 0.99] : candidate=None, baseline=None
dateFormat X
axisFormat %s
section baseline
noprobe (324.395 µs) : 269, 380
. : milestone, 324,
basic (307.207 µs) : 292, 322
. : milestone, 307,
loop (10.123 ms) : 10087, 10159
. : milestone, 10123,
section candidate
noprobe (318.214 µs) : 280, 357
. : milestone, 318,
basic (310.222 µs) : 301, 319
. : milestone, 310,
loop (11.491 ms) : 11458, 11523
. : milestone, 11491,
Loading
  • baseline results
ScenarioRequest median duration [CI 0.99]
noprobe324.395 µs [268.827 µs, 379.964 µs]
basic307.207 µs [292.166 µs, 322.248 µs]
loop10.123 ms [10.087 ms, 10.159 ms]
  • candidate results
ScenarioRequest median duration [CI 0.99]
noprobe318.214 µs [279.891 µs, 356.536 µs]
basic310.222 µs [301.493 µs, 318.951 µs]
loop11.491 ms [11.458 ms, 11.523 ms]

@pr-commenter

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterjpbempel/revert-inproduct
git_commit_date17411120771741120665
git_commit_sha951960b0e7e060
release_version1.47.0-SNAPSHOT~951960b7951.47.0-SNAPSHOT~0e7e06075a
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17411231761741123176
ci_job_id832677383832677383
ci_pipeline_id5771005457710054
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-tlq2fia6-project-304-concurrent-0-co4ttt6w 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-tlq2fia6-project-304-concurrent-0-co4ttt6w 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone
variantiastiast

Summary

Found 21 performance improvements and 6 performance regressions! Performance is the same for 28 metrics, 8 unstable metrics.

scenarioΔ mean execution_timecandidate mean execution_timebaseline mean execution_time
scenario:startup:insecure-bank:iast:Agentbetter
[-687.164ms; -592.624ms] or [-6.955%; -5.998%]
9.241s9.881s
scenario:startup:insecure-bank:iast:Agent.startbetter
[-92.289ms; -57.852ms] or [-7.364%; -4.616%]
1.178s1.253s
scenario:startup:insecure-bank:iast:Remote Configworse
[+88.147µs; +128.106µs] or [+17.278%; +25.110%]
618.297µs510.171µs
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agentbetter
[-695.984ms; -614.612ms] or [-7.068%; -6.241%]
9.192s9.847s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.startbetter
[-92.453ms; -82.118ms] or [-7.369%; -6.545%]
1.167s1.255s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Remote Configworse
[+91.073µs; +128.945µs] or [+17.816%; +25.225%]
621.186µs511.177µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agentbetter
[-718.480ms; -535.530ms] or [-7.249%; -5.403%]
9.284s9.911s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.startbetter
[-111.028ms; -77.234ms] or [-8.815%; -6.132%]
1.165s1.260s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Configworse
[+84.377µs; +123.317µs] or [+16.189%; +23.660%]
625.050µs521.202µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Telemetrybetter
[-3.553ms; -3.123ms] or [-29.360%; -25.809%]
8.763ms12.101ms
scenario:startup:insecure-bank:tracing:Agentbetter
[-700.133ms; -546.893ms] or [-7.529%; -5.881%]
8.676s9.299s
scenario:startup:insecure-bank:tracing:Agent.startbetter
[-106.041ms; -90.335ms] or [-9.342%; -7.959%]
1.037s1.135s
scenario:startup:insecure-bank:tracing:Remote Configworse
[+99.007µs; +142.326µs] or [+16.935%; +24.345%]
705.286µs584.620µs
scenario:startup:petclinic:appsec:Agentbetter
[-1001.570ms; -777.730ms] or [-8.605%; -6.682%]
10.750s11.640s
scenario:startup:petclinic:appsec:Agent.startbetter
[-97.669ms; -81.796ms] or [-7.680%; -6.432%]
1.182s1.272s
scenario:startup:petclinic:appsec:Telemetrybetter
[-4.233ms; -3.877ms] or [-34.245%; -31.358%]
8.307ms12.362ms
scenario:startup:petclinic:iast:Agentbetter
[-1.102s; -0.931s] or [-9.220%; -7.790%]
10.933s11.949s
scenario:startup:petclinic:iast:Agent.startbetter
[-94.560ms; -83.633ms] or [-7.512%; -6.644%]
1.170s1.259s
scenario:startup:petclinic:iast:Remote Configworse
[+70.345µs; +102.649µs] or [+13.409%; +19.567%]
611.102µs524.605µs
scenario:startup:petclinic:profiling:Agentbetter
[-1050.550ms; -825.748ms] or [-8.900%; -6.996%]
10.865s11.804s
scenario:startup:petclinic:profiling:Agent.startbetter
[-121.917ms; -106.723ms] or [-8.852%; -7.749%]
1.263s1.377s
scenario:startup:petclinic:profiling:ProfilingAgentbetter
[-28.475ms; -24.239ms] or [-23.154%; -19.710%]
96.622ms122.979ms
scenario:startup:petclinic:profiling:Telemetrybetter
[-3.674ms; -3.145ms] or [-29.308%; -25.082%]
9.128ms12.538ms
scenario:startup:petclinic:profiling:Profilingbetter
[-28.471ms; -24.233ms] or [-23.147%; -19.702%]
96.648ms123.000ms
scenario:startup:petclinic:tracing:Agentbetter
[-1.203s; -0.943s] or [-10.444%; -8.183%]
10.449s11.522s
scenario:startup:petclinic:tracing:Agent.startbetter
[-104.250ms; -75.570ms] or [-9.183%; -6.656%]
1.045s1.135s
scenario:startup:petclinic:tracing:Remote Configworse
[+98.300µs; +131.506µs] or [+16.885%; +22.588%]
697.085µs582.182µs
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~0e7e06075a, baseline=1.47.0-SNAPSHOT~951960b795
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.135 s) : 0, 1135305
Total [baseline] (11.522 s) : 0, 11521842
Agent [candidate] (1.045 s) : 0, 1045395
Total [candidate] (10.449 s) : 0, 10448732
section appsec
Agent [baseline] (1.272 s) : 0, 1271688
Total [baseline] (11.64 s) : 0, 11639740
Agent [candidate] (1.182 s) : 0, 1181956
Total [candidate] (10.75 s) : 0, 10750090
section iast
Agent [baseline] (1.259 s) : 0, 1258758
Total [baseline] (11.949 s) : 0, 11949318
Agent [candidate] (1.17 s) : 0, 1169662
Total [candidate] (10.933 s) : 0, 10933036
section profiling
Agent [baseline] (1.377 s) : 0, 1377252
Total [baseline] (11.804 s) : 0, 11803527
Agent [candidate] (1.263 s) : 0, 1262932
Total [candidate] (10.865 s) : 0, 10865378
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.135 s-
Agentappsec1.272 s136.383 ms (12.0%)
Agentiast1.259 s123.453 ms (10.9%)
Agentprofiling1.377 s241.947 ms (21.3%)
Totaltracing11.522 s-
Totalappsec11.64 s117.898 ms (1.0%)
Totaliast11.949 s427.476 ms (3.7%)
Totalprofiling11.804 s281.685 ms (2.4%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.045 s-
Agentappsec1.182 s136.561 ms (13.1%)
Agentiast1.17 s124.267 ms (11.9%)
Agentprofiling1.263 s217.537 ms (20.8%)
Totaltracing10.449 s-
Totalappsec10.75 s301.358 ms (2.9%)
Totaliast10.933 s484.304 ms (4.6%)
Totalprofiling10.865 s416.646 ms (4.0%)
gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~0e7e06075a, baseline=1.47.0-SNAPSHOT~951960b795
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.798 ms) : 0, 716798
BytebuddyAgent [candidate] (720.829 ms) : 0, 720829
GlobalTracer [baseline] (239.147 ms) : 0, 239147
GlobalTracer [candidate] (240.773 ms) : 0, 240773
AppSec [baseline] (55.86 ms) : 0, 55860
AppSec [candidate] (55.84 ms) : 0, 55840
Remote Config [baseline] (582.182 µs) : 0, 582
Remote Config [candidate] (697.085 µs) : 0, 697
Telemetry [baseline] (12.547 ms) : 0, 12547
Telemetry [candidate] (12.286 ms) : 0, 12286
Debugger [baseline] (95.441 ms) : 0, 95441
section appsec
BytebuddyAgent [baseline] (734.097 ms) : 0, 734097
BytebuddyAgent [candidate] (734.151 ms) : 0, 734151
GlobalTracer [baseline] (236.471 ms) : 0, 236471
GlobalTracer [candidate] (236.126 ms) : 0, 236126
IAST [baseline] (21.493 ms) : 0, 21493
IAST [candidate] (21.537 ms) : 0, 21537
AppSec [baseline] (178.127 ms) : 0, 178127
AppSec [candidate] (177.041 ms) : 0, 177041
Remote Config [baseline] (639.873 µs) : 0, 640
Remote Config [candidate] (670.29 µs) : 0, 670
Telemetry [baseline] (12.362 ms) : 0, 12362
Telemetry [candidate] (8.307 ms) : 0, 8307
Debugger [baseline] (84.292 ms) : 0, 84292
section iast
BytebuddyAgent [baseline] (835.898 ms) : 0, 835898
BytebuddyAgent [candidate] (835.295 ms) : 0, 835295
GlobalTracer [baseline] (229.956 ms) : 0, 229956
GlobalTracer [candidate] (229.907 ms) : 0, 229907
IAST [baseline] (22.575 ms) : 0, 22575
IAST [candidate] (22.965 ms) : 0, 22965
AppSec [baseline] (57.257 ms) : 0, 57257
AppSec [candidate] (57.258 ms) : 0, 57258
Remote Config [baseline] (524.605 µs) : 0, 525
Remote Config [candidate] (611.102 µs) : 0, 611
Telemetry [baseline] (14.314 ms) : 0, 14314
Telemetry [candidate] (8.693 ms) : 0, 8693
Debugger [baseline] (83.183 ms) : 0, 83183
section profiling
BytebuddyAgent [baseline] (707.32 ms) : 0, 707320
BytebuddyAgent [candidate] (708.819 ms) : 0, 708819
GlobalTracer [baseline] (349.744 ms) : 0, 349744
GlobalTracer [candidate] (352.278 ms) : 0, 352278
AppSec [baseline] (55.162 ms) : 0, 55162
AppSec [candidate] (54.965 ms) : 0, 54965
Remote Config [baseline] (635.997 µs) : 0, 636
Remote Config [candidate] (677.238 µs) : 0, 677
Telemetry [baseline] (12.538 ms) : 0, 12538
Telemetry [candidate] (9.128 ms) : 0, 9128
Debugger [baseline] (88.476 ms) : 0, 88476
ProfilingAgent [baseline] (122.979 ms) : 0, 122979
ProfilingAgent [candidate] (96.622 ms) : 0, 96622
Profiling [baseline] (123.0 ms) : 0, 123000
Profiling [candidate] (96.648 ms) : 0, 96648
Loading
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~0e7e06075a, baseline=1.47.0-SNAPSHOT~951960b795
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.135 s) : 0, 1135071
Total [baseline] (9.299 s) : 0, 9299223
Agent [candidate] (1.037 s) : 0, 1036883
Total [candidate] (8.676 s) : 0, 8675710
section iast
Agent [baseline] (1.253 s) : 0, 1253272
Total [baseline] (9.881 s) : 0, 9880595
Agent [candidate] (1.178 s) : 0, 1178201
Total [candidate] (9.241 s) : 0, 9240701
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.255 s) : 0, 1254623
Total [baseline] (9.847 s) : 0, 9847407
Agent [candidate] (1.167 s) : 0, 1167338
Total [candidate] (9.192 s) : 0, 9192109
section iast_TELEMETRY_OFF
Agent [baseline] (1.26 s) : 0, 1259558
Total [baseline] (9.911 s) : 0, 9910843
Agent [candidate] (1.165 s) : 0, 1165427
Total [candidate] (9.284 s) : 0, 9283838
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.135 s-
Agentiast1.253 s118.2 ms (10.4%)
Agentiast_HARDCODED_SECRET_DISABLED1.255 s119.552 ms (10.5%)
Agentiast_TELEMETRY_OFF1.26 s124.487 ms (11.0%)
Totaltracing9.299 s-
Totaliast9.881 s581.372 ms (6.3%)
Totaliast_HARDCODED_SECRET_DISABLED9.847 s548.184 ms (5.9%)
Totaliast_TELEMETRY_OFF9.911 s611.62 ms (6.6%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.037 s-
Agentiast1.178 s141.318 ms (13.6%)
Agentiast_HARDCODED_SECRET_DISABLED1.167 s130.455 ms (12.6%)
Agentiast_TELEMETRY_OFF1.165 s128.544 ms (12.4%)
Totaltracing8.676 s-
Totaliast9.241 s564.991 ms (6.5%)
Totaliast_HARDCODED_SECRET_DISABLED9.192 s516.399 ms (6.0%)
Totaliast_TELEMETRY_OFF9.284 s608.128 ms (7.0%)
gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~0e7e06075a, baseline=1.47.0-SNAPSHOT~951960b795
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.532 ms) : 0, 717532
BytebuddyAgent [candidate] (715.451 ms) : 0, 715451
GlobalTracer [baseline] (239.401 ms) : 0, 239401
GlobalTracer [candidate] (239.977 ms) : 0, 239977
AppSec [baseline] (55.447 ms) : 0, 55447
AppSec [candidate] (55.776 ms) : 0, 55776
Remote Config [baseline] (584.62 µs) : 0, 585
Remote Config [candidate] (705.286 µs) : 0, 705
Telemetry [baseline] (12.402 ms) : 0, 12402
Telemetry [candidate] (10.095 ms) : 0, 10095
Debugger [baseline] (94.688 ms) : 0, 94688
section iast
BytebuddyAgent [baseline] (832.459 ms) : 0, 832459
BytebuddyAgent [candidate] (842.161 ms) : 0, 842161
GlobalTracer [baseline] (229.651 ms) : 0, 229651
GlobalTracer [candidate] (231.097 ms) : 0, 231097
IAST [baseline] (22.537 ms) : 0, 22537
IAST [candidate] (23.131 ms) : 0, 23131
AppSec [baseline] (56.528 ms) : 0, 56528
AppSec [candidate] (57.403 ms) : 0, 57403
Remote Config [baseline] (510.171 µs) : 0, 510
Remote Config [candidate] (618.297 µs) : 0, 618
Telemetry [baseline] (13.58 ms) : 0, 13580
Telemetry [candidate] (8.792 ms) : 0, 8792
Debugger [baseline] (83.092 ms) : 0, 83092
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (832.253 ms) : 0, 832253
BytebuddyAgent [candidate] (833.581 ms) : 0, 833581
GlobalTracer [baseline] (229.908 ms) : 0, 229908
GlobalTracer [candidate] (229.707 ms) : 0, 229707
IAST [baseline] (22.773 ms) : 0, 22773
IAST [candidate] (22.79 ms) : 0, 22790
AppSec [baseline] (57.079 ms) : 0, 57079
AppSec [candidate] (57.06 ms) : 0, 57060
Remote Config [baseline] (511.177 µs) : 0, 511
Remote Config [candidate] (621.186 µs) : 0, 621
Telemetry [baseline] (13.519 ms) : 0, 13519
Telemetry [candidate] (8.668 ms) : 0, 8668
Debugger [baseline] (83.597 ms) : 0, 83597
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (836.671 ms) : 0, 836671
BytebuddyAgent [candidate] (831.678 ms) : 0, 831678
GlobalTracer [baseline] (231.219 ms) : 0, 231219
GlobalTracer [candidate] (229.639 ms) : 0, 229639
IAST [baseline] (24.28 ms) : 0, 24280
IAST [candidate] (24.662 ms) : 0, 24662
AppSec [baseline] (55.698 ms) : 0, 55698
AppSec [candidate] (55.108 ms) : 0, 55108
Remote Config [baseline] (521.202 µs) : 0, 521
Remote Config [candidate] (625.05 µs) : 0, 625
Telemetry [baseline] (12.101 ms) : 0, 12101
Telemetry [candidate] (8.763 ms) : 0, 8763
Debugger [baseline] (83.989 ms) : 0, 83989
Loading

Load

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
end_time2025-03-04T20:48:462025-03-04T20:56:41
git_branchmasterjpbempel/revert-inproduct
git_commit_date17411120771741120665
git_commit_sha951960b0e7e060
release_version1.47.0-SNAPSHOT~951960b7951.47.0-SNAPSHOT~0e7e06075a
start_time2025-03-04T20:48:322025-03-04T20:56:27
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17411222021741122202
ci_job_id832677384832677384
ci_pipeline_id5771005457710054
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-oxfzpu-project-304-concurrent-2-qkt4mlxx 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-oxfzpu-project-304-concurrent-2-qkt4mlxx 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variantiastiast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0e7e06075a, baseline=1.47.0-SNAPSHOT~951960b795
dateFormat X
axisFormat %s
section baseline
no_agent (396.778 µs) : 377, 417
. : milestone, 397,
iast (520.539 µs) : 498, 543
. : milestone, 521,
iast_FULL (738.566 µs) : 716, 761
. : milestone, 739,
iast_GLOBAL (579.791 µs) : 555, 604
. : milestone, 580,
iast_HARDCODED_SECRET_DISABLED (514.722 µs) : 493, 537
. : milestone, 515,
iast_INACTIVE (473.442 µs) : 452, 495
. : milestone, 473,
iast_TELEMETRY_OFF (510.459 µs) : 488, 533
. : milestone, 510,
tracing (465.36 µs) : 444, 487
. : milestone, 465,
section candidate
no_agent (388.118 µs) : 368, 408
. : milestone, 388,
iast (518.983 µs) : 497, 541
. : milestone, 519,
iast_FULL (737.274 µs) : 715, 759
. : milestone, 737,
iast_GLOBAL (572.339 µs) : 549, 596
. : milestone, 572,
iast_HARDCODED_SECRET_DISABLED (516.625 µs) : 494, 539
. : milestone, 517,
iast_INACTIVE (478.907 µs) : 457, 500
. : milestone, 479,
iast_TELEMETRY_OFF (514.259 µs) : 492, 536
. : milestone, 514,
tracing (459.48 µs) : 439, 480
. : milestone, 459,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent396.778 µs [377.028 µs, 416.528 µs]-
iast520.539 µs [498.231 µs, 542.847 µs]123.761 µs (31.2%)
iast_FULL738.566 µs [716.364 µs, 760.768 µs]341.788 µs (86.1%)
iast_GLOBAL579.791 µs [555.234 µs, 604.347 µs]183.012 µs (46.1%)
iast_HARDCODED_SECRET_DISABLED514.722 µs [492.934 µs, 536.509 µs]117.943 µs (29.7%)
iast_INACTIVE473.442 µs [451.993 µs, 494.891 µs]76.663 µs (19.3%)
iast_TELEMETRY_OFF510.459 µs [488.037 µs, 532.881 µs]113.68 µs (28.7%)
tracing465.36 µs [443.611 µs, 487.11 µs]68.582 µs (17.3%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent388.118 µs [368.405 µs, 407.832 µs]-
iast518.983 µs [497.379 µs, 540.588 µs]130.865 µs (33.7%)
iast_FULL737.274 µs [715.345 µs, 759.204 µs]349.156 µs (90.0%)
iast_GLOBAL572.339 µs [548.914 µs, 595.765 µs]184.221 µs (47.5%)
iast_HARDCODED_SECRET_DISABLED516.625 µs [493.931 µs, 539.319 µs]128.507 µs (33.1%)
iast_INACTIVE478.907 µs [457.393 µs, 500.421 µs]90.789 µs (23.4%)
iast_TELEMETRY_OFF514.259 µs [492.197 µs, 536.321 µs]126.141 µs (32.5%)
tracing459.48 µs [438.962 µs, 479.999 µs]71.362 µs (18.4%)
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0e7e06075a, baseline=1.47.0-SNAPSHOT~951960b795
dateFormat X
axisFormat %s
section baseline
no_agent (1.37 ms) : 1351, 1390
. : milestone, 1370,
appsec (1.742 ms) : 1718, 1765
. : milestone, 1742,
appsec_no_iast (1.752 ms) : 1728, 1775
. : milestone, 1752,
code_origins (1.695 ms) : 1661, 1729
. : milestone, 1695,
iast (1.522 ms) : 1497, 1546
. : milestone, 1522,
profiling (1.508 ms) : 1483, 1532
. : milestone, 1508,
tracing (1.504 ms) : 1480, 1527
. : milestone, 1504,
section candidate
no_agent (1.365 ms) : 1346, 1385
. : milestone, 1365,
appsec (1.727 ms) : 1702, 1751
. : milestone, 1727,
appsec_no_iast (1.73 ms) : 1703, 1756
. : milestone, 1730,
code_origins (1.674 ms) : 1640, 1708
. : milestone, 1674,
iast (1.514 ms) : 1491, 1538
. : milestone, 1514,
profiling (1.518 ms) : 1495, 1541
. : milestone, 1518,
tracing (1.509 ms) : 1485, 1534
. : milestone, 1509,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.37 ms [1.351 ms, 1.39 ms]-
appsec1.742 ms [1.718 ms, 1.765 ms]371.17 µs (27.1%)
appsec_no_iast1.752 ms [1.728 ms, 1.775 ms]381.523 µs (27.8%)
code_origins1.695 ms [1.661 ms, 1.729 ms]324.807 µs (23.7%)
iast1.522 ms [1.497 ms, 1.546 ms]151.23 µs (11.0%)
profiling1.508 ms [1.483 ms, 1.532 ms]137.18 µs (10.0%)
tracing1.504 ms [1.48 ms, 1.527 ms]133.453 µs (9.7%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent1.365 ms [1.346 ms, 1.385 ms]-
appsec1.727 ms [1.702 ms, 1.751 ms]361.263 µs (26.5%)
appsec_no_iast1.73 ms [1.703 ms, 1.756 ms]364.271 µs (26.7%)
code_origins1.674 ms [1.64 ms, 1.708 ms]308.316 µs (22.6%)
iast1.514 ms [1.491 ms, 1.538 ms]149.07 µs (10.9%)
profiling1.518 ms [1.495 ms, 1.541 ms]152.749 µs (11.2%)
tracing1.509 ms [1.485 ms, 1.534 ms]144.188 µs (10.6%)

Dacapo

@jpbempel
jpbempel merged commit 7787c9d into masterMar 4, 2025
@jpbempel
jpbempel deleted the jpbempel/revert-inproduct branch March 4, 2025 21:43
@github-actionsgithub-actionsBot added this to the 1.47.0 milestone Mar 4, 2025
@mccullsmcculls added the tag: no release notes Changes to exclude from release notes label Mar 4, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: debuggerDynamic Instrumentationtag: no release notesChanges to exclude from release notestype: refactoring

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jpbempel@mcculls