Move ClassName filtering initialization by jpbempel · Pull Request #8507 · DataDog/dd-trace-java

jpbempel · 2025-03-04T17:33:16Z

What Does This Do

move the the classname filtering when actual feature are enabled because it adds some overhead at startup to read and parse the third-party list

Motivation

startup perf

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

move the the classname filtering when actual feature are enabled because it adds some overhead at startup to read and parse the third-party list

github-actions · 2025-03-04T17:33:28Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-03-04T17:48:07Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1741109740	1741110122
end_time	2025-03-04T17:36:58	2025-03-04T17:43:19
git_branch	master	jpbempel/fix-init-class-filter
git_commit_sha	`9966995`	`184a2e1`
start_time	2025-03-04T17:35:41	2025-03-04T17:42:03

See matching parameters

	Baseline	Candidate
ci_job_id	832327900	832327900
ci_pipeline_id	57680266	57680266
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1741109133	1741109133

Summary

Found 5 performance improvements and 0 performance regressions! Performance is the same for 5 metrics, 5 unstable metrics.

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:loop	better [-545.432µs; -484.428µs] or [-5.170%; -4.592%]	better [-580.749µs; -481.884µs] or [-5.412%; -4.491%]	better [-559.504µs; -419.477µs] or [-5.175%; -3.880%]	better [-958.539µs; -234.626µs] or [-8.461%; -2.071%]	better [+3.377op/s; +5.528op/s] or [+3.664%; +5.997%]

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-31.209µs; +19.079µs] or [-11.275%; +6.893%]	unstable [-43.353µs; +31.744µs] or [-13.669%; +10.009%]	unstable [-59.426µs; +42.615µs] or [-17.797%; +12.762%]	unstable [-109.285µs; +91.017µs] or [-17.927%; +14.930%]	same
scenario:basic	unsure [-12.884µs; -0.669µs] or [-4.527%; -0.235%]	unsure [-20.426µs; -0.304µs] or [-6.483%; -0.097%]	same	unstable [-112.418µs; -8.162µs] or [-19.492%; -1.415%]	same

Request duration reports for reports

gantt
title reports - request duration [CI 0.99] : candidate=None, baseline=None
dateFormat X
axisFormat %s
section baseline
noprobe (317.164 µs) : 278, 357
. : milestone, 317,
basic (315.057 µs) : 303, 327
. : milestone, 315,
loop (10.73 ms) : 10675, 10785
. : milestone, 10730,
section candidate
noprobe (311.36 µs) : 280, 343
. : milestone, 311,
basic (304.692 µs) : 298, 311
. : milestone, 305,
loop (10.199 ms) : 10164, 10234
. : milestone, 10199,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	317.164 µs [277.581 µs, 356.747 µs]
basic	315.057 µs [302.692 µs, 327.422 µs]
loop	10.73 ms [10.675 ms, 10.785 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	311.36 µs [279.829 µs, 342.89 µs]
basic	304.692 µs [298.334 µs, 311.05 µs]
loop	10.199 ms [10.164 ms, 10.234 ms]

pr-commenter · 2025-03-04T18:09:41Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-init-class-filter
git_commit_date	1741108009	1741109133
git_commit_sha	`9966995`	`184a2e1`
release_version	1.47.0-SNAPSHOT~9966995dd4	1.47.0-SNAPSHOT~184a2e10dd

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741111733	1741111733
ci_job_id	832327894	832327894
ci_pipeline_id	57680266	57680266
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-3sscnlvm-project-304-concurrent-2-49izfhdt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-3sscnlvm-project-304-concurrent-2-49izfhdt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 11 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 5 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Debugger	better [-14.490ms; -12.490ms] or [-17.325%; -14.933%]	70.148ms	83.638ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Debugger	better [-14.102ms; -11.970ms] or [-16.880%; -14.328%]	70.509ms	83.546ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Debugger	better [-13.931ms; -12.472ms] or [-16.773%; -15.016%]	69.856ms	83.058ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config	better [-43.744µs; -13.348µs] or [-8.275%; -2.525%]	500.075µs	528.621µs
scenario:startup:insecure-bank:tracing:Debugger	better [-14.324ms; -12.589ms] or [-15.062%; -13.237%]	81.643ms	95.099ms
scenario:startup:petclinic:appsec:Debugger	better [-14.469ms; -12.772ms] or [-17.204%; -15.186%]	70.483ms	84.103ms
scenario:startup:petclinic:appsec:Remote Config	better [-83.353µs; -48.791µs] or [-13.161%; -7.704%]	567.246µs	633.318µs
scenario:startup:petclinic:appsec:Telemetry	better [-912.342µs; -486.805µs] or [-7.414%; -3.956%]	11.606ms	12.305ms
scenario:startup:petclinic:iast:Debugger	better [-14.880ms; -13.797ms] or [-17.736%; -16.445%]	69.558ms	83.896ms
scenario:startup:petclinic:profiling:Debugger	better [-14.106ms; -12.115ms] or [-16.071%; -13.803%]	74.661ms	87.772ms
scenario:startup:petclinic:tracing:Debugger	better [-14.553ms; -12.266ms] or [-15.373%; -12.957%]	81.256ms	94.666ms
scenario:startup:petclinic:tracing:Remote Config	worse [+13.834µs; +57.324µs] or [+2.415%; +10.006%]	608.469µs	572.890µs

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.137 s) : 0, 1137480
Total [baseline] (9.266 s) : 0, 9266382
Agent [candidate] (1.13 s) : 0, 1129601
Total [candidate] (9.224 s) : 0, 9224351
section iast
Agent [baseline] (1.266 s) : 0, 1266458
Total [baseline] (9.879 s) : 0, 9879376
Agent [candidate] (1.255 s) : 0, 1254746
Total [candidate] (9.848 s) : 0, 9847555
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.258 s) : 0, 1258356
Total [baseline] (9.835 s) : 0, 9835351
Agent [candidate] (1.259 s) : 0, 1259150
Total [candidate] (9.815 s) : 0, 9815201
section iast_TELEMETRY_OFF
Agent [baseline] (1.252 s) : 0, 1252096
Total [baseline] (9.851 s) : 0, 9851287
Agent [candidate] (1.239 s) : 0, 1239440
Total [candidate] (9.804 s) : 0, 9803519

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.137 s	-
Agent	iast	1.266 s	128.978 ms (11.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.258 s	120.876 ms (10.6%)
Agent	iast_TELEMETRY_OFF	1.252 s	114.616 ms (10.1%)
Total	tracing	9.266 s	-
Total	iast	9.879 s	612.994 ms (6.6%)
Total	iast_HARDCODED_SECRET_DISABLED	9.835 s	568.969 ms (6.1%)
Total	iast_TELEMETRY_OFF	9.851 s	584.905 ms (6.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.13 s	-
Agent	iast	1.255 s	125.145 ms (11.1%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.259 s	129.549 ms (11.5%)
Agent	iast_TELEMETRY_OFF	1.239 s	109.839 ms (9.7%)
Total	tracing	9.224 s	-
Total	iast	9.848 s	623.204 ms (6.8%)
Total	iast_HARDCODED_SECRET_DISABLED	9.815 s	590.85 ms (6.4%)
Total	iast_TELEMETRY_OFF	9.804 s	579.168 ms (6.3%)

gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.52 ms) : 0, 718520
BytebuddyAgent [candidate] (722.115 ms) : 0, 722115
GlobalTracer [baseline] (240.45 ms) : 0, 240450
GlobalTracer [candidate] (241.823 ms) : 0, 241823
AppSec [baseline] (55.492 ms) : 0, 55492
AppSec [candidate] (56.346 ms) : 0, 56346
Debugger [baseline] (95.099 ms) : 0, 95099
Debugger [candidate] (81.643 ms) : 0, 81643
Remote Config [baseline] (595.673 µs) : 0, 596
Remote Config [candidate] (592.286 µs) : 0, 592
Telemetry [baseline] (12.371 ms) : 0, 12371
Telemetry [candidate] (11.971 ms) : 0, 11971
section iast
BytebuddyAgent [baseline] (838.467 ms) : 0, 838467
BytebuddyAgent [candidate] (844.449 ms) : 0, 844449
GlobalTracer [baseline] (230.322 ms) : 0, 230322
GlobalTracer [candidate] (232.157 ms) : 0, 232157
AppSec [baseline] (57.119 ms) : 0, 57119
AppSec [candidate] (57.371 ms) : 0, 57371
Debugger [baseline] (83.638 ms) : 0, 83638
Debugger [candidate] (70.148 ms) : 0, 70148
Remote Config [baseline] (520.245 µs) : 0, 520
Remote Config [candidate] (499.642 µs) : 0, 500
Telemetry [baseline] (18.286 ms) : 0, 18286
Telemetry [candidate] (12.064 ms) : 0, 12064
IAST [baseline] (23.117 ms) : 0, 23117
IAST [candidate] (23.013 ms) : 0, 23013
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.103 ms) : 0, 835103
BytebuddyAgent [candidate] (847.055 ms) : 0, 847055
GlobalTracer [baseline] (230.399 ms) : 0, 230399
GlobalTracer [candidate] (232.726 ms) : 0, 232726
AppSec [baseline] (57.399 ms) : 0, 57399
AppSec [candidate] (57.788 ms) : 0, 57788
Debugger [baseline] (83.546 ms) : 0, 83546
Debugger [candidate] (70.509 ms) : 0, 70509
Remote Config [baseline] (520.916 µs) : 0, 521
Remote Config [candidate] (492.57 µs) : 0, 493
Telemetry [baseline] (13.516 ms) : 0, 13516
Telemetry [candidate] (12.045 ms) : 0, 12045
IAST [baseline] (22.943 ms) : 0, 22943
IAST [candidate] (23.433 ms) : 0, 23433
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.945 ms) : 0, 832945
BytebuddyAgent [candidate] (832.624 ms) : 0, 832624
GlobalTracer [baseline] (229.544 ms) : 0, 229544
GlobalTracer [candidate] (230.174 ms) : 0, 230174
AppSec [baseline] (55.85 ms) : 0, 55850
AppSec [candidate] (57.094 ms) : 0, 57094
Debugger [baseline] (83.058 ms) : 0, 83058
Debugger [candidate] (69.856 ms) : 0, 69856
Remote Config [baseline] (528.621 µs) : 0, 529
Remote Config [candidate] (500.075 µs) : 0, 500
Telemetry [baseline] (12.012 ms) : 0, 12012
Telemetry [candidate] (11.821 ms) : 0, 11821
IAST [baseline] (23.157 ms) : 0, 23157
IAST [candidate] (22.385 ms) : 0, 22385

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.136 s) : 0, 1135780
Total [baseline] (11.475 s) : 0, 11475144
Agent [candidate] (1.12 s) : 0, 1120022
Total [candidate] (11.372 s) : 0, 11371967
section appsec
Agent [baseline] (1.276 s) : 0, 1276340
Total [baseline] (11.656 s) : 0, 11656161
Agent [candidate] (1.258 s) : 0, 1258291
Total [candidate] (11.676 s) : 0, 11676030
section iast
Agent [baseline] (1.262 s) : 0, 1262357
Total [baseline] (11.959 s) : 0, 11959435
Agent [candidate] (1.244 s) : 0, 1244106
Total [candidate] (12.03 s) : 0, 12030424
section profiling
Agent [baseline] (1.376 s) : 0, 1376034
Total [baseline] (11.769 s) : 0, 11769086
Agent [candidate] (1.366 s) : 0, 1366470
Total [candidate] (11.844 s) : 0, 11844059

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.136 s	-
Agent	appsec	1.276 s	140.56 ms (12.4%)
Agent	iast	1.262 s	126.577 ms (11.1%)
Agent	profiling	1.376 s	240.254 ms (21.2%)
Total	tracing	11.475 s	-
Total	appsec	11.656 s	181.018 ms (1.6%)
Total	iast	11.959 s	484.292 ms (4.2%)
Total	profiling	11.769 s	293.942 ms (2.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.12 s	-
Agent	appsec	1.258 s	138.269 ms (12.3%)
Agent	iast	1.244 s	124.085 ms (11.1%)
Agent	profiling	1.366 s	246.449 ms (22.0%)
Total	tracing	11.372 s	-
Total	appsec	11.676 s	304.063 ms (2.7%)
Total	iast	12.03 s	658.457 ms (5.8%)
Total	profiling	11.844 s	472.092 ms (4.2%)

gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.546 ms) : 0, 717546
BytebuddyAgent [candidate] (716.203 ms) : 0, 716203
GlobalTracer [baseline] (240.012 ms) : 0, 240012
GlobalTracer [candidate] (239.271 ms) : 0, 239271
AppSec [baseline] (55.661 ms) : 0, 55661
AppSec [candidate] (55.64 ms) : 0, 55640
Debugger [baseline] (94.666 ms) : 0, 94666
Debugger [candidate] (81.256 ms) : 0, 81256
Remote Config [baseline] (572.89 µs) : 0, 573
Remote Config [candidate] (608.469 µs) : 0, 608
Telemetry [baseline] (12.385 ms) : 0, 12385
Telemetry [candidate] (12.013 ms) : 0, 12013
section appsec
BytebuddyAgent [baseline] (738.811 ms) : 0, 738811
BytebuddyAgent [candidate] (736.762 ms) : 0, 736762
GlobalTracer [baseline] (237.073 ms) : 0, 237073
GlobalTracer [candidate] (236.346 ms) : 0, 236346
AppSec [baseline] (177.619 ms) : 0, 177619
AppSec [candidate] (176.825 ms) : 0, 176825
Debugger [baseline] (84.103 ms) : 0, 84103
Debugger [candidate] (70.483 ms) : 0, 70483
Remote Config [baseline] (633.318 µs) : 0, 633
Remote Config [candidate] (567.246 µs) : 0, 567
Telemetry [baseline] (12.305 ms) : 0, 12305
Telemetry [candidate] (11.606 ms) : 0, 11606
IAST [baseline] (21.446 ms) : 0, 21446
IAST [candidate] (21.333 ms) : 0, 21333
section iast
BytebuddyAgent [baseline] (837.14 ms) : 0, 837140
BytebuddyAgent [candidate] (836.079 ms) : 0, 836079
GlobalTracer [baseline] (230.894 ms) : 0, 230894
GlobalTracer [candidate] (231.068 ms) : 0, 231068
AppSec [baseline] (57.109 ms) : 0, 57109
AppSec [candidate] (57.139 ms) : 0, 57139
Debugger [baseline] (83.896 ms) : 0, 83896
Debugger [candidate] (69.558 ms) : 0, 69558
Remote Config [baseline] (512.155 µs) : 0, 512
Remote Config [candidate] (506.693 µs) : 0, 507
Telemetry [baseline] (14.847 ms) : 0, 14847
Telemetry [candidate] (11.951 ms) : 0, 11951
IAST [baseline] (22.976 ms) : 0, 22976
IAST [candidate] (22.849 ms) : 0, 22849
section profiling
BytebuddyAgent [baseline] (708.067 ms) : 0, 708067
BytebuddyAgent [candidate] (709.741 ms) : 0, 709741
GlobalTracer [baseline] (348.915 ms) : 0, 348915
GlobalTracer [candidate] (351.302 ms) : 0, 351302
AppSec [baseline] (54.92 ms) : 0, 54920
AppSec [candidate] (54.978 ms) : 0, 54978
Debugger [baseline] (87.772 ms) : 0, 87772
Debugger [candidate] (74.661 ms) : 0, 74661
Remote Config [baseline] (612.992 µs) : 0, 613
Remote Config [candidate] (610.941 µs) : 0, 611
Telemetry [baseline] (12.488 ms) : 0, 12488
Telemetry [candidate] (12.257 ms) : 0, 12257
ProfilingAgent [baseline] (122.888 ms) : 0, 122888
ProfilingAgent [candidate] (122.63 ms) : 0, 122630
Profiling [baseline] (122.91 ms) : 0, 122910
Profiling [candidate] (122.653 ms) : 0, 122653

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-03-04T17:34:53	2025-03-04T17:42:48
git_branch	master	jpbempel/fix-init-class-filter
git_commit_date	1741108009	1741109133
git_commit_sha	`9966995`	`184a2e1`
release_version	1.47.0-SNAPSHOT~9966995dd4	1.47.0-SNAPSHOT~184a2e10dd
start_time	2025-03-04T17:34:38	2025-03-04T17:42:34

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741110576	1741110576
ci_job_id	832327895	832327895
ci_pipeline_id	57680266	57680266
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-3sscnlvm-project-304-concurrent-3-03ewm1lh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-3sscnlvm-project-304-concurrent-3-03ewm1lh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (1.355 ms) : 1335, 1375
. : milestone, 1355,
appsec (1.737 ms) : 1713, 1761
. : milestone, 1737,
appsec_no_iast (1.731 ms) : 1707, 1754
. : milestone, 1731,
code_origins (1.672 ms) : 1638, 1707
. : milestone, 1672,
iast (1.516 ms) : 1492, 1541
. : milestone, 1516,
profiling (1.518 ms) : 1493, 1543
. : milestone, 1518,
tracing (1.492 ms) : 1468, 1516
. : milestone, 1492,
section candidate
no_agent (1.373 ms) : 1354, 1393
. : milestone, 1373,
appsec (1.734 ms) : 1710, 1758
. : milestone, 1734,
appsec_no_iast (1.711 ms) : 1686, 1736
. : milestone, 1711,
code_origins (1.692 ms) : 1659, 1726
. : milestone, 1692,
iast (1.508 ms) : 1483, 1533
. : milestone, 1508,
profiling (1.527 ms) : 1503, 1551
. : milestone, 1527,
tracing (1.499 ms) : 1475, 1523
. : milestone, 1499,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.355 ms [1.335 ms, 1.375 ms]	-
appsec	1.737 ms [1.713 ms, 1.761 ms]	382.114 µs (28.2%)
appsec_no_iast	1.731 ms [1.707 ms, 1.754 ms]	375.872 µs (27.7%)
code_origins	1.672 ms [1.638 ms, 1.707 ms]	317.382 µs (23.4%)
iast	1.516 ms [1.492 ms, 1.541 ms]	161.435 µs (11.9%)
profiling	1.518 ms [1.493 ms, 1.543 ms]	162.866 µs (12.0%)
tracing	1.492 ms [1.468 ms, 1.516 ms]	137.339 µs (10.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.373 ms [1.354 ms, 1.393 ms]	-
appsec	1.734 ms [1.71 ms, 1.758 ms]	360.58 µs (26.3%)
appsec_no_iast	1.711 ms [1.686 ms, 1.736 ms]	337.557 µs (24.6%)
code_origins	1.692 ms [1.659 ms, 1.726 ms]	318.683 µs (23.2%)
iast	1.508 ms [1.483 ms, 1.533 ms]	134.532 µs (9.8%)
profiling	1.527 ms [1.503 ms, 1.551 ms]	153.17 µs (11.2%)
tracing	1.499 ms [1.475 ms, 1.523 ms]	125.373 µs (9.1%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (384.345 µs) : 364, 405
. : milestone, 384,
iast (528.6 µs) : 506, 551
. : milestone, 529,
iast_FULL (734.963 µs) : 713, 757
. : milestone, 735,
iast_GLOBAL (570.649 µs) : 547, 594
. : milestone, 571,
iast_HARDCODED_SECRET_DISABLED (519.534 µs) : 496, 543
. : milestone, 520,
iast_INACTIVE (472.46 µs) : 451, 494
. : milestone, 472,
iast_TELEMETRY_OFF (507.961 µs) : 485, 531
. : milestone, 508,
tracing (459.71 µs) : 439, 480
. : milestone, 460,
section candidate
no_agent (380.404 µs) : 361, 400
. : milestone, 380,
iast (514.876 µs) : 493, 537
. : milestone, 515,
iast_FULL (731.907 µs) : 710, 754
. : milestone, 732,
iast_GLOBAL (558.716 µs) : 537, 580
. : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (514.328 µs) : 493, 536
. : milestone, 514,
iast_INACTIVE (464.372 µs) : 443, 486
. : milestone, 464,
iast_TELEMETRY_OFF (502.732 µs) : 481, 525
. : milestone, 503,
tracing (460.22 µs) : 439, 481
. : milestone, 460,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	384.345 µs [363.516 µs, 405.173 µs]	-
iast	528.6 µs [506.154 µs, 551.045 µs]	144.255 µs (37.5%)
iast_FULL	734.963 µs [712.674 µs, 757.252 µs]	350.618 µs (91.2%)
iast_GLOBAL	570.649 µs [547.266 µs, 594.032 µs]	186.304 µs (48.5%)
iast_HARDCODED_SECRET_DISABLED	519.534 µs [496.204 µs, 542.863 µs]	135.189 µs (35.2%)
iast_INACTIVE	472.46 µs [450.648 µs, 494.272 µs]	88.115 µs (22.9%)
iast_TELEMETRY_OFF	507.961 µs [485.276 µs, 530.647 µs]	123.617 µs (32.2%)
tracing	459.71 µs [438.977 µs, 480.443 µs]	75.365 µs (19.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	380.404 µs [360.815 µs, 399.993 µs]	-
iast	514.876 µs [493.071 µs, 536.68 µs]	134.472 µs (35.3%)
iast_FULL	731.907 µs [709.691 µs, 754.123 µs]	351.503 µs (92.4%)
iast_GLOBAL	558.716 µs [537.307 µs, 580.126 µs]	178.312 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED	514.328 µs [492.547 µs, 536.109 µs]	133.924 µs (35.2%)
iast_INACTIVE	464.372 µs [442.868 µs, 485.877 µs]	83.968 µs (22.1%)
iast_TELEMETRY_OFF	502.732 µs [480.837 µs, 524.627 µs]	122.329 µs (32.2%)
tracing	460.22 µs [439.02 µs, 481.42 µs]	79.816 µs (21.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/fix-init-class-filter
git_commit_date	1741108009	1741109133
git_commit_sha	`9966995`	`184a2e1`
release_version	1.47.0-SNAPSHOT~9966995dd4	1.47.0-SNAPSHOT~184a2e10dd

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1741111237	1741111237
ci_job_id	832327896	832327896
ci_pipeline_id	57680266	57680266
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-njn2trh-project-304-concurrent-2-di4htf11 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-njn2trh-project-304-concurrent-2-di4htf11 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
. : milestone, 1476,
appsec (2.342 ms) : 2299, 2386
. : milestone, 2342,
iast (2.114 ms) : 2059, 2169
. : milestone, 2114,
iast_GLOBAL (2.177 ms) : 2121, 2234
. : milestone, 2177,
profiling (1.969 ms) : 1925, 2012
. : milestone, 1969,
tracing (1.942 ms) : 1900, 1984
. : milestone, 1942,
section candidate
no_agent (1.477 ms) : 1466, 1489
. : milestone, 1477,
appsec (2.348 ms) : 2304, 2391
. : milestone, 2348,
iast (2.12 ms) : 2065, 2175
. : milestone, 2120,
iast_GLOBAL (2.161 ms) : 2106, 2217
. : milestone, 2161,
profiling (1.97 ms) : 1927, 2013
. : milestone, 1970,
tracing (1.935 ms) : 1893, 1977
. : milestone, 1935,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	2.342 ms [2.299 ms, 2.386 ms]	866.081 µs (58.7%)
iast	2.114 ms [2.059 ms, 2.169 ms]	637.499 µs (43.2%)
iast_GLOBAL	2.177 ms [2.121 ms, 2.234 ms]	701.006 µs (47.5%)
profiling	1.969 ms [1.925 ms, 2.012 ms]	492.196 µs (33.3%)
tracing	1.942 ms [1.9 ms, 1.984 ms]	465.808 µs (31.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	2.348 ms [2.304 ms, 2.391 ms]	870.125 µs (58.9%)
iast	2.12 ms [2.065 ms, 2.175 ms]	642.636 µs (43.5%)
iast_GLOBAL	2.161 ms [2.106 ms, 2.217 ms]	684.054 µs (46.3%)
profiling	1.97 ms [1.927 ms, 2.013 ms]	492.411 µs (33.3%)
tracing	1.935 ms [1.893 ms, 1.977 ms]	457.43 µs (31.0%)

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~184a2e10dd, baseline=1.47.0-SNAPSHOT~9966995dd4
dateFormat X
axisFormat %s
section baseline
no_agent (15.414 s) : 15414000, 15414000
. : milestone, 15414000,
appsec (14.894 s) : 14894000, 14894000
. : milestone, 14894000,
iast (18.562 s) : 18562000, 18562000
. : milestone, 18562000,
iast_GLOBAL (17.983 s) : 17983000, 17983000
. : milestone, 17983000,
profiling (15.432 s) : 15432000, 15432000
. : milestone, 15432000,
tracing (15.061 s) : 15061000, 15061000
. : milestone, 15061000,
section candidate
no_agent (15.517 s) : 15517000, 15517000
. : milestone, 15517000,
appsec (15.054 s) : 15054000, 15054000
. : milestone, 15054000,
iast (18.13 s) : 18130000, 18130000
. : milestone, 18130000,
iast_GLOBAL (17.829 s) : 17829000, 17829000
. : milestone, 17829000,
profiling (15.016 s) : 15016000, 15016000
. : milestone, 15016000,
tracing (14.78 s) : 14780000, 14780000
. : milestone, 14780000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.414 s [15.414 s, 15.414 s]	-
appsec	14.894 s [14.894 s, 14.894 s]	-520.0 ms (-3.4%)
iast	18.562 s [18.562 s, 18.562 s]	3.148 s (20.4%)
iast_GLOBAL	17.983 s [17.983 s, 17.983 s]	2.569 s (16.7%)
profiling	15.432 s [15.432 s, 15.432 s]	18.0 ms (0.1%)
tracing	15.061 s [15.061 s, 15.061 s]	-353.0 ms (-2.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.517 s [15.517 s, 15.517 s]	-
appsec	15.054 s [15.054 s, 15.054 s]	-463.0 ms (-3.0%)
iast	18.13 s [18.13 s, 18.13 s]	2.613 s (16.8%)
iast_GLOBAL	17.829 s [17.829 s, 17.829 s]	2.312 s (14.9%)
profiling	15.016 s [15.016 s, 15.016 s]	-501.0 ms (-3.2%)
tracing	14.78 s [14.78 s, 14.78 s]	-737.0 ms (-4.7%)

jpbempel · 2025-03-24T09:09:25Z

supersede by #8587

Move ClassName filtering initialization
184a2e1
move the the classname filtering when actual feature are enabled because it adds some overhead at startup to read and parse the third-party list

jpbempel requested a review from a team as a code owner March 4, 2025 17:33

jpbempel requested review from ojung and removed request for a teamMarch 4, 2025 17:33

jpbempel added comp: debugger Dynamic Instrumentation type: refactoring tag: no release notes Changes to exclude from release notes labels Mar 4, 2025

jpbempel closed this Mar 24, 2025

Navigation Menu

Uh oh!

Move ClassName filtering initialization - #8507

Move ClassName filtering initialization#8507
jpbempel wants to merge 1 commit into
masterfrom
jpbempel/fix-init-class-filter

jpbempel commented Mar 4, 2025

Uh oh!

github-actionsBot commented Mar 4, 2025•
edited
Loading

Uh oh!

pr-commenterBot commented Mar 4, 2025

Uh oh!

pr-commenterBot commented Mar 4, 2025

Uh oh!

jpbempel commented Mar 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

jpbempel commented Mar 4, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actionsBot commented Mar 4, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenterBot commented Mar 4, 2025

Debugger benchmarks

Parameters

Summary

Uh oh!

pr-commenterBot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

jpbempel commented Mar 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

github-actionsBot commented Mar 4, 2025•
edited
Loading