Enable API Security by default and make it lazy loading by smola · Pull Request #9009 · DataDog/dd-trace-java

smola · 2025-06-19T09:34:50Z

What Does This Do

Bring back #8511
Original attempt was reverted because of a regression in startup time. This PR brings back the feature, but with lazy loading of the sampling, which removes the startup overhead when AppSec is not enabled.

Change DD_API_SECURITY_ENABLED=true by default. This should have impact only when AppSec is enabled.

This feature es effectively enabled only if AppSec is also enabled.

Motivation

API Security is now core functionality to the App & API Protection (AppSec), so we want it to be available by default to all AppSec customers.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APPSEC-57850

smola · 2025-06-19T09:40:39Z

From here onwards, this is just spotless being funny.

Let it have its fun then 😓

pr-commenter · 2025-06-19T10:07:41Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/api-security-startup-time
git_commit_date	1750340918	1750342351
git_commit_sha	`f47ab39`	`ba6bea4`
release_version	1.50.0-SNAPSHOT~f47ab3945d	1.50.0-SNAPSHOT~ba6bea4fa9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1750344081	1750344081
ci_job_id	990209658	990209658
ci_pipeline_id	68245760	68245760
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-emldojjo-project-304-concurrent-0-ti9pxmms 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-emldojjo-project-304-concurrent-0-ti9pxmms 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 40 metrics, 12 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:petclinic:tracing:Remote Config	better [-90.830µs; -49.263µs] or [-12.335%; -6.690%]	666.291µs	736.338µs

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.029 s) : 0, 1029298
Total [baseline] (8.548 s) : 0, 8547935
Agent [candidate] (1.025 s) : 0, 1025049
Total [candidate] (8.565 s) : 0, 8564893
section iast
Agent [baseline] (1.153 s) : 0, 1152828
Total [baseline] (9.191 s) : 0, 9190826
Agent [candidate] (1.156 s) : 0, 1155699
Total [candidate] (9.184 s) : 0, 9184397

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.029 s	-
Agent	iast	1.153 s	123.53 ms (12.0%)
Total	tracing	8.548 s	-
Total	iast	9.191 s	642.891 ms (7.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.025 s	-
Agent	iast	1.156 s	130.649 ms (12.7%)
Total	tracing	8.565 s	-
Total	iast	9.184 s	619.504 ms (7.2%)

gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.403 ms) : 0, 686403
BytebuddyAgent [candidate] (683.385 ms) : 0, 683385
GlobalTracer [baseline] (242.662 ms) : 0, 242662
GlobalTracer [candidate] (241.147 ms) : 0, 241147
AppSec [baseline] (56.448 ms) : 0, 56448
AppSec [candidate] (56.563 ms) : 0, 56563
Debugger [baseline] (9.132 ms) : 0, 9132
Debugger [candidate] (7.024 ms) : 0, 7024
Remote Config [baseline] (750.422 µs) : 0, 750
Remote Config [candidate] (720.53 µs) : 0, 721
Telemetry [baseline] (10.406 ms) : 0, 10406
Telemetry [candidate] (12.759 ms) : 0, 12759
section iast
BytebuddyAgent [baseline] (804.652 ms) : 0, 804652
BytebuddyAgent [candidate] (805.932 ms) : 0, 805932
GlobalTracer [baseline] (231.155 ms) : 0, 231155
GlobalTracer [candidate] (231.733 ms) : 0, 231733
IAST [baseline] (26.022 ms) : 0, 26022
IAST [candidate] (26.934 ms) : 0, 26934
AppSec [baseline] (52.213 ms) : 0, 52213
AppSec [candidate] (53.055 ms) : 0, 53055
Debugger [baseline] (5.94 ms) : 0, 5940
Debugger [candidate] (5.983 ms) : 0, 5983
Remote Config [baseline] (594.555 µs) : 0, 595
Remote Config [candidate] (616.79 µs) : 0, 617
Telemetry [baseline] (7.919 ms) : 0, 7919
Telemetry [candidate] (8.015 ms) : 0, 8015

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020153
Total [baseline] (10.512 s) : 0, 10512201
Agent [candidate] (1.03 s) : 0, 1029927
Total [candidate] (10.509 s) : 0, 10509131
section appsec
Agent [baseline] (1.185 s) : 0, 1184695
Total [baseline] (10.722 s) : 0, 10722031
Agent [candidate] (1.187 s) : 0, 1187242
Total [candidate] (10.71 s) : 0, 10710376
section iast
Agent [baseline] (1.17 s) : 0, 1169770
Total [baseline] (10.88 s) : 0, 10880316
Agent [candidate] (1.155 s) : 0, 1155382
Total [candidate] (10.897 s) : 0, 10897440
section profiling
Agent [baseline] (1.263 s) : 0, 1263151
Total [baseline] (10.864 s) : 0, 10864275
Agent [candidate] (1.279 s) : 0, 1278612
Total [candidate] (10.96 s) : 0, 10959991

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.02 s	-
Agent	appsec	1.185 s	164.542 ms (16.1%)
Agent	iast	1.17 s	149.617 ms (14.7%)
Agent	profiling	1.263 s	242.998 ms (23.8%)
Total	tracing	10.512 s	-
Total	appsec	10.722 s	209.83 ms (2.0%)
Total	iast	10.88 s	368.115 ms (3.5%)
Total	profiling	10.864 s	352.075 ms (3.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.03 s	-
Agent	appsec	1.187 s	157.315 ms (15.3%)
Agent	iast	1.155 s	125.455 ms (12.2%)
Agent	profiling	1.279 s	248.685 ms (24.1%)
Total	tracing	10.509 s	-
Total	appsec	10.71 s	201.245 ms (1.9%)
Total	iast	10.897 s	388.309 ms (3.7%)
Total	profiling	10.96 s	450.86 ms (4.3%)

gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.63 ms) : 0, 681630
BytebuddyAgent [candidate] (688.058 ms) : 0, 688058
GlobalTracer [baseline] (240.128 ms) : 0, 240128
GlobalTracer [candidate] (242.307 ms) : 0, 242307
AppSec [baseline] (56.968 ms) : 0, 56968
AppSec [candidate] (59.4 ms) : 0, 59400
Debugger [baseline] (8.367 ms) : 0, 8367
Debugger [candidate] (6.913 ms) : 0, 6913
Remote Config [baseline] (736.338 µs) : 0, 736
Remote Config [candidate] (666.291 µs) : 0, 666
Telemetry [baseline] (8.95 ms) : 0, 8950
Telemetry [candidate] (8.968 ms) : 0, 8968
section appsec
BytebuddyAgent [baseline] (712.243 ms) : 0, 712243
BytebuddyAgent [candidate] (711.891 ms) : 0, 711891
GlobalTracer [baseline] (236.988 ms) : 0, 236988
GlobalTracer [candidate] (236.594 ms) : 0, 236594
IAST [baseline] (22.239 ms) : 0, 22239
IAST [candidate] (21.925 ms) : 0, 21925
AppSec [baseline] (175.796 ms) : 0, 175796
AppSec [candidate] (179.496 ms) : 0, 179496
Debugger [baseline] (5.929 ms) : 0, 5929
Debugger [candidate] (5.813 ms) : 0, 5813
Remote Config [baseline] (616.017 µs) : 0, 616
Remote Config [candidate] (629.553 µs) : 0, 630
Telemetry [baseline] (7.276 ms) : 0, 7276
Telemetry [candidate] (7.3 ms) : 0, 7300
section iast
BytebuddyAgent [baseline] (816.885 ms) : 0, 816885
BytebuddyAgent [candidate] (805.719 ms) : 0, 805719
GlobalTracer [baseline] (234.199 ms) : 0, 234199
GlobalTracer [candidate] (231.645 ms) : 0, 231645
IAST [baseline] (27.556 ms) : 0, 27556
IAST [candidate] (26.03 ms) : 0, 26030
AppSec [baseline] (52.613 ms) : 0, 52613
AppSec [candidate] (53.883 ms) : 0, 53883
Debugger [baseline] (6.018 ms) : 0, 6018
Debugger [candidate] (5.956 ms) : 0, 5956
Remote Config [baseline] (618.105 µs) : 0, 618
Remote Config [candidate] (600.737 µs) : 0, 601
Telemetry [baseline] (8.088 ms) : 0, 8088
Telemetry [candidate] (8.02 ms) : 0, 8020
section profiling
BytebuddyAgent [baseline] (673.298 ms) : 0, 673298
BytebuddyAgent [candidate] (680.44 ms) : 0, 680440
GlobalTracer [baseline] (359.223 ms) : 0, 359223
GlobalTracer [candidate] (362.728 ms) : 0, 362728
AppSec [baseline] (61.94 ms) : 0, 61940
AppSec [candidate] (62.8 ms) : 0, 62800
Debugger [baseline] (6.078 ms) : 0, 6078
Debugger [candidate] (6.172 ms) : 0, 6172
Remote Config [baseline] (656.775 µs) : 0, 657
Remote Config [candidate] (670.803 µs) : 0, 671
Telemetry [baseline] (8.123 ms) : 0, 8123
Telemetry [candidate] (8.322 ms) : 0, 8322
ProfilingAgent [baseline] (103.127 ms) : 0, 103127
ProfilingAgent [candidate] (106.267 ms) : 0, 106267
Profiling [baseline] (103.151 ms) : 0, 103151
Profiling [candidate] (106.292 ms) : 0, 106292

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/api-security-startup-time
git_commit_date	1750340918	1750342351
git_commit_sha	`f47ab39`	`ba6bea4`
release_version	1.50.0-SNAPSHOT~f47ab3945d	1.50.0-SNAPSHOT~ba6bea4fa9

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1750343775	1750343775
ci_job_id	990209659	990209659
ci_pipeline_id	68245760	68245760
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-8bgay5fx-project-304-concurrent-0-9x9ed961 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-8bgay5fx-project-304-concurrent-0-9x9ed961 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 4 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+234.469µs; +472.113µs] or [+3.225%; +6.494%]	unstable [-107.687op/s; +49.187op/s] or [-16.912%; +7.725%]	7.623ms	607.500op/s	7.270ms	636.750op/s
scenario:load:petclinic:no_agent:high_load	worse [+0.992ms; +1.628ms] or [+2.756%; +4.524%]	unstable [-13.357op/s; +4.332op/s] or [-10.280%; +3.334%]	37.295ms	125.425op/s	35.985ms	129.938op/s
scenario:load:petclinic:iast:high_load	worse [+1.123ms; +1.977ms] or [+2.498%; +4.398%]	unstable [-9.073op/s; +4.722op/s] or [-8.712%; +4.534%]	46.497ms	101.962op/s	44.947ms	104.138op/s
scenario:load:petclinic:tracing:high_load	worse [+2.111ms; +2.932ms] or [+4.857%; +6.746%]	unstable [-13.281op/s; +1.506op/s] or [-12.337%; +1.399%]	45.992ms	101.763op/s	43.470ms	107.650op/s

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section baseline
no_agent (35.985 ms) : 35693, 36278
. : milestone, 35985,
appsec (46.953 ms) : 46529, 47377
. : milestone, 46953,
code_origins (44.545 ms) : 44192, 44898
. : milestone, 44545,
iast (44.947 ms) : 44555, 45340
. : milestone, 44947,
profiling (47.736 ms) : 47234, 48239
. : milestone, 47736,
tracing (43.47 ms) : 43094, 43845
. : milestone, 43470,
section candidate
no_agent (37.295 ms) : 36996, 37594
. : milestone, 37295,
appsec (46.394 ms) : 45982, 46807
. : milestone, 46394,
code_origins (44.35 ms) : 43994, 44706
. : milestone, 44350,
iast (46.497 ms) : 46096, 46899
. : milestone, 46497,
profiling (47.729 ms) : 47252, 48206
. : milestone, 47729,
tracing (45.992 ms) : 45605, 46379
. : milestone, 45992,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.985 ms [35.693 ms, 36.278 ms]	-
appsec	46.953 ms [46.529 ms, 47.377 ms]	10.968 ms (30.5%)
code_origins	44.545 ms [44.192 ms, 44.898 ms]	8.56 ms (23.8%)
iast	44.947 ms [44.555 ms, 45.34 ms]	8.962 ms (24.9%)
profiling	47.736 ms [47.234 ms, 48.239 ms]	11.751 ms (32.7%)
tracing	43.47 ms [43.094 ms, 43.845 ms]	7.485 ms (20.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.295 ms [36.996 ms, 37.594 ms]	-
appsec	46.394 ms [45.982 ms, 46.807 ms]	9.099 ms (24.4%)
code_origins	44.35 ms [43.994 ms, 44.706 ms]	7.055 ms (18.9%)
iast	46.497 ms [46.096 ms, 46.899 ms]	9.202 ms (24.7%)
profiling	47.729 ms [47.252 ms, 48.206 ms]	10.434 ms (28.0%)
tracing	45.992 ms [45.605 ms, 46.379 ms]	8.697 ms (23.3%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section baseline
no_agent (4.396 ms) : 4340, 4452
. : milestone, 4396,
iast (9.021 ms) : 8860, 9183
. : milestone, 9021,
iast_FULL (13.642 ms) : 13368, 13917
. : milestone, 13642,
iast_GLOBAL (10.448 ms) : 10265, 10632
. : milestone, 10448,
profiling (8.885 ms) : 8724, 9046
. : milestone, 8885,
tracing (7.27 ms) : 7162, 7378
. : milestone, 7270,
section candidate
no_agent (4.295 ms) : 4247, 4344
. : milestone, 4295,
iast (9.163 ms) : 9010, 9315
. : milestone, 9163,
iast_FULL (13.598 ms) : 13328, 13869
. : milestone, 13598,
iast_GLOBAL (10.053 ms) : 9874, 10232
. : milestone, 10053,
profiling (8.883 ms) : 8743, 9024
. : milestone, 8883,
tracing (7.623 ms) : 7510, 7736
. : milestone, 7623,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.396 ms [4.34 ms, 4.452 ms]	-
iast	9.021 ms [8.86 ms, 9.183 ms]	4.625 ms (105.2%)
iast_FULL	13.642 ms [13.368 ms, 13.917 ms]	9.247 ms (210.3%)
iast_GLOBAL	10.448 ms [10.265 ms, 10.632 ms]	6.052 ms (137.7%)
profiling	8.885 ms [8.724 ms, 9.046 ms]	4.489 ms (102.1%)
tracing	7.27 ms [7.162 ms, 7.378 ms]	2.874 ms (65.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.295 ms [4.247 ms, 4.344 ms]	-
iast	9.163 ms [9.01 ms, 9.315 ms]	4.867 ms (113.3%)
iast_FULL	13.598 ms [13.328 ms, 13.869 ms]	9.303 ms (216.6%)
iast_GLOBAL	10.053 ms [9.874 ms, 10.232 ms]	5.758 ms (134.0%)
profiling	8.883 ms [8.743 ms, 9.024 ms]	4.588 ms (106.8%)
tracing	7.623 ms [7.51 ms, 7.736 ms]	3.328 ms (77.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	smola/api-security-startup-time
git_commit_date	1750340918	1750342351
git_commit_sha	`f47ab39`	`ba6bea4`
release_version	1.50.0-SNAPSHOT~f47ab3945d	1.50.0-SNAPSHOT~ba6bea4fa9

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1750344300	1750344300
ci_job_id	990209660	990209660
ci_pipeline_id	68245760	68245760
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-emldojjo-project-304-concurrent-1-200l9963 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-emldojjo-project-304-concurrent-1-200l9963 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1490
. : milestone, 1478,
appsec (2.405 ms) : 2357, 2454
. : milestone, 2405,
iast (2.185 ms) : 2124, 2246
. : milestone, 2185,
iast_GLOBAL (2.238 ms) : 2177, 2300
. : milestone, 2238,
profiling (2.02 ms) : 1972, 2069
. : milestone, 2020,
tracing (2.002 ms) : 1955, 2049
. : milestone, 2002,
section candidate
no_agent (1.477 ms) : 1466, 1489
. : milestone, 1477,
appsec (2.398 ms) : 2350, 2446
. : milestone, 2398,
iast (2.187 ms) : 2126, 2248
. : milestone, 2187,
iast_GLOBAL (2.231 ms) : 2170, 2293
. : milestone, 2231,
profiling (2.034 ms) : 1985, 2083
. : milestone, 2034,
tracing (2.005 ms) : 1958, 2053
. : milestone, 2005,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.49 ms]	-
appsec	2.405 ms [2.357 ms, 2.454 ms]	927.34 µs (62.7%)
iast	2.185 ms [2.124 ms, 2.246 ms]	707.314 µs (47.9%)
iast_GLOBAL	2.238 ms [2.177 ms, 2.3 ms]	760.368 µs (51.4%)
profiling	2.02 ms [1.972 ms, 2.069 ms]	542.257 µs (36.7%)
tracing	2.002 ms [1.955 ms, 2.049 ms]	524.113 µs (35.5%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	2.398 ms [2.35 ms, 2.446 ms]	920.735 µs (62.3%)
iast	2.187 ms [2.126 ms, 2.248 ms]	709.683 µs (48.0%)
iast_GLOBAL	2.231 ms [2.17 ms, 2.293 ms]	753.933 µs (51.0%)
profiling	2.034 ms [1.985 ms, 2.083 ms]	557.119 µs (37.7%)
tracing	2.005 ms [1.958 ms, 2.053 ms]	527.978 µs (35.7%)

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~ba6bea4fa9, baseline=1.50.0-SNAPSHOT~f47ab3945d
dateFormat X
axisFormat %s
section baseline
no_agent (15.245 s) : 15245000, 15245000
. : milestone, 15245000,
appsec (14.818 s) : 14818000, 14818000
. : milestone, 14818000,
iast (18.365 s) : 18365000, 18365000
. : milestone, 18365000,
iast_GLOBAL (17.726 s) : 17726000, 17726000
. : milestone, 17726000,
profiling (14.974 s) : 14974000, 14974000
. : milestone, 14974000,
tracing (14.596 s) : 14596000, 14596000
. : milestone, 14596000,
section candidate
no_agent (15.589 s) : 15589000, 15589000
. : milestone, 15589000,
appsec (15.032 s) : 15032000, 15032000
. : milestone, 15032000,
iast (18.956 s) : 18956000, 18956000
. : milestone, 18956000,
iast_GLOBAL (18.096 s) : 18096000, 18096000
. : milestone, 18096000,
profiling (15.83 s) : 15830000, 15830000
. : milestone, 15830000,
tracing (15.027 s) : 15027000, 15027000
. : milestone, 15027000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.245 s [15.245 s, 15.245 s]	-
appsec	14.818 s [14.818 s, 14.818 s]	-427.0 ms (-2.8%)
iast	18.365 s [18.365 s, 18.365 s]	3.12 s (20.5%)
iast_GLOBAL	17.726 s [17.726 s, 17.726 s]	2.481 s (16.3%)
profiling	14.974 s [14.974 s, 14.974 s]	-271.0 ms (-1.8%)
tracing	14.596 s [14.596 s, 14.596 s]	-649.0 ms (-4.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.589 s [15.589 s, 15.589 s]	-
appsec	15.032 s [15.032 s, 15.032 s]	-557.0 ms (-3.6%)
iast	18.956 s [18.956 s, 18.956 s]	3.367 s (21.6%)
iast_GLOBAL	18.096 s [18.096 s, 18.096 s]	2.507 s (16.1%)
profiling	15.83 s [15.83 s, 15.83 s]	241.0 ms (1.5%)
tracing	15.027 s [15.027 s, 15.027 s]	-562.0 ms (-3.6%)

This reverts commit 2f4c864.

github-actions · 2025-06-20T08:30:37Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

manuel-alvarez-alvarez · 2025-06-20T10:01:29Z

+ // We initialize API Security the first time AppSec becomes active.
+ // We never de-initialize it, as that could lead to a leak of open WAF contexts in-flight.
+ if (API_SECURITY_INITIALIZED.compareAndSet(false, true)) {
+ if (SpanPostProcessor.Holder.INSTANCE == SpanPostProcessor.Holder.NOOP) {


Correctly if I'm wrong, but this should also have a positive effect on span processing overhead when appsec is disabled right? (I'm asking because of the regressions in the high_load benchmarks, that might be spurious)

Yes, this should ensure that the post-processor is always no-op unless enabled.

| Package | Type | Package file | Manager | Update | Change | |---|---|---|---|---|---| | [com.google.errorprone:error_prone_annotations](https://errorprone.info) ([source](https://github.com/google/error-prone)) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `2.39.0` -> `2.40.0` | | [org.apache.commons:commons-lang3](https://commons.apache.org/proper/commons-lang/) ([source](https://gitbox.apache.org/repos/asf/commons-lang.git)) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `3.17.0` -> `3.18.0` | | [org.jetbrains.kotlinx.binary-compatibility-validator](https://github.com/Kotlin/binary-compatibility-validator) | plugin | misk/gradle/libs.versions.toml | gradle | patch | `0.18.0` -> `0.18.1` | | [com.datadoghq:dd-trace-api](https://github.com/datadog/dd-trace-java) | dependencies | misk/gradle/libs.versions.toml | gradle | minor | `1.50.1` -> `1.51.0` | | [software.amazon.awssdk:sdk-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:sqs](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:dynamodb-enhanced](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:dynamodb](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:aws-core](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:bom](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | | [software.amazon.awssdk:auth](https://aws.amazon.com/sdkforjava) | dependencies | misk/gradle/libs.versions.toml | gradle | patch | `2.31.77` -> `2.31.78` | --- ### Release Notes <details> <summary>google/error-prone (com.google.errorprone:error_prone_annotations)</summary> ### [`v2.40.0`](https://github.com/google/error-prone/releases/tag/v2.40.0): Error Prone 2.40.0 Changes: - Bug fixes and improvements - Releases (including snapshots) have migrated from [OSSRH to the Central Publisher Portal](https://central.sonatype.org/pages/ossrh-eol/#process-to-migrate) Full changelog: google/error-prone@v2.39.0...v2.40.0 </details> <details> <summary>Kotlin/binary-compatibility-validator (org.jetbrains.kotlinx.binary-compatibility-validator)</summary> ### [`v0.18.1`](https://github.com/Kotlin/binary-compatibility-validator/releases/tag/0.18.1) [Compare Source](Kotlin/binary-compatibility-validator@0.18.0...0.18.1) #### What's Changed - Fixed a bug preventing use of cross-compilation support during KLIB dump validation \[[#304](https://github.com/Kotlin/binary-compatibility-validator/issues/304)]\[[#306](https://github.com/Kotlin/binary-compatibility-validator/issues/306)] </details> <details> <summary>datadog/dd-trace-java (com.datadoghq:dd-trace-api)</summary> ### [`v1.51.0`](https://github.com/DataDog/dd-trace-java/releases/tag/v1.51.0): 1.51.0 ### Components #### Application Security Management (IAST) - 🐛 Fix verify error when ctor params are used after a call site ([#9083](DataDog/dd-trace-java#9083) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛 Limit the maximum size of the location path in IAST vulnerabilities ([#9028](DataDog/dd-trace-java#9028) - [@jandro996](https://github.com/jandro996)) - 🐛 Fix IAST gRPC handler with null superclass ([#8984](DataDog/dd-trace-java#8984) - [@smola](https://github.com/smola)) - ✨ Optimize IAST Vulnerability Detection ([#8885](DataDog/dd-trace-java#8885) - [@jandro996](https://github.com/jandro996)) #### Application Security Management (WAF) - ✨ Upgrade libddwaf-java to 15.0.0 ([#9022](DataDog/dd-trace-java#9022) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Extract RestEasy json body response schemas ([#9015](DataDog/dd-trace-java#9015) - [@jandro996](https://github.com/jandro996)) - ✨ Extract Jersey json body response schemas ([#9014](DataDog/dd-trace-java#9014) - [@jandro996](https://github.com/jandro996)) - ✨ Extract Ratpack json body response schemas ([#9013](DataDog/dd-trace-java#9013) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Enable API Security by default and make it lazy loading ([#9009](DataDog/dd-trace-java#9009) - [@smola](https://github.com/smola)) - ✨ Extract Vert.x json body response schemas ([#9001](DataDog/dd-trace-java#9001) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Extract Play json body response schemas ([#8995](DataDog/dd-trace-java#8995) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - 🐛 Fix Jackson nodes introspection for request/response schema extraction ([#8980](DataDog/dd-trace-java#8980) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Extract Spring json body response schemas ([#8938](DataDog/dd-trace-java#8938) - [@sezen-datadog](https://github.com/sezen-datadog)) - ✨ Default obfuscation regexp update ([#8937](DataDog/dd-trace-java#8937) - [@sezen-datadog](https://github.com/sezen-datadog)) #### Build & Tooling - ✨ Cancel GitLab running pipeline on new PR push ([#9023](DataDog/dd-trace-java#9023) - [@PerfectSlayer](https://github.com/PerfectSlayer)) - ✨ Migrate publishing to Maven Central Portal ([#8807](DataDog/dd-trace-java#8807) - [@sarahchen6](https://github.com/sarahchen6)) #### Continuous Integration Visibility - 🐛 Fix Test Optimization to work with JDK 24 ([#9114](DataDog/dd-trace-java#9114) - [@nikita-tkachenko-datadog](https://github.com/nikita-tkachenko-datadog)) - ✨ Add repo root as safe directory on git client creation ([#9033](DataDog/dd-trace-java#9033) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Add PR number tag and improve PR information building ([#8990](DataDog/dd-trace-java#8990) - [@daniel-mohedano](https://github.com/daniel-mohedano)) - ✨ Update impacted tests logic ([#8923](DataDog/dd-trace-java#8923) - [@daniel-mohedano](https://github.com/daniel-mohedano)) #### Data Streams Monitoring - 🧹 Clean up DSM context injection ([#8776](DataDog/dd-trace-java#8776) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Database Monitoring - 🐛 Set trace\_injected in try block ([#9025](DataDog/dd-trace-java#9025) - [@natashadada](https://github.com/natashadada)) #### Dynamic Instrumentation - 🐛 Add source file tracking enable option ([#9115](DataDog/dd-trace-java#9115) - [@jpbempel](https://github.com/jpbempel)) - ✨ Add java.util.Date support ([#9111](DataDog/dd-trace-java#9111) - [@jpbempel](https://github.com/jpbempel)) - ✨ Update file probe format ([#9047](DataDog/dd-trace-java#9047) - [@jpbempel](https://github.com/jpbempel)) - ✨ add safe local var hoisting ([#9034](DataDog/dd-trace-java#9034) - [@jpbempel](https://github.com/jpbempel)) - 🧹 Add new config for debugger upload interval ([#8959](DataDog/dd-trace-java#8959) - [@jpbempel](https://github.com/jpbempel)) - ✨ Enable Code Origin with Dynamic instrumentation ([#8940](DataDog/dd-trace-java#8940) - [@jpbempel](https://github.com/jpbempel)) #### ML Observability (LLMObs) - 💡 LLM Observability SDK ([#8781](DataDog/dd-trace-java#8781) - [@gary-huang](https://github.com/gary-huang), [@nayeem-kamal](https://github.com/nayeem-kamal)) #### Metrics - 🐛 Ensure client stat reporter is started when the agent is not available at bootstrap ([#9082](DataDog/dd-trace-java#9082) - [@amarziali](https://github.com/amarziali)) - ✨ Create metric: appsec.waf.config\_errors ([#8394](DataDog/dd-trace-java#8394) - [@sezen-datadog](https://github.com/sezen-datadog)) #### Platform components - ✨ Introduce environment component ([#9071](DataDog/dd-trace-java#9071) - [@PerfectSlayer](https://github.com/PerfectSlayer)) #### Profiling - 🐛 Remove annoying warning for smap event parsing ([#9119](DataDog/dd-trace-java#9119) - [@jbachorik](https://github.com/jbachorik)) - 🐛 Fix ByteCountingInputStream when reading past EOF ([#8988](DataDog/dd-trace-java#8988) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Realtime User Monitoring - ✨ Add RUM SDK injection for servlet based web servers ([#9110](DataDog/dd-trace-java#9110) - [@PerfectSlayer](https://github.com/PerfectSlayer) [@amarziali](https://github.com/amarziali)) #### Telemetry - ✨ Update the config origin metric to match what it's mapping ([#9045](DataDog/dd-trace-java#9045) - [@sezen-datadog](https://github.com/sezen-datadog)) #### Testing - ✨ Add testing for latest stable version (JDK 24) ([#8875](DataDog/dd-trace-java#8875) - [@sarahchen6](https://github.com/sarahchen6)) #### Trace context propagation - 🐛 Fix bug with dropping baggage when `TracePropagationBehaviorExtract=IGNORE` ([#9037](DataDog/dd-trace-java#9037) - [@mhlidd](https://github.com/mhlidd)) - 🐛 Fix ArrayIndexOutOfBoundsException in PercentEscaper ([#9032](DataDog/dd-trace-java#9032) - [@mhlidd](https://github.com/mhlidd)) #### Tracer core - 🐛 Fix `Error` handling for trace interceptors ([#9097](DataDog/dd-trace-java#9097) - [@AlexeyKuznetsov-DD](https://github.com/AlexeyKuznetsov-DD)) - 💡 Add wildcard feature for `DD_TRACE_HEADER_TAGS` and enabling for Http Response headers ([#9067](DataDog/dd-trace-java#9067) - [@mhlidd](https://github.com/mhlidd)) #### Tracer public API - 💡 Add LLM Observability SDK ([#8781](DataDog/dd-trace-java#8781) - [@gary-huang](https://github.com/gary-huang)) ### Instrumentations #### Akka instrumentation - 🐛 Fix NPE in akka-http and pekko-http integrations ([#9019](DataDog/dd-trace-java#9019) - [@mcculls](https://github.com/mcculls)) #### Eclipse Vert.x instrumentation - ✨ Extract Vert.x json body response schemas ([#9001](DataDog/dd-trace-java#9001) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) - ✨ Write http.route tag as soon as possible in vert.x ([#8952](DataDog/dd-trace-java#8952) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### JAX-WS instrumentation - 💡⚠️ Enable jax-ws integration by default ([#9030](DataDog/dd-trace-java#9030) - [@bm1549](https://github.com/bm1549)) - ✨ Extract Jersey json body response schemas ([#9014](DataDog/dd-trace-java#9014) - [@jandro996](https://github.com/jandro996)) #### Mule instrumentation - 🐛 Propagate grizzly http span in filters if nothing is active ([#9016](DataDog/dd-trace-java#9016) - [@amarziali](https://github.com/amarziali)) #### Play Framework instrumentation - ✨ Extract Play json body response schemas ([#8995](DataDog/dd-trace-java#8995) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Ratpack instrumentation - ✨ Extract Ratpack json body response schemas ([#9013](DataDog/dd-trace-java#9013) - [@manuel-alvarez-alvarez](https://github.com/manuel-alvarez-alvarez)) #### Spring instrumentation - ✨ Extract Spring json body response schemas ([#8938](DataDog/dd-trace-java#8938) - [@sezen-datadog](https://github.com/sezen-datadog)) </details> --- ### Configuration 📅 **Schedule**: Branch creation - "after 6pm every weekday,before 2am every weekday" in timezone Australia/Melbourne, Automerge - At any time (no schedule defined). 🚦 **Automerge**: Enabled. ♻ **Rebasing**: Never, or you tick the rebase/retry checkbox. 👻 **Immortal**: This PR will be recreated if closed unmerged. Get [config help](https://github.com/renovatebot/renovate/discussions) if that's undesired. --- - [ ] If you want to rebase/retry this PR, check this box --- This PR has been generated by [Renovate Bot](https://github.com/renovatebot/renovate). GitOrigin-RevId: 649b690d4c9d7dcb572c457f0802b42b8e3e682e

smola force-pushed the smola/api-security-startup-time branch from 33d425a to bc849b6Compare June 19, 2025 09:40

smola commented Jun 19, 2025
View reviewed changes

smola force-pushed the smola/api-security-startup-time branch from bc849b6 to 9ad217dCompare June 19, 2025 10:15

smola changed the title ~~Smola/api security startup time~~Enable API Security by default and make it lazy loadingJun 19, 2025

smola added the comp: asm waf Application Security Management (WAF) label Jun 19, 2025

smola force-pushed the smola/api-security-startup-time branch from 9ad217d to 744ce49Compare June 19, 2025 12:33

smola added 2 commits June 19, 2025 16:12

Lazy API Security initialization
de7f62e

Reapply "Enable API Security by default (#8511)" (#9006)
ba6bea4
This reverts commit 2f4c864.

smola force-pushed the smola/api-security-startup-time branch from 744ce49 to ba6bea4Compare June 19, 2025 14:12

smola marked this pull request as ready for review June 20, 2025 08:30

smola requested review from a team as code owners June 20, 2025 08:30

smola requested review from manuel-alvarez-alvarez and robertpi June 20, 2025 08:30

smola added the type: feature Enhancements and improvements label Jun 20, 2025

sezen-datadog approved these changes Jun 20, 2025
View reviewed changes

manuel-alvarez-alvarez reviewed Jun 20, 2025
View reviewed changes

manuel-alvarez-alvarez approved these changes Jun 20, 2025
View reviewed changes

smola merged commit 60c30c2 into masterJun 20, 2025

smola deleted the smola/api-security-startup-time branch June 20, 2025 13:57

github-actionsBot added this to the 1.51.0 milestone Jun 20, 2025

Navigation Menu

Uh oh!

Enable API Security by default and make it lazy loading - #9009

Enable API Security by default and make it lazy loading#9009
smola merged 2 commits into
masterfrom
smola/api-security-startup-time

smola commented Jun 19, 2025•
edited by atlassian Bot
Loading

Uh oh!

smolaJun 19, 2025

Uh oh!

PerfectSlayerJun 19, 2025

Uh oh!

pr-commenterBot commented Jun 19, 2025•
edited
Loading

Uh oh!

github-actionsBot commented Jun 20, 2025•
edited
Loading

Uh oh!

manuel-alvarez-alvarezJun 20, 2025•
edited
Loading

Uh oh!

smolaJun 20, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

smola commented Jun 19, 2025• edited by atlassian BotLoading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

smolaJun 19, 2025

Choose a reason for hiding this comment

Uh oh!

PerfectSlayerJun 19, 2025

Choose a reason for hiding this comment

Uh oh!

pr-commenterBot commented Jun 19, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

github-actionsBot commented Jun 20, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

manuel-alvarez-alvarezJun 20, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

smolaJun 20, 2025

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

smola commented Jun 19, 2025•
edited by atlassian Bot
Loading

pr-commenterBot commented Jun 19, 2025•
edited
Loading

github-actionsBot commented Jun 20, 2025•
edited
Loading

manuel-alvarez-alvarezJun 20, 2025•
edited
Loading