Fix appsec.rasp.error and appsec.waf.error telemetry metrics

[jandro996]

What Does This Do

• Remove counters from AppsecRequestContext as they are not used in the metrics
• Fix appsec.waf.error metric tags as they didn't match the RFC
• Fix that appsec.waf.error was created in the same loop using the rasp counter instead of using the waf counter
• Increment metrics if UnclassifiedPowerwafException is thrown
• Replace ConcurrentHashMap with AtomicLongArray for raspErrorCodeCounter to improve performance and memory efficiency
• Add test to cover WafModule implementation

Motivation

Additional Notes

RFC

appsec.waf.error	Count		Counts the number of times the WAF returned an error when evaluating WAF addresses through ddwaf_run.
	Version String	waf_version	Version of the libddwaf library
	Version String	event_rules_version	Version of the ruleset
	Int	waf_error	The numeric error returned by ddwaf_run or -127 If the error is caused by the WAF bindings rather than the call to ddwaf_run.

It's necessary to add more test to cover how metrics are incremented for errors in waf calls, right now the class used for that purpose (Additive) is final so there is no easy way to test this properly.
https://datadoghq.atlassian.net/browse/APPSEC-57082

Benchmark Results

Scenario	ConcurrentSkipListMap (ms)	AtomicLongArray (ms)	Speedup
Single-threaded benchmark	1,060	526	2.0×
Four-thread concurrent test	754	251	3.0×

These figures show that replacing the map-based counter with a flat AtomicLongArray significantly reduces the time needed to perform millions of increments under both single-threaded and multi-threaded load.

Benchmark Code

import java.util.Random;
import java.util.concurrent.ConcurrentMap;
import java.util.concurrent.ConcurrentSkipListMap;
import java.util.concurrent.atomic.AtomicLongArray;
public class ErrorCounterBench {
static final int NUM_ERROR_CODES = 32;
static final int NUM_RULE_TYPES = 16;
static final int ITERATIONS = 20_000_000;
public static void main(String[] args) {
Random rnd = new Random(0);
ConcurrentMap<Integer, AtomicLongArray> mapCounter = new ConcurrentSkipListMap<>();
for (int i = -NUM_ERROR_CODES; i < 0; i++) {
mapCounter.put(i, new AtomicLongArray(NUM_RULE_TYPES));
}
AtomicLongArray arrayCounter = new AtomicLongArray(NUM_ERROR_CODES * NUM_RULE_TYPES);
// Warm-up
for (int i = 0; i < ITERATIONS / 10; i++) {
int err = -1 - rnd.nextInt(NUM_ERROR_CODES);
int rule = rnd.nextInt(NUM_RULE_TYPES);
mapCounter.get(err).incrementAndGet(rule);
int idx = (-err - 1) * NUM_RULE_TYPES + rule;
arrayCounter.incrementAndGet(idx);
}
// Map-based
long start = System.nanoTime();
for (int i = 0; i < ITERATIONS; i++) {
int err = -1 - rnd.nextInt(NUM_ERROR_CODES);
int rule = rnd.nextInt(NUM_RULE_TYPES);
mapCounter.get(err).incrementAndGet(rule);
}
long mapTime = System.nanoTime() - start;
// Array-based
start = System.nanoTime();
for (int i = 0; i < ITERATIONS; i++) {
int err = -1 - rnd.nextInt(NUM_ERROR_CODES);
int rule = rnd.nextInt(NUM_RULE_TYPES);
int idx = (-err - 1) * NUM_RULE_TYPES + rule;
arrayCounter.incrementAndGet(idx);
}
long arrayTime = System.nanoTime() - start;
System.out.printf("Map-based: %d ms%n", mapTime / 1_000_000);
System.out.printf("Array-based: %d ms%n", arrayTime / 1_000_000);
}
}

import java.util.Random;
import java.util.concurrent.ConcurrentMap;
import java.util.concurrent.ConcurrentSkipListMap;
import java.util.concurrent.CountDownLatch;
import java.util.concurrent.atomic.AtomicLongArray;
public class ErrorCounterBenchMT {
static final int NUM_ERROR_CODES = 32;
static final int NUM_RULE_TYPES = 16;
static final int ITERATIONS = 2_000_000; // per thread
static final int THREADS = 4;
public static void main(String[] args) throws Exception {
// Map-based structure
ConcurrentMap<Integer, AtomicLongArray> mapCounter = new ConcurrentSkipListMap<>();
for (int i = -NUM_ERROR_CODES; i < 0; i++) {
mapCounter.put(i, new AtomicLongArray(NUM_RULE_TYPES));
}
CountDownLatch startLatch = new CountDownLatch(1);
CountDownLatch doneLatch = new CountDownLatch(THREADS);
final CountDownLatch startLatchRef = startLatch;
final CountDownLatch doneLatchRef = doneLatch;
Runnable mapTask = () -> {
Random rnd = new Random();
try {
startLatchRef.await();
for (int i = 0; i < ITERATIONS; i++) {
int err = -1 - rnd.nextInt(NUM_ERROR_CODES);
int rule = rnd.nextInt(NUM_RULE_TYPES);
mapCounter.get(err).incrementAndGet(rule);
}
} catch (InterruptedException e) {
Thread.currentThread().interrupt();
}
doneLatchRef.countDown();
};
for (int t = 0; t < THREADS; t++) new Thread(mapTask).start();
long start = System.nanoTime();
startLatch.countDown();
doneLatch.await();
long mapTime = System.nanoTime() - start;
// Array-based structure
AtomicLongArray arrayCounter = new AtomicLongArray(NUM_ERROR_CODES * NUM_RULE_TYPES);
startLatch = new CountDownLatch(1);
doneLatch = new CountDownLatch(THREADS);
final CountDownLatch startLatchRef2 = startLatch;
final CountDownLatch doneLatchRef2 = doneLatch;
Runnable arrayTask = () -> {
Random rnd = new Random();
try {
startLatchRef2.await();
for (int i = 0; i < ITERATIONS; i++) {
int err = -1 - rnd.nextInt(NUM_ERROR_CODES);
int rule = rnd.nextInt(NUM_RULE_TYPES);
int idx = (-err - 1) * NUM_RULE_TYPES + rule;
arrayCounter.incrementAndGet(idx);
}
} catch (InterruptedException e) {
Thread.currentThread().interrupt();
}
doneLatchRef2.countDown();
};
for (int t = 0; t < THREADS; t++) new Thread(arrayTask).start();
start = System.nanoTime();
startLatch.countDown();
doneLatch.await();
long arrayTime = System.nanoTime() - start;
System.out.printf("Map-based: %d ms%n", mapTime / 1_000_000);
System.out.printf("Array-based: %d ms%n", arrayTime / 1_000_000);
}
}

Contributor Checklist

• Format the title according the contribution guidelines
• Assign the type: and (comp: or inst:) labels in addition to any usefull labels
• Don't use close, fix or any linking keywords when referencing an issue.
  Use solves instead, and assign the PR milestone to the issue
• Update the public documentation in case of new configuration flag or behavior

Jira ticket: APPSEC-57054

[pr-commenter]

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/APPSEC-57054
git_commit_date	1743592817	1743592881
git_commit_sha	32046a3	5f4cc62
release_version	1.48.0-SNAPSHOT~32046a39ed	1.48.0-SNAPSHOT~5f4cc62475

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1743595743	1743595743
ci_job_id	876761446	876761446
ci_pipeline_id	60782595	60782595
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-x-j3wh1g-project-304-concurrent-0-g2p1j8wr 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-x-j3wh1g-project-304-concurrent-0-g2p1j8wr 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.048 s) : 0, 1048470
Total [baseline] (8.65 s) : 0, 8650187
Agent [candidate] (1.051 s) : 0, 1051216
Total [candidate] (8.662 s) : 0, 8661598
section iast
Agent [baseline] (1.185 s) : 0, 1184816
Total [baseline] (9.269 s) : 0, 9269118
Agent [candidate] (1.193 s) : 0, 1193365
Total [candidate] (9.27 s) : 0, 9270449
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.179 s) : 0, 1178579
Total [baseline] (9.222 s) : 0, 9221523
Agent [candidate] (1.18 s) : 0, 1180120
Total [candidate] (9.196 s) : 0, 9196255
section iast_TELEMETRY_OFF
Agent [baseline] (1.175 s) : 0, 1175194
Total [baseline] (9.268 s) : 0, 9267976
Agent [candidate] (1.174 s) : 0, 1174478
Total [candidate] (9.268 s) : 0, 9267952

Loading

• baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.048 s	-
Agent	iast	1.185 s	136.346 ms (13.0%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.179 s	130.109 ms (12.4%)
Agent	iast_TELEMETRY_OFF	1.175 s	126.723 ms (12.1%)
Total	tracing	8.65 s	-
Total	iast	9.269 s	618.932 ms (7.2%)
Total	iast_HARDCODED_SECRET_DISABLED	9.222 s	571.336 ms (6.6%)
Total	iast_TELEMETRY_OFF	9.268 s	617.789 ms (7.1%)

• candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.051 s	-
Agent	iast	1.193 s	142.149 ms (13.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.18 s	128.904 ms (12.3%)
Agent	iast_TELEMETRY_OFF	1.174 s	123.261 ms (11.7%)
Total	tracing	8.662 s	-
Total	iast	9.27 s	608.851 ms (7.0%)
Total	iast_HARDCODED_SECRET_DISABLED	9.196 s	534.657 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.268 s	606.354 ms (7.0%)

gantt
title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.964 ms) : 0, 716964
BytebuddyAgent [candidate] (718.181 ms) : 0, 718181
GlobalTracer [baseline] (238.795 ms) : 0, 238795
GlobalTracer [candidate] (239.274 ms) : 0, 239274
AppSec [baseline] (55.743 ms) : 0, 55743
AppSec [candidate] (55.109 ms) : 0, 55109
Debugger [baseline] (4.462 ms) : 0, 4462
Debugger [candidate] (4.448 ms) : 0, 4448
Remote Config [baseline] (684.235 µs) : 0, 684
Remote Config [candidate] (687.516 µs) : 0, 688
Telemetry [baseline] (11.299 ms) : 0, 11299
Telemetry [candidate] (13.004 ms) : 0, 13004
section iast
BytebuddyAgent [baseline] (842.601 ms) : 0, 842601
BytebuddyAgent [candidate] (849.37 ms) : 0, 849370
GlobalTracer [baseline] (229.662 ms) : 0, 229662
GlobalTracer [candidate] (230.398 ms) : 0, 230398
IAST [baseline] (22.535 ms) : 0, 22535
IAST [candidate] (22.94 ms) : 0, 22940
AppSec [baseline] (56.002 ms) : 0, 56002
AppSec [candidate] (56.266 ms) : 0, 56266
Debugger [baseline] (4.15 ms) : 0, 4150
Debugger [candidate] (4.189 ms) : 0, 4189
Remote Config [baseline] (614.948 µs) : 0, 615
Remote Config [candidate] (625.932 µs) : 0, 626
Telemetry [baseline] (8.736 ms) : 0, 8736
Telemetry [candidate] (8.888 ms) : 0, 8888
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.845 ms) : 0, 836845
BytebuddyAgent [candidate] (837.609 ms) : 0, 837609
GlobalTracer [baseline] (229.37 ms) : 0, 229370
GlobalTracer [candidate] (229.692 ms) : 0, 229692
IAST [baseline] (24.228 ms) : 0, 24228
IAST [candidate] (22.825 ms) : 0, 22825
AppSec [baseline] (54.108 ms) : 0, 54108
AppSec [candidate] (56.047 ms) : 0, 56047
Debugger [baseline] (4.174 ms) : 0, 4174
Debugger [candidate] (4.125 ms) : 0, 4125
Remote Config [baseline] (615.231 µs) : 0, 615
Remote Config [candidate] (608.081 µs) : 0, 608
Telemetry [baseline] (8.809 ms) : 0, 8809
Telemetry [candidate] (8.76 ms) : 0, 8760
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.801 ms) : 0, 833801
BytebuddyAgent [candidate] (832.975 ms) : 0, 832975
GlobalTracer [baseline] (229.629 ms) : 0, 229629
GlobalTracer [candidate] (229.381 ms) : 0, 229381
IAST [baseline] (21.996 ms) : 0, 21996
IAST [candidate] (22.935 ms) : 0, 22935
AppSec [baseline] (55.823 ms) : 0, 55823
AppSec [candidate] (55.258 ms) : 0, 55258
Debugger [baseline] (4.166 ms) : 0, 4166
Debugger [candidate] (4.188 ms) : 0, 4188
Remote Config [baseline] (618.145 µs) : 0, 618
Remote Config [candidate] (625.732 µs) : 0, 626
Telemetry [baseline] (8.707 ms) : 0, 8707
Telemetry [candidate] (8.714 ms) : 0, 8714

Loading

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1052570
Total [baseline] (10.482 s) : 0, 10481783
Agent [candidate] (1.05 s) : 0, 1050462
Total [candidate] (10.453 s) : 0, 10453034
section appsec
Agent [baseline] (1.201 s) : 0, 1201497
Total [baseline] (10.732 s) : 0, 10731927
Agent [candidate] (1.196 s) : 0, 1196179
Total [candidate] (10.81 s) : 0, 10809910
section iast
Agent [baseline] (1.179 s) : 0, 1179083
Total [baseline] (10.964 s) : 0, 10963503
Agent [candidate] (1.179 s) : 0, 1178991
Total [candidate] (11.006 s) : 0, 11005918
section profiling
Agent [baseline] (1.281 s) : 0, 1280821
Total [baseline] (10.883 s) : 0, 10883086
Agent [candidate] (1.277 s) : 0, 1276768
Total [candidate] (10.903 s) : 0, 10902602

Loading

• baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.053 s	-
Agent	appsec	1.201 s	148.927 ms (14.1%)
Agent	iast	1.179 s	126.513 ms (12.0%)
Agent	profiling	1.281 s	228.251 ms (21.7%)
Total	tracing	10.482 s	-
Total	appsec	10.732 s	250.144 ms (2.4%)
Total	iast	10.964 s	481.72 ms (4.6%)
Total	profiling	10.883 s	401.303 ms (3.8%)

• candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.05 s	-
Agent	appsec	1.196 s	145.717 ms (13.9%)
Agent	iast	1.179 s	128.529 ms (12.2%)
Agent	profiling	1.277 s	226.306 ms (21.5%)
Total	tracing	10.453 s	-
Total	appsec	10.81 s	356.876 ms (3.4%)
Total	iast	11.006 s	552.885 ms (5.3%)
Total	profiling	10.903 s	449.568 ms (4.3%)

gantt
title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.205 ms) : 0, 718205
BytebuddyAgent [candidate] (718.051 ms) : 0, 718051
GlobalTracer [baseline] (239.23 ms) : 0, 239230
GlobalTracer [candidate] (239.197 ms) : 0, 239197
AppSec [baseline] (54.466 ms) : 0, 54466
AppSec [candidate] (54.554 ms) : 0, 54554
Debugger [baseline] (4.42 ms) : 0, 4420
Debugger [candidate] (4.41 ms) : 0, 4410
Remote Config [baseline] (705.492 µs) : 0, 705
Remote Config [candidate] (700.092 µs) : 0, 700
Telemetry [baseline] (15.036 ms) : 0, 15036
Telemetry [candidate] (13.013 ms) : 0, 13013
section appsec
BytebuddyAgent [baseline] (742.549 ms) : 0, 742549
BytebuddyAgent [candidate] (738.15 ms) : 0, 738150
GlobalTracer [baseline] (237.523 ms) : 0, 237523
GlobalTracer [candidate] (236.696 ms) : 0, 236696
AppSec [baseline] (176.414 ms) : 0, 176414
AppSec [candidate] (176.675 ms) : 0, 176675
Debugger [baseline] (4.294 ms) : 0, 4294
Debugger [candidate] (4.286 ms) : 0, 4286
Remote Config [baseline] (641.343 µs) : 0, 641
Remote Config [candidate] (645.376 µs) : 0, 645
Telemetry [baseline] (8.597 ms) : 0, 8597
Telemetry [candidate] (8.2 ms) : 0, 8200
IAST [baseline] (21.745 ms) : 0, 21745
IAST [candidate] (21.938 ms) : 0, 21938
section iast
BytebuddyAgent [baseline] (836.96 ms) : 0, 836960
BytebuddyAgent [candidate] (836.827 ms) : 0, 836827
GlobalTracer [baseline] (229.557 ms) : 0, 229557
GlobalTracer [candidate] (229.286 ms) : 0, 229286
AppSec [baseline] (56.042 ms) : 0, 56042
AppSec [candidate] (56.357 ms) : 0, 56357
Debugger [baseline] (4.119 ms) : 0, 4119
Debugger [candidate] (4.135 ms) : 0, 4135
Remote Config [baseline] (615.757 µs) : 0, 616
Remote Config [candidate] (628.843 µs) : 0, 629
Telemetry [baseline] (8.67 ms) : 0, 8670
Telemetry [candidate] (8.713 ms) : 0, 8713
IAST [baseline] (22.715 ms) : 0, 22715
IAST [candidate] (22.624 ms) : 0, 22624
section profiling
BytebuddyAgent [baseline] (712.953 ms) : 0, 712953
BytebuddyAgent [candidate] (710.597 ms) : 0, 710597
GlobalTracer [baseline] (350.279 ms) : 0, 350279
GlobalTracer [candidate] (349.939 ms) : 0, 349939
AppSec [baseline] (54.277 ms) : 0, 54277
AppSec [candidate] (53.217 ms) : 0, 53217
Debugger [baseline] (4.302 ms) : 0, 4302
Debugger [candidate] (4.283 ms) : 0, 4283
Remote Config [baseline] (717.229 µs) : 0, 717
Remote Config [candidate] (691.479 µs) : 0, 691
Telemetry [baseline] (8.979 ms) : 0, 8979
Telemetry [candidate] (9.002 ms) : 0, 9002
ProfilingAgent [baseline] (103.372 ms) : 0, 103372
ProfilingAgent [candidate] (103.37 ms) : 0, 103370
Profiling [baseline] (103.397 ms) : 0, 103397
Profiling [candidate] (103.397 ms) : 0, 103397

Loading

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-04-02T11:41:18	2025-04-02T11:49:05
git_branch	master	alejandro.gonzalez/APPSEC-57054
git_commit_date	1743592817	1743592881
git_commit_sha	32046a3	5f4cc62
release_version	1.48.0-SNAPSHOT~32046a39ed	1.48.0-SNAPSHOT~5f4cc62475
start_time	2025-04-02T11:41:04	2025-04-02T11:48:50

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1743594946	1743594946
ci_job_id	876761447	876761447
ci_pipeline_id	60782595	60782595
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-1ywhvvpj-project-304-concurrent-0-1uzddymk 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-1ywhvvpj-project-304-concurrent-0-1uzddymk 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section baseline
no_agent (1.377 ms) : 1357, 1396
. : milestone, 1377,
appsec (1.737 ms) : 1713, 1760
. : milestone, 1737,
appsec_no_iast (1.739 ms) : 1714, 1764
. : milestone, 1739,
code_origins (1.696 ms) : 1670, 1722
. : milestone, 1696,
iast (1.518 ms) : 1493, 1543
. : milestone, 1518,
profiling (1.526 ms) : 1502, 1550
. : milestone, 1526,
tracing (1.499 ms) : 1475, 1523
. : milestone, 1499,
section candidate
no_agent (1.376 ms) : 1355, 1396
. : milestone, 1376,
appsec (1.776 ms) : 1753, 1799
. : milestone, 1776,
appsec_no_iast (1.75 ms) : 1725, 1775
. : milestone, 1750,
code_origins (1.699 ms) : 1671, 1726
. : milestone, 1699,
iast (1.519 ms) : 1495, 1544
. : milestone, 1519,
profiling (1.563 ms) : 1538, 1588
. : milestone, 1563,
tracing (1.509 ms) : 1485, 1534
. : milestone, 1509,

Loading

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.377 ms [1.357 ms, 1.396 ms]	-
appsec	1.737 ms [1.713 ms, 1.76 ms]	359.814 µs (26.1%)
appsec_no_iast	1.739 ms [1.714 ms, 1.764 ms]	362.173 µs (26.3%)
code_origins	1.696 ms [1.67 ms, 1.722 ms]	319.096 µs (23.2%)
iast	1.518 ms [1.493 ms, 1.543 ms]	140.691 µs (10.2%)
profiling	1.526 ms [1.502 ms, 1.55 ms]	148.867 µs (10.8%)
tracing	1.499 ms [1.475 ms, 1.523 ms]	122.089 µs (8.9%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.376 ms [1.355 ms, 1.396 ms]	-
appsec	1.776 ms [1.753 ms, 1.799 ms]	400.301 µs (29.1%)
appsec_no_iast	1.75 ms [1.725 ms, 1.775 ms]	374.57 µs (27.2%)
code_origins	1.699 ms [1.671 ms, 1.726 ms]	323.16 µs (23.5%)
iast	1.519 ms [1.495 ms, 1.544 ms]	143.657 µs (10.4%)
profiling	1.563 ms [1.538 ms, 1.588 ms]	187.59 µs (13.6%)
tracing	1.509 ms [1.485 ms, 1.534 ms]	133.563 µs (9.7%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section baseline
no_agent (382.212 µs) : 362, 402
. : milestone, 382,
iast (518.418 µs) : 497, 540
. : milestone, 518,
iast_FULL (737.905 µs) : 716, 760
. : milestone, 738,
iast_GLOBAL (564.556 µs) : 543, 586
. : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (520.539 µs) : 499, 542
. : milestone, 521,
iast_INACTIVE (469.102 µs) : 447, 491
. : milestone, 469,
iast_TELEMETRY_OFF (516.154 µs) : 493, 539
. : milestone, 516,
tracing (466.684 µs) : 445, 488
. : milestone, 467,
section candidate
no_agent (384.365 µs) : 364, 404
. : milestone, 384,
iast (520.471 µs) : 499, 542
. : milestone, 520,
iast_FULL (741.861 µs) : 720, 764
. : milestone, 742,
iast_GLOBAL (564.661 µs) : 543, 587
. : milestone, 565,
iast_HARDCODED_SECRET_DISABLED (521.131 µs) : 499, 543
. : milestone, 521,
iast_INACTIVE (470.165 µs) : 449, 492
. : milestone, 470,
iast_TELEMETRY_OFF (509.689 µs) : 487, 532
. : milestone, 510,
tracing (467.319 µs) : 446, 489
. : milestone, 467,

Loading

• baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	382.212 µs [361.965 µs, 402.459 µs]	-
iast	518.418 µs [496.648 µs, 540.188 µs]	136.206 µs (35.6%)
iast_FULL	737.905 µs [715.877 µs, 759.933 µs]	355.693 µs (93.1%)
iast_GLOBAL	564.556 µs [542.795 µs, 586.318 µs]	182.344 µs (47.7%)
iast_HARDCODED_SECRET_DISABLED	520.539 µs [498.599 µs, 542.478 µs]	138.327 µs (36.2%)
iast_INACTIVE	469.102 µs [447.369 µs, 490.835 µs]	86.89 µs (22.7%)
iast_TELEMETRY_OFF	516.154 µs [493.317 µs, 538.99 µs]	133.942 µs (35.0%)
tracing	466.684 µs [445.341 µs, 488.028 µs]	84.473 µs (22.1%)

• candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	384.365 µs [364.325 µs, 404.405 µs]	-
iast	520.471 µs [498.688 µs, 542.253 µs]	136.106 µs (35.4%)
iast_FULL	741.861 µs [719.636 µs, 764.087 µs]	357.496 µs (93.0%)
iast_GLOBAL	564.661 µs [542.515 µs, 586.807 µs]	180.296 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED	521.131 µs [499.159 µs, 543.103 µs]	136.765 µs (35.6%)
iast_INACTIVE	470.165 µs [448.752 µs, 491.579 µs]	85.8 µs (22.3%)
iast_TELEMETRY_OFF	509.689 µs [487.414 µs, 531.964 µs]	125.324 µs (32.6%)
tracing	467.319 µs [445.818 µs, 488.821 µs]	82.954 µs (21.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	alejandro.gonzalez/APPSEC-57054
git_commit_date	1743592817	1743592881
git_commit_sha	32046a3	5f4cc62
release_version	1.48.0-SNAPSHOT~32046a39ed	1.48.0-SNAPSHOT~5f4cc62475

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1743595444	1743595444
ci_job_id	876761448	876761448
ci_pipeline_id	60782595	60782595
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-1ywhvvpj-project-304-concurrent-1-kk9myiz4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-1ywhvvpj-project-304-concurrent-1-kk9myiz4 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section baseline
no_agent (15.52 s) : 15520000, 15520000
. : milestone, 15520000,
appsec (15.01 s) : 15010000, 15010000
. : milestone, 15010000,
iast (18.868 s) : 18868000, 18868000
. : milestone, 18868000,
iast_GLOBAL (18.161 s) : 18161000, 18161000
. : milestone, 18161000,
profiling (14.921 s) : 14921000, 14921000
. : milestone, 14921000,
tracing (15.035 s) : 15035000, 15035000
. : milestone, 15035000,
section candidate
no_agent (15.466 s) : 15466000, 15466000
. : milestone, 15466000,
appsec (14.779 s) : 14779000, 14779000
. : milestone, 14779000,
iast (19.25 s) : 19250000, 19250000
. : milestone, 19250000,
iast_GLOBAL (18.218 s) : 18218000, 18218000
. : milestone, 18218000,
profiling (15.588 s) : 15588000, 15588000
. : milestone, 15588000,
tracing (14.847 s) : 14847000, 14847000
. : milestone, 14847000,

Loading

• baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.52 s [15.52 s, 15.52 s]	-
appsec	15.01 s [15.01 s, 15.01 s]	-510.0 ms (-3.3%)
iast	18.868 s [18.868 s, 18.868 s]	3.348 s (21.6%)
iast_GLOBAL	18.161 s [18.161 s, 18.161 s]	2.641 s (17.0%)
profiling	14.921 s [14.921 s, 14.921 s]	-599.0 ms (-3.9%)
tracing	15.035 s [15.035 s, 15.035 s]	-485.0 ms (-3.1%)

• candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.466 s [15.466 s, 15.466 s]	-
appsec	14.779 s [14.779 s, 14.779 s]	-687.0 ms (-4.4%)
iast	19.25 s [19.25 s, 19.25 s]	3.784 s (24.5%)
iast_GLOBAL	18.218 s [18.218 s, 18.218 s]	2.752 s (17.8%)
profiling	15.588 s [15.588 s, 15.588 s]	122.0 ms (0.8%)
tracing	14.847 s [14.847 s, 14.847 s]	-619.0 ms (-4.0%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~5f4cc62475, baseline=1.48.0-SNAPSHOT~32046a39ed
dateFormat X
axisFormat %s
section baseline
no_agent (1.477 ms) : 1466, 1489
. : milestone, 1477,
appsec (2.374 ms) : 2327, 2421
. : milestone, 2374,
iast (2.161 ms) : 2102, 2220
. : milestone, 2161,
iast_GLOBAL (2.195 ms) : 2136, 2253
. : milestone, 2195,
profiling (2.473 ms) : 2292, 2653
. : milestone, 2473,
tracing (1.979 ms) : 1934, 2025
. : milestone, 1979,
section candidate
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (2.37 ms) : 2324, 2417
. : milestone, 2370,
iast (2.159 ms) : 2101, 2218
. : milestone, 2159,
iast_GLOBAL (2.199 ms) : 2140, 2258
. : milestone, 2199,
profiling (2.028 ms) : 1979, 2076
. : milestone, 2028,
tracing (1.978 ms) : 1933, 2023
. : milestone, 1978,

Loading

• baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.466 ms, 1.489 ms]	-
appsec	2.374 ms [2.327 ms, 2.421 ms]	896.584 µs (60.7%)
iast	2.161 ms [2.102 ms, 2.22 ms]	683.955 µs (46.3%)
iast_GLOBAL	2.195 ms [2.136 ms, 2.253 ms]	717.249 µs (48.6%)
profiling	2.473 ms [2.292 ms, 2.653 ms]	995.312 µs (67.4%)
tracing	1.979 ms [1.934 ms, 2.025 ms]	501.85 µs (34.0%)

• candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	2.37 ms [2.324 ms, 2.417 ms]	892.427 µs (60.4%)
iast	2.159 ms [2.101 ms, 2.218 ms]	681.609 µs (46.1%)
iast_GLOBAL	2.199 ms [2.14 ms, 2.258 ms]	721.6 µs (48.8%)
profiling	2.028 ms [1.979 ms, 2.076 ms]	550.055 µs (37.2%)
tracing	1.978 ms [1.933 ms, 2.023 ms]	500.187 µs (33.8%)