Nikita tkachenko/test env 87b536644c4927894b6b24d99c5088a787f44dea by nikita-tkachenko-datadog · Pull Request #8496 · DataDog/dd-trace-java

nikita-tkachenko-datadog · 2025-03-04T11:57:24Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

… Kit (#8465)

if the service methods aren't found on the ImplBase, look for an AsyncService interface which *should* have the service methods.

pr-commenter · 2025-03-04T12:34:53Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea
git_commit_date	1741082792	1740751331
git_commit_sha	`8f945b0`	`87b5366`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~87b536644c

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741091645	1741091645
ci_job_id	831518062	831518062
ci_pipeline_id	57626486	57626486
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-ozdivcxc-project-304-concurrent-0-iye45262 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-ozdivcxc-project-304-concurrent-0-iye45262 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 21 performance improvements and 6 performance regressions! Performance is the same for 26 metrics, 10 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent	better [-665.159ms; -522.556ms] or [-6.753%; -5.305%]	9.257s	9.851s
scenario:startup:insecure-bank:iast:Agent.start	better [-91.730ms; -60.592ms] or [-7.281%; -4.810%]	1.184s	1.260s
scenario:startup:insecure-bank:iast:Remote Config	worse [+78.155µs; +111.713µs] or [+15.036%; +21.492%]	614.717µs	519.783µs
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent	better [-689.269ms; -605.062ms] or [-7.005%; -6.149%]	9.193s	9.840s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.start	better [-97.928ms; -86.530ms] or [-7.755%; -6.852%]	1.171s	1.263s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Remote Config	worse [+52.811µs; +92.523µs] or [+9.880%; +17.309%]	607.217µs	534.550µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent	better [-679.251ms; -571.892ms] or [-6.896%; -5.806%]	9.224s	9.849s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.start	better [-91.798ms; -83.298ms] or [-7.321%; -6.643%]	1.166s	1.254s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config	worse [+70.912µs; +105.963µs] or [+13.443%; +20.088%]	615.935µs	527.497µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Telemetry	better [-3.595ms; -3.304ms] or [-29.860%; -27.442%]	8.590ms	12.039ms
scenario:startup:insecure-bank:tracing:Agent	better [-710.184ms; -628.630ms] or [-7.633%; -6.756%]	8.635s	9.304s
scenario:startup:insecure-bank:tracing:Agent.start	better [-102.037ms; -92.384ms] or [-8.974%; -8.125%]	1.040s	1.137s
scenario:startup:insecure-bank:tracing:Remote Config	worse [+88.075µs; +120.907µs] or [+15.139%; +20.783%]	686.248µs	581.757µs
scenario:startup:petclinic:appsec:Agent	better [-996.280ms; -798.957ms] or [-8.570%; -6.873%]	10.727s	11.625s
scenario:startup:petclinic:appsec:Agent.start	better [-106.660ms; -78.955ms] or [-8.355%; -6.185%]	1.184s	1.277s
scenario:startup:petclinic:appsec:Telemetry	better [-4.099ms; -3.769ms] or [-33.520%; -30.824%]	8.293ms	12.227ms
scenario:startup:petclinic:iast:Agent	better [-1.140s; -0.964s] or [-9.517%; -8.048%]	10.931s	11.983s
scenario:startup:petclinic:iast:Agent.start	better [-99.556ms; -88.695ms] or [-7.870%; -7.011%]	1.171s	1.265s
scenario:startup:petclinic:iast:Remote Config	worse [+70.809µs; +110.107µs] or [+13.439%; +20.898%]	617.334µs	526.876µs
scenario:startup:petclinic:profiling:Agent	better [-971.851ms; -699.638ms] or [-8.258%; -5.945%]	10.933s	11.769s
scenario:startup:petclinic:profiling:Agent.start	better [-126.756ms; -96.506ms] or [-9.184%; -6.993%]	1.268s	1.380s
scenario:startup:petclinic:profiling:ProfilingAgent	better [-28.420ms; -23.281ms] or [-23.063%; -18.893%]	97.377ms	123.227ms
scenario:startup:petclinic:profiling:Remote Config	worse [+49.848µs; +101.760µs] or [+8.221%; +16.782%]	682.165µs	606.361µs
scenario:startup:petclinic:profiling:Telemetry	better [-3.592ms; -3.075ms] or [-28.719%; -24.590%]	9.172ms	12.506ms
scenario:startup:petclinic:profiling:Profiling	better [-28.414ms; -23.276ms] or [-23.054%; -18.886%]	97.403ms	123.248ms
scenario:startup:petclinic:tracing:Agent	better [-1.131s; -0.886s] or [-9.863%; -7.727%]	10.459s	11.468s
scenario:startup:petclinic:tracing:Agent.start	better [-102.346ms; -90.656ms] or [-9.004%; -7.976%]	1.040s	1.137s

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.137 s) : 0, 1137092
Total [baseline] (9.304 s) : 0, 9304391
Agent [candidate] (1.04 s) : 0, 1039882
Total [candidate] (8.635 s) : 0, 8634984
section iast
Agent [baseline] (1.26 s) : 0, 1259818
Total [baseline] (9.851 s) : 0, 9850540
Agent [candidate] (1.184 s) : 0, 1183656
Total [candidate] (9.257 s) : 0, 9256683
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.263 s) : 0, 1262759
Total [baseline] (9.84 s) : 0, 9840235
Agent [candidate] (1.171 s) : 0, 1170530
Total [candidate] (9.193 s) : 0, 9193070
section iast_TELEMETRY_OFF
Agent [baseline] (1.254 s) : 0, 1253845
Total [baseline] (9.849 s) : 0, 9849377
Agent [candidate] (1.166 s) : 0, 1166297
Total [candidate] (9.224 s) : 0, 9223805

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.137 s	-
Agent	iast	1.26 s	122.725 ms (10.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.263 s	125.666 ms (11.1%)
Agent	iast_TELEMETRY_OFF	1.254 s	116.753 ms (10.3%)
Total	tracing	9.304 s	-
Total	iast	9.851 s	546.149 ms (5.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.84 s	535.844 ms (5.8%)
Total	iast_TELEMETRY_OFF	9.849 s	544.986 ms (5.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	iast	1.184 s	143.774 ms (13.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.171 s	130.648 ms (12.6%)
Agent	iast_TELEMETRY_OFF	1.166 s	126.415 ms (12.2%)
Total	tracing	8.635 s	-
Total	iast	9.257 s	621.699 ms (7.2%)
Total	iast_HARDCODED_SECRET_DISABLED	9.193 s	558.086 ms (6.5%)
Total	iast_TELEMETRY_OFF	9.224 s	588.821 ms (6.8%)

gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.432 ms) : 0, 718432
BytebuddyAgent [candidate] (717.085 ms) : 0, 717085
GlobalTracer [baseline] (240.163 ms) : 0, 240163
GlobalTracer [candidate] (239.021 ms) : 0, 239021
AppSec [baseline] (55.475 ms) : 0, 55475
AppSec [candidate] (55.291 ms) : 0, 55291
Remote Config [baseline] (581.757 µs) : 0, 582
Remote Config [candidate] (686.248 µs) : 0, 686
Telemetry [baseline] (12.298 ms) : 0, 12298
Telemetry [candidate] (12.936 ms) : 0, 12936
Debugger [baseline] (95.089 ms) : 0, 95089
section iast
BytebuddyAgent [baseline] (835.377 ms) : 0, 835377
BytebuddyAgent [candidate] (849.813 ms) : 0, 849813
GlobalTracer [baseline] (230.14 ms) : 0, 230140
GlobalTracer [candidate] (229.414 ms) : 0, 229414
IAST [baseline] (23.525 ms) : 0, 23525
IAST [candidate] (22.823 ms) : 0, 22823
AppSec [baseline] (56.108 ms) : 0, 56108
AppSec [candidate] (57.156 ms) : 0, 57156
Remote Config [baseline] (519.783 µs) : 0, 520
Remote Config [candidate] (614.717 µs) : 0, 615
Telemetry [baseline] (15.712 ms) : 0, 15712
Telemetry [candidate] (8.666 ms) : 0, 8666
Debugger [baseline] (83.475 ms) : 0, 83475
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.254 ms) : 0, 836254
BytebuddyAgent [candidate] (836.317 ms) : 0, 836317
GlobalTracer [baseline] (232.162 ms) : 0, 232162
GlobalTracer [candidate] (230.005 ms) : 0, 230005
IAST [baseline] (23.177 ms) : 0, 23177
IAST [candidate] (22.825 ms) : 0, 22825
AppSec [baseline] (57.479 ms) : 0, 57479
AppSec [candidate] (57.121 ms) : 0, 57121
Remote Config [baseline] (534.55 µs) : 0, 535
Remote Config [candidate] (607.217 µs) : 0, 607
Telemetry [baseline] (13.696 ms) : 0, 13696
Telemetry [candidate] (8.73 ms) : 0, 8730
Debugger [baseline] (84.52 ms) : 0, 84520
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.09 ms) : 0, 833090
BytebuddyAgent [candidate] (833.72 ms) : 0, 833720
GlobalTracer [baseline] (230.741 ms) : 0, 230741
GlobalTracer [candidate] (229.405 ms) : 0, 229405
IAST [baseline] (23.819 ms) : 0, 23819
IAST [candidate] (25.309 ms) : 0, 25309
AppSec [baseline] (55.312 ms) : 0, 55312
AppSec [candidate] (53.813 ms) : 0, 53813
Remote Config [baseline] (527.497 µs) : 0, 527
Remote Config [candidate] (615.935 µs) : 0, 616
Telemetry [baseline] (12.039 ms) : 0, 12039
Telemetry [candidate] (8.59 ms) : 0, 8590
Debugger [baseline] (83.43 ms) : 0, 83430

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.137 s) : 0, 1136664
Total [baseline] (11.468 s) : 0, 11467768
Agent [candidate] (1.04 s) : 0, 1040163
Total [candidate] (10.459 s) : 0, 10459189
section appsec
Agent [baseline] (1.277 s) : 0, 1276656
Total [baseline] (11.625 s) : 0, 11625115
Agent [candidate] (1.184 s) : 0, 1183848
Total [candidate] (10.727 s) : 0, 10727497
section iast
Agent [baseline] (1.265 s) : 0, 1265064
Total [baseline] (11.983 s) : 0, 11983099
Agent [candidate] (1.171 s) : 0, 1170939
Total [candidate] (10.931 s) : 0, 10930657
section profiling
Agent [baseline] (1.38 s) : 0, 1380126
Total [baseline] (11.769 s) : 0, 11768539
Agent [candidate] (1.268 s) : 0, 1268495
Total [candidate] (10.933 s) : 0, 10932794

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.137 s	-
Agent	appsec	1.277 s	139.992 ms (12.3%)
Agent	iast	1.265 s	128.4 ms (11.3%)
Agent	profiling	1.38 s	243.462 ms (21.4%)
Total	tracing	11.468 s	-
Total	appsec	11.625 s	157.347 ms (1.4%)
Total	iast	11.983 s	515.331 ms (4.5%)
Total	profiling	11.769 s	300.771 ms (2.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.04 s	-
Agent	appsec	1.184 s	143.685 ms (13.8%)
Agent	iast	1.171 s	130.775 ms (12.6%)
Agent	profiling	1.268 s	228.331 ms (22.0%)
Total	tracing	10.459 s	-
Total	appsec	10.727 s	268.308 ms (2.6%)
Total	iast	10.931 s	471.468 ms (4.5%)
Total	profiling	10.933 s	473.606 ms (4.5%)

gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.663 ms) : 0, 717663
BytebuddyAgent [candidate] (717.123 ms) : 0, 717123
GlobalTracer [baseline] (240.082 ms) : 0, 240082
GlobalTracer [candidate] (240.6 ms) : 0, 240600
AppSec [baseline] (55.85 ms) : 0, 55850
AppSec [candidate] (55.987 ms) : 0, 55987
Remote Config [baseline] (592.723 µs) : 0, 593
Remote Config [candidate] (700.048 µs) : 0, 700
Telemetry [baseline] (12.441 ms) : 0, 12441
Telemetry [candidate] (10.852 ms) : 0, 10852
Debugger [baseline] (95.146 ms) : 0, 95146
section appsec
BytebuddyAgent [baseline] (739.447 ms) : 0, 739447
BytebuddyAgent [candidate] (735.736 ms) : 0, 735736
GlobalTracer [baseline] (237.118 ms) : 0, 237118
GlobalTracer [candidate] (236.085 ms) : 0, 236085
IAST [baseline] (21.538 ms) : 0, 21538
IAST [candidate] (21.474 ms) : 0, 21474
AppSec [baseline] (176.377 ms) : 0, 176377
AppSec [candidate] (177.364 ms) : 0, 177364
Remote Config [baseline] (642.623 µs) : 0, 643
Remote Config [candidate] (660.991 µs) : 0, 661
Telemetry [baseline] (12.227 ms) : 0, 12227
Telemetry [candidate] (8.293 ms) : 0, 8293
Debugger [baseline] (85.035 ms) : 0, 85035
section iast
BytebuddyAgent [baseline] (837.911 ms) : 0, 837911
BytebuddyAgent [candidate] (836.49 ms) : 0, 836490
GlobalTracer [baseline] (231.299 ms) : 0, 231299
GlobalTracer [candidate] (229.834 ms) : 0, 229834
IAST [baseline] (22.949 ms) : 0, 22949
IAST [candidate] (22.963 ms) : 0, 22963
AppSec [baseline] (57.243 ms) : 0, 57243
AppSec [candidate] (57.41 ms) : 0, 57410
Remote Config [baseline] (526.876 µs) : 0, 527
Remote Config [candidate] (617.334 µs) : 0, 617
Telemetry [baseline] (16.341 ms) : 0, 16341
Telemetry [candidate] (8.697 ms) : 0, 8697
Debugger [baseline] (83.832 ms) : 0, 83832
section profiling
BytebuddyAgent [baseline] (709.654 ms) : 0, 709654
BytebuddyAgent [candidate] (713.898 ms) : 0, 713898
GlobalTracer [baseline] (350.337 ms) : 0, 350337
GlobalTracer [candidate] (351.415 ms) : 0, 351415
AppSec [baseline] (55.215 ms) : 0, 55215
AppSec [candidate] (55.48 ms) : 0, 55480
Remote Config [baseline] (606.361 µs) : 0, 606
Remote Config [candidate] (682.165 µs) : 0, 682
Telemetry [baseline] (12.506 ms) : 0, 12506
Telemetry [candidate] (9.172 ms) : 0, 9172
Debugger [baseline] (88.374 ms) : 0, 88374
ProfilingAgent [baseline] (123.227 ms) : 0, 123227
ProfilingAgent [candidate] (97.377 ms) : 0, 97377
Profiling [baseline] (123.248 ms) : 0, 123248
Profiling [candidate] (97.403 ms) : 0, 97403

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-03-04T12:03:14	2025-03-04T12:11:07
git_branch	master	nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea
git_commit_date	1741082792	1740751331
git_commit_sha	`8f945b0`	`87b5366`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~87b536644c
start_time	2025-03-04T12:02:59	2025-03-04T12:10:53

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741090664	1741090664
ci_job_id	831518063	831518063
ci_pipeline_id	57626486	57626486
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zrt-bbxu-project-304-concurrent-0-3uxnivld 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zrt-bbxu-project-304-concurrent-0-3uxnivld 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (1.367 ms) : 1347, 1387
. : milestone, 1367,
appsec (1.733 ms) : 1708, 1758
. : milestone, 1733,
appsec_no_iast (1.732 ms) : 1707, 1757
. : milestone, 1732,
code_origins (1.701 ms) : 1667, 1735
. : milestone, 1701,
iast (1.51 ms) : 1484, 1536
. : milestone, 1510,
profiling (1.524 ms) : 1499, 1548
. : milestone, 1524,
tracing (1.495 ms) : 1470, 1519
. : milestone, 1495,
section candidate
no_agent (1.354 ms) : 1335, 1374
. : milestone, 1354,
appsec (1.758 ms) : 1734, 1781
. : milestone, 1758,
appsec_no_iast (1.752 ms) : 1728, 1777
. : milestone, 1752,
code_origins (1.676 ms) : 1644, 1709
. : milestone, 1676,
iast (1.496 ms) : 1473, 1520
. : milestone, 1496,
profiling (1.51 ms) : 1487, 1534
. : milestone, 1510,
tracing (1.469 ms) : 1443, 1495
. : milestone, 1469,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.367 ms [1.347 ms, 1.387 ms]	-
appsec	1.733 ms [1.708 ms, 1.758 ms]	366.191 µs (26.8%)
appsec_no_iast	1.732 ms [1.707 ms, 1.757 ms]	365.318 µs (26.7%)
code_origins	1.701 ms [1.667 ms, 1.735 ms]	334.134 µs (24.4%)
iast	1.51 ms [1.484 ms, 1.536 ms]	142.955 µs (10.5%)
profiling	1.524 ms [1.499 ms, 1.548 ms]	156.472 µs (11.4%)
tracing	1.495 ms [1.47 ms, 1.519 ms]	127.527 µs (9.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.335 ms, 1.374 ms]	-
appsec	1.758 ms [1.734 ms, 1.781 ms]	403.479 µs (29.8%)
appsec_no_iast	1.752 ms [1.728 ms, 1.777 ms]	398.429 µs (29.4%)
code_origins	1.676 ms [1.644 ms, 1.709 ms]	322.302 µs (23.8%)
iast	1.496 ms [1.473 ms, 1.52 ms]	142.338 µs (10.5%)
profiling	1.51 ms [1.487 ms, 1.534 ms]	156.353 µs (11.5%)
tracing	1.469 ms [1.443 ms, 1.495 ms]	115.003 µs (8.5%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (379.986 µs) : 360, 400
. : milestone, 380,
iast (519.208 µs) : 497, 541
. : milestone, 519,
iast_FULL (726.567 µs) : 705, 749
. : milestone, 727,
iast_GLOBAL (557.143 µs) : 536, 579
. : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (517.586 µs) : 495, 540
. : milestone, 518,
iast_INACTIVE (466.977 µs) : 445, 489
. : milestone, 467,
iast_TELEMETRY_OFF (500.745 µs) : 479, 523
. : milestone, 501,
tracing (458.747 µs) : 437, 480
. : milestone, 459,
section candidate
no_agent (385.757 µs) : 366, 406
. : milestone, 386,
iast (513.394 µs) : 492, 535
. : milestone, 513,
iast_FULL (729.481 µs) : 707, 751
. : milestone, 729,
iast_GLOBAL (562.099 µs) : 540, 585
. : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (509.784 µs) : 487, 532
. : milestone, 510,
iast_INACTIVE (464.754 µs) : 444, 486
. : milestone, 465,
iast_TELEMETRY_OFF (504.948 µs) : 482, 528
. : milestone, 505,
tracing (462.962 µs) : 442, 484
. : milestone, 463,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.986 µs [359.517 µs, 400.455 µs]	-
iast	519.208 µs [497.224 µs, 541.192 µs]	139.222 µs (36.6%)
iast_FULL	726.567 µs [704.593 µs, 748.541 µs]	346.581 µs (91.2%)
iast_GLOBAL	557.143 µs [535.557 µs, 578.728 µs]	177.157 µs (46.6%)
iast_HARDCODED_SECRET_DISABLED	517.586 µs [494.89 µs, 540.282 µs]	137.6 µs (36.2%)
iast_INACTIVE	466.977 µs [445.239 µs, 488.716 µs]	86.991 µs (22.9%)
iast_TELEMETRY_OFF	500.745 µs [478.827 µs, 522.662 µs]	120.759 µs (31.8%)
tracing	458.747 µs [437.475 µs, 480.019 µs]	78.761 µs (20.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	385.757 µs [365.663 µs, 405.85 µs]	-
iast	513.394 µs [491.756 µs, 535.032 µs]	127.637 µs (33.1%)
iast_FULL	729.481 µs [707.481 µs, 751.481 µs]	343.724 µs (89.1%)
iast_GLOBAL	562.099 µs [539.625 µs, 584.573 µs]	176.343 µs (45.7%)
iast_HARDCODED_SECRET_DISABLED	509.784 µs [487.371 µs, 532.196 µs]	124.027 µs (32.2%)
iast_INACTIVE	464.754 µs [443.997 µs, 485.512 µs]	78.998 µs (20.5%)
iast_TELEMETRY_OFF	504.948 µs [481.942 µs, 527.954 µs]	119.191 µs (30.9%)
tracing	462.962 µs [441.915 µs, 484.009 µs]	77.205 µs (20.0%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea
git_commit_date	1741082792	1740751331
git_commit_sha	`8f945b0`	`87b5366`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~87b536644c

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1741091218	1741091218
ci_job_id	831518064	831518064
ci_pipeline_id	57626486	57626486
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-xk9phren-project-304-concurrent-2-5aw8oi69 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-xk9phren-project-304-concurrent-2-5aw8oi69 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (14.933 s) : 14933000, 14933000
. : milestone, 14933000,
appsec (14.976 s) : 14976000, 14976000
. : milestone, 14976000,
iast (18.828 s) : 18828000, 18828000
. : milestone, 18828000,
iast_GLOBAL (17.886 s) : 17886000, 17886000
. : milestone, 17886000,
profiling (15.085 s) : 15085000, 15085000
. : milestone, 15085000,
tracing (15.081 s) : 15081000, 15081000
. : milestone, 15081000,
section candidate
no_agent (15.408 s) : 15408000, 15408000
. : milestone, 15408000,
appsec (14.937 s) : 14937000, 14937000
. : milestone, 14937000,
iast (18.34 s) : 18340000, 18340000
. : milestone, 18340000,
iast_GLOBAL (17.561 s) : 17561000, 17561000
. : milestone, 17561000,
profiling (15.19 s) : 15190000, 15190000
. : milestone, 15190000,
tracing (14.894 s) : 14894000, 14894000
. : milestone, 14894000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.933 s [14.933 s, 14.933 s]	-
appsec	14.976 s [14.976 s, 14.976 s]	43.0 ms (0.3%)
iast	18.828 s [18.828 s, 18.828 s]	3.895 s (26.1%)
iast_GLOBAL	17.886 s [17.886 s, 17.886 s]	2.953 s (19.8%)
profiling	15.085 s [15.085 s, 15.085 s]	152.0 ms (1.0%)
tracing	15.081 s [15.081 s, 15.081 s]	148.0 ms (1.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.408 s [15.408 s, 15.408 s]	-
appsec	14.937 s [14.937 s, 14.937 s]	-471.0 ms (-3.1%)
iast	18.34 s [18.34 s, 18.34 s]	2.932 s (19.0%)
iast_GLOBAL	17.561 s [17.561 s, 17.561 s]	2.153 s (14.0%)
profiling	15.19 s [15.19 s, 15.19 s]	-218.0 ms (-1.4%)
tracing	14.894 s [14.894 s, 14.894 s]	-514.0 ms (-3.3%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~87b536644c, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (1.478 ms) : 1466, 1489
. : milestone, 1478,
appsec (2.352 ms) : 2308, 2396
. : milestone, 2352,
iast (2.126 ms) : 2071, 2182
. : milestone, 2126,
iast_GLOBAL (2.171 ms) : 2115, 2227
. : milestone, 2171,
profiling (1.98 ms) : 1936, 2023
. : milestone, 1980,
tracing (1.956 ms) : 1913, 1998
. : milestone, 1956,
section candidate
no_agent (1.478 ms) : 1466, 1490
. : milestone, 1478,
appsec (2.353 ms) : 2309, 2396
. : milestone, 2353,
iast (2.119 ms) : 2064, 2173
. : milestone, 2119,
iast_GLOBAL (2.171 ms) : 2115, 2226
. : milestone, 2171,
profiling (1.971 ms) : 1928, 2014
. : milestone, 1971,
tracing (1.94 ms) : 1899, 1982
. : milestone, 1940,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.489 ms]	-
appsec	2.352 ms [2.308 ms, 2.396 ms]	874.367 µs (59.2%)
iast	2.126 ms [2.071 ms, 2.182 ms]	648.724 µs (43.9%)
iast_GLOBAL	2.171 ms [2.115 ms, 2.227 ms]	693.309 µs (46.9%)
profiling	1.98 ms [1.936 ms, 2.023 ms]	501.911 µs (34.0%)
tracing	1.956 ms [1.913 ms, 1.998 ms]	478.022 µs (32.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.478 ms [1.466 ms, 1.49 ms]	-
appsec	2.353 ms [2.309 ms, 2.396 ms]	874.926 µs (59.2%)
iast	2.119 ms [2.064 ms, 2.173 ms]	640.618 µs (43.3%)
iast_GLOBAL	2.171 ms [2.115 ms, 2.226 ms]	692.702 µs (46.9%)
profiling	1.971 ms [1.928 ms, 2.014 ms]	493.062 µs (33.4%)
tracing	1.94 ms [1.899 ms, 1.982 ms]	462.306 µs (31.3%)

nikita-tkachenko-datadogand others added 2 commits February 28, 2025 14:12

Fix Gradle Launcher instrumentation to not interfere with Gradle Test…
da6a1b6
… Kit (#8465)

Look in another location for grpc service methods (#8468)
87b5366
if the service methods aren't found on the ImplBase, look for an AsyncService interface which *should* have the service methods.

nikita-tkachenko-datadog added the tag: do not merge Do not merge changes label Mar 4, 2025

nikita-tkachenko-datadog closed this Mar 4, 2025

nikita-tkachenko-datadog deleted the nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea branch March 4, 2025 14:10

Navigation Menu

Uh oh!

Nikita tkachenko/test env 87b536644c4927894b6b24d99c5088a787f44dea - #8496

Nikita tkachenko/test env 87b536644c4927894b6b24d99c5088a787f44dea#8496
nikita-tkachenko-datadog wants to merge 2 commits into
nikita-tkachenko/test-env-6a2bd8d1ecc54c7c918efdbd1e62027619269fc2from
nikita-tkachenko/test-env-87b536644c4927894b6b24d99c5088a787f44dea

nikita-tkachenko-datadog commented Mar 4, 2025

Uh oh!

pr-commenterBot commented Mar 4, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

nikita-tkachenko-datadog commented Mar 4, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants