Skip to content

Custom build on top of v1.51.1 - #9213

Closed
kr-igor wants to merge 5 commits into
masterfrom
kr-igor/dsm-improvements-custom-build
Closed

Custom build on top of v1.51.1 #9213
kr-igor wants to merge 5 commits into
masterfrom
kr-igor/dsm-improvements-custom-build

Conversation

@kr-igor

@kr-igorkr-igor commented Jul 22, 2025

Copy link
Copy Markdown
Contributor

This is v1.51.1 with the following PRs merged in:
#9151
#9137

See this ticket for details.

…9177)
* fix: avoid race conditions on feature discovery
(cherry picked from commit ff2c775)
* commit suggestion
Co-authored-by: Nikita Tkachenko <121111529+nikita-tkachenko-datadog@users.noreply.github.com>
(cherry picked from commit a304e94)
* fix: spotless and issue with groovy mocking
(cherry picked from commit 4e880c7)
---------
Co-authored-by: Nikita Tkachenko <121111529+nikita-tkachenko-datadog@users.noreply.github.com>
* Avoid long to string conversion
* Use synchronized
)
* DSM optimizations - major refactoring to get rid of LinkedHashMap
* Refactored DSM tags for all integrations
* Removed tests which no longer needed
* Fixed some more tests
* Fixed payload writer tests
* Fixed http tests
* Removed DataStreamsTagsBuilder, updated all integraions and tests
* Spotless apply
* Fixed more tests
* Add base hash support and service name overrides
* Fixed more tests
* Spotless apply
* Added tests for tags
* Improved coverage
* Removed unused imports
* Fixed even more tests
* Updated multiple tests
* Fixed more tests
* Spotless apply
* Fixed even more tests
* Fixed http tests, improved test coverage
* Spotless apply
* One more refactoring
* Some fixes in tests
* Improved test coverage
* Spotless apply
* Removed unused import
* Fixed all tags
* Fixed kafka tests
@kr-igor
kr-igor marked this pull request as ready for review July 22, 2025 14:18
@kr-igor
kr-igor requested review from a team as code ownersJuly 22, 2025 14:18
@pr-commenter

Copy link
Copy Markdown

Benchmarks

Startup

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterkr-igor/dsm-improvements-custom-build
git_commit_date17531872731753193350
git_commit_sha766af68da96233
release_version1.51.1-SNAPSHOT~766af685ed1.52.0-SNAPSHOT~da962336df
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17531956361753195636
ci_job_id10411340761041134076
ci_pipeline_id7131568671315686
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zfyrx7zua-project-304-concurrent-0-gydqojof 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zfyrx7zua-project-304-concurrent-0-gydqojof 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
moduleAgentAgent
parentNoneNone

Summary

Found 10 performance improvements and 3 performance regressions! Performance is the same for 30 metrics, 10 unstable metrics.

scenarioΔ mean execution_timecandidate mean execution_timebaseline mean execution_time
scenario:startup:insecure-bank:iast:Agent.startbetter
[-67.425ms; -33.745ms] or [-5.710%; -2.858%]
1.130s1.181s
scenario:startup:insecure-bank:iast:BytebuddyAgentbetter
[-60.247ms; -33.104ms] or [-7.070%; -3.885%]
805.480ms852.155ms
scenario:startup:insecure-bank:tracing:Agent.startbetter
[-48.176ms; -22.056ms] or [-4.653%; -2.130%]
1.000s1.035s
scenario:startup:insecure-bank:tracing:BytebuddyAgentbetter
[-46.563ms; -27.374ms] or [-6.401%; -3.763%]
690.427ms727.395ms
scenario:startup:insecure-bank:tracing:Remote Configworse
[+19.963µs; +66.679µs] or [+3.107%; +10.379%]
685.796µs642.475µs
scenario:startup:petclinic:appsec:Agent.startbetter
[-46.609ms; -38.861ms] or [-3.833%; -3.196%]
1.173s1.216s
scenario:startup:petclinic:appsec:BytebuddyAgentbetter
[-44.447ms; -38.833ms] or [-5.923%; -5.175%]
708.741ms750.381ms
scenario:startup:petclinic:iast:BytebuddyAgentbetter
[-47.633ms; -23.932ms] or [-5.627%; -2.827%]
810.760ms846.542ms
scenario:startup:petclinic:profiling:Agent.startworse
[+56.215ms; +63.807ms] or [+4.759%; +5.402%]
1.241s1.181s
scenario:startup:petclinic:profiling:BytebuddyAgentbetter
[-84.841ms; -79.749ms] or [-11.190%; -10.518%]
675.900ms758.195ms
scenario:startup:petclinic:profiling:GlobalTracerworse
[+139.331ms; +141.558ms] or [+63.304%; +64.316%]
360.542ms220.097ms
scenario:startup:petclinic:tracing:Agent.startbetter
[-63.793ms; -25.881ms] or [-6.105%; -2.477%]
1.000s1.045s
scenario:startup:petclinic:tracing:BytebuddyAgentbetter
[-57.372ms; -30.412ms] or [-7.816%; -4.143%]
690.171ms734.063ms
Startup time reports for insecure-bank
gantt
title insecure-bank - global startup overhead: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1035303
Total [baseline] (8.597 s) : 0, 8596773
Agent [candidate] (1.0 s) : 0, 1000187
Total [candidate] (8.553 s) : 0, 8553123
section iast
Agent [baseline] (1.181 s) : 0, 1180834
Total [baseline] (9.303 s) : 0, 9303156
Agent [candidate] (1.13 s) : 0, 1130249
Total [candidate] (9.271 s) : 0, 9270600
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.035 s-
Agentiast1.181 s145.531 ms (14.1%)
Totaltracing8.597 s-
Totaliast9.303 s706.383 ms (8.2%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.0 s-
Agentiast1.13 s130.062 ms (13.0%)
Totaltracing8.553 s-
Totaliast9.271 s717.476 ms (8.4%)
gantt
title insecure-bank - break down per module: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (727.395 ms) : 0, 727395
BytebuddyAgent [candidate] (690.427 ms) : 0, 690427
GlobalTracer [baseline] (240.61 ms) : 0, 240610
GlobalTracer [candidate] (243.293 ms) : 0, 243293
AppSec [baseline] (30.294 ms) : 0, 30294
AppSec [candidate] (30.617 ms) : 0, 30617
Debugger [baseline] (5.951 ms) : 0, 5951
Debugger [candidate] (5.982 ms) : 0, 5982
Remote Config [baseline] (642.475 µs) : 0, 642
Remote Config [candidate] (685.796 µs) : 0, 686
Telemetry [baseline] (8.152 ms) : 0, 8152
Telemetry [candidate] (8.323 ms) : 0, 8323
crashtracking [baseline] (1.419 ms) : 0, 1419
section iast
BytebuddyAgent [baseline] (852.155 ms) : 0, 852155
BytebuddyAgent [candidate] (805.48 ms) : 0, 805480
GlobalTracer [baseline] (232.941 ms) : 0, 232941
GlobalTracer [candidate] (231.864 ms) : 0, 231864
IAST [baseline] (30.419 ms) : 0, 30419
IAST [candidate] (26.199 ms) : 0, 26199
AppSec [baseline] (28.321 ms) : 0, 28321
AppSec [candidate] (30.967 ms) : 0, 30967
Debugger [baseline] (5.845 ms) : 0, 5845
Debugger [candidate] (6.592 ms) : 0, 6592
Remote Config [baseline] (600.401 µs) : 0, 600
Remote Config [candidate] (577.158 µs) : 0, 577
Telemetry [baseline] (8.102 ms) : 0, 8102
Telemetry [candidate] (7.921 ms) : 0, 7921
crashtracking [baseline] (1.434 ms) : 0, 1434
Loading
Startup time reports for petclinic
gantt
title petclinic - global startup overhead: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.045 s) : 0, 1044989
Total [baseline] (10.7 s) : 0, 10699593
Agent [candidate] (1.0 s) : 0, 1000152
Total [candidate] (10.753 s) : 0, 10752933
section appsec
Agent [baseline] (1.216 s) : 0, 1216017
Total [baseline] (10.845 s) : 0, 10845100
Agent [candidate] (1.173 s) : 0, 1173282
Total [candidate] (10.719 s) : 0, 10718970
section iast
Agent [baseline] (1.173 s) : 0, 1172603
Total [baseline] (10.844 s) : 0, 10844304
Agent [candidate] (1.137 s) : 0, 1137114
Total [candidate] (10.801 s) : 0, 10801323
section profiling
Agent [baseline] (1.181 s) : 0, 1181172
Total [baseline] (10.877 s) : 0, 10876623
Agent [candidate] (1.241 s) : 0, 1241183
Total [candidate] (10.935 s) : 0, 10935407
Loading
  • baseline results
ModuleVariantDurationΔ tracing
Agenttracing1.045 s-
Agentappsec1.216 s171.028 ms (16.4%)
Agentiast1.173 s127.614 ms (12.2%)
Agentprofiling1.181 s136.183 ms (13.0%)
Totaltracing10.7 s-
Totalappsec10.845 s145.507 ms (1.4%)
Totaliast10.844 s144.711 ms (1.4%)
Totalprofiling10.877 s177.031 ms (1.7%)
  • candidate results
ModuleVariantDurationΔ tracing
Agenttracing1.0 s-
Agentappsec1.173 s173.13 ms (17.3%)
Agentiast1.137 s136.962 ms (13.7%)
Agentprofiling1.241 s241.031 ms (24.1%)
Totaltracing10.753 s-
Totalappsec10.719 s-33.963 ms (-0.3%)
Totaliast10.801 s48.39 ms (0.5%)
Totalprofiling10.935 s182.474 ms (1.7%)
gantt
title petclinic - break down per module: candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (734.063 ms) : 0, 734063
BytebuddyAgent [candidate] (690.171 ms) : 0, 690171
GlobalTracer [baseline] (242.666 ms) : 0, 242666
GlobalTracer [candidate] (243.454 ms) : 0, 243454
AppSec [baseline] (30.722 ms) : 0, 30722
AppSec [candidate] (30.743 ms) : 0, 30743
Debugger [baseline] (6.069 ms) : 0, 6069
Debugger [candidate] (6.032 ms) : 0, 6032
Remote Config [baseline] (657.201 µs) : 0, 657
Remote Config [candidate] (682.713 µs) : 0, 683
Telemetry [baseline] (8.282 ms) : 0, 8282
Telemetry [candidate] (8.262 ms) : 0, 8262
crashtracking [baseline] (1.445 ms) : 0, 1445
section appsec
BytebuddyAgent [baseline] (750.381 ms) : 0, 750381
BytebuddyAgent [candidate] (708.741 ms) : 0, 708741
GlobalTracer [baseline] (234.254 ms) : 0, 234254
GlobalTracer [candidate] (234.778 ms) : 0, 234778
IAST [baseline] (23.498 ms) : 0, 23498
IAST [candidate] (23.193 ms) : 0, 23193
AppSec [baseline] (167.804 ms) : 0, 167804
AppSec [candidate] (171.286 ms) : 0, 171286
Debugger [baseline] (8.648 ms) : 0, 8648
Debugger [candidate] (5.734 ms) : 0, 5734
Remote Config [baseline] (612.249 µs) : 0, 612
Remote Config [candidate] (610.644 µs) : 0, 611
Telemetry [baseline] (8.131 ms) : 0, 8131
Telemetry [candidate] (8.104 ms) : 0, 8104
crashtracking [baseline] (1.417 ms) : 0, 1417
section iast
BytebuddyAgent [baseline] (846.542 ms) : 0, 846542
BytebuddyAgent [candidate] (810.76 ms) : 0, 810760
GlobalTracer [baseline] (231.153 ms) : 0, 231153
GlobalTracer [candidate] (233.128 ms) : 0, 233128
IAST [baseline] (27.421 ms) : 0, 27421
IAST [candidate] (26.493 ms) : 0, 26493
AppSec [baseline] (28.176 ms) : 0, 28176
AppSec [candidate] (30.877 ms) : 0, 30877
Debugger [baseline] (8.437 ms) : 0, 8437
Debugger [candidate] (6.604 ms) : 0, 6604
Remote Config [baseline] (594.819 µs) : 0, 595
Remote Config [candidate] (577.255 µs) : 0, 577
Telemetry [baseline] (7.891 ms) : 0, 7891
Telemetry [candidate] (7.85 ms) : 0, 7850
crashtracking [baseline] (1.429 ms) : 0, 1429
section profiling
BytebuddyAgent [baseline] (758.195 ms) : 0, 758195
BytebuddyAgent [candidate] (675.9 ms) : 0, 675900
GlobalTracer [baseline] (220.097 ms) : 0, 220097
GlobalTracer [candidate] (360.542 ms) : 0, 360542
AppSec [baseline] (30.221 ms) : 0, 30221
AppSec [candidate] (35.223 ms) : 0, 35223
Debugger [baseline] (6.243 ms) : 0, 6243
Debugger [candidate] (9.107 ms) : 0, 9107
Remote Config [baseline] (658.135 µs) : 0, 658
Remote Config [candidate] (656.199 µs) : 0, 656
Telemetry [baseline] (12.425 ms) : 0, 12425
Telemetry [candidate] (7.951 ms) : 0, 7951
crashtracking [baseline] (1.394 ms) : 0, 1394
ProfilingAgent [baseline] (103.695 ms) : 0, 103695
ProfilingAgent [candidate] (103.353 ms) : 0, 103353
Profiling [baseline] (103.718 ms) : 0, 103718
Profiling [candidate] (103.379 ms) : 0, 103379
Loading

Load

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterkr-igor/dsm-improvements-custom-build
git_commit_date17531872731753193350
git_commit_sha766af68da96233
release_version1.51.1-SNAPSHOT~766af685ed1.52.0-SNAPSHOT~da962336df
See matching parameters
BaselineCandidate
applicationinsecure-bankinsecure-bank
ci_job_date17531953111753195311
ci_job_id10411340771041134077
ci_pipeline_id7131568671315686
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zfyrx7zua-project-304-concurrent-2-sfti2d9z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zfyrx7zua-project-304-concurrent-2-sfti2d9z 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenarioΔ mean http_req_durationΔ mean throughputcandidate mean http_req_durationcandidate mean throughputbaseline mean http_req_durationbaseline mean throughput
scenario:load:insecure-bank:profiling:high_loadbetter
[-740.947µs; -393.513µs] or [-7.904%; -4.198%]
unstable
[-39.443op/s; +102.630op/s] or [-7.965%; +20.726%]
8.807ms526.781op/s9.374ms495.188op/s
scenario:load:petclinic:no_agent:high_loadworse
[+0.831ms; +1.498ms] or [+2.231%; +4.020%]
unstable
[-12.941op/s; +5.441op/s] or [-10.314%; +4.337%]
38.425ms121.725op/s37.261ms125.475op/s
scenario:load:petclinic:profiling:high_loadbetter
[-2.086ms; -1.086ms] or [-4.152%; -2.162%]
unstable
[-2.815op/s; +11.225op/s] or [-3.021%; +12.044%]
48.645ms97.405op/s50.231ms93.200op/s
scenario:load:petclinic:code_origins:high_loadbetter
[-2.558ms; -1.740ms] or [-5.568%; -3.787%]
unstable
[-3.016op/s; +12.991op/s] or [-2.961%; +12.756%]
43.798ms106.825op/s45.948ms101.838op/s
scenario:load:petclinic:appsec:high_loadbetter
[-2.946ms; -2.005ms] or [-5.933%; -4.038%]
unstable
[-1.005op/s; +13.366op/s] or [-1.066%; +14.178%]
47.177ms100.456op/s49.653ms94.275op/s
Request duration reports for insecure-bank
gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section baseline
no_agent (4.348 ms) : 4295, 4401
. : milestone, 4348,
iast (9.163 ms) : 9002, 9323
. : milestone, 9163,
iast_FULL (14.394 ms) : 14105, 14684
. : milestone, 14394,
iast_GLOBAL (10.199 ms) : 10007, 10392
. : milestone, 10199,
profiling (9.374 ms) : 9199, 9548
. : milestone, 9374,
tracing (7.544 ms) : 7429, 7658
. : milestone, 7544,
section candidate
no_agent (4.48 ms) : 4430, 4530
. : milestone, 4480,
iast (9.432 ms) : 9276, 9588
. : milestone, 9432,
iast_FULL (14.036 ms) : 13758, 14314
. : milestone, 14036,
iast_GLOBAL (10.496 ms) : 10303, 10690
. : milestone, 10496,
profiling (8.807 ms) : 8659, 8954
. : milestone, 8807,
tracing (7.485 ms) : 7381, 7589
. : milestone, 7485,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent4.348 ms [4.295 ms, 4.401 ms]-
iast9.163 ms [9.002 ms, 9.323 ms]4.815 ms (110.7%)
iast_FULL14.394 ms [14.105 ms, 14.684 ms]10.046 ms (231.1%)
iast_GLOBAL10.199 ms [10.007 ms, 10.392 ms]5.851 ms (134.6%)
profiling9.374 ms [9.199 ms, 9.548 ms]5.026 ms (115.6%)
tracing7.544 ms [7.429 ms, 7.658 ms]3.196 ms (73.5%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent4.48 ms [4.43 ms, 4.53 ms]-
iast9.432 ms [9.276 ms, 9.588 ms]4.952 ms (110.5%)
iast_FULL14.036 ms [13.758 ms, 14.314 ms]9.555 ms (213.3%)
iast_GLOBAL10.496 ms [10.303 ms, 10.69 ms]6.016 ms (134.3%)
profiling8.807 ms [8.659 ms, 8.954 ms]4.326 ms (96.6%)
tracing7.485 ms [7.381 ms, 7.589 ms]3.005 ms (67.1%)
Request duration reports for petclinic
gantt
title petclinic - request duration [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section baseline
no_agent (37.261 ms) : 36958, 37563
. : milestone, 37261,
appsec (49.653 ms) : 49208, 50098
. : milestone, 49653,
code_origins (45.948 ms) : 45546, 46349
. : milestone, 45948,
iast (44.743 ms) : 44358, 45129
. : milestone, 44743,
profiling (50.231 ms) : 49768, 50694
. : milestone, 50231,
tracing (42.833 ms) : 42461, 43205
. : milestone, 42833,
section candidate
no_agent (38.425 ms) : 38108, 38742
. : milestone, 38425,
appsec (47.177 ms) : 46748, 47607
. : milestone, 47177,
code_origins (43.798 ms) : 43441, 44156
. : milestone, 43798,
iast (44.029 ms) : 43652, 44406
. : milestone, 44029,
profiling (48.645 ms) : 48179, 49112
. : milestone, 48645,
tracing (42.291 ms) : 41926, 42657
. : milestone, 42291,
Loading
  • baseline results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent37.261 ms [36.958 ms, 37.563 ms]-
appsec49.653 ms [49.208 ms, 50.098 ms]12.392 ms (33.3%)
code_origins45.948 ms [45.546 ms, 46.349 ms]8.687 ms (23.3%)
iast44.743 ms [44.358 ms, 45.129 ms]7.483 ms (20.1%)
profiling50.231 ms [49.768 ms, 50.694 ms]12.971 ms (34.8%)
tracing42.833 ms [42.461 ms, 43.205 ms]5.573 ms (15.0%)
  • candidate results
VariantRequest duration [CI 0.99]Δ no_agent
no_agent38.425 ms [38.108 ms, 38.742 ms]-
appsec47.177 ms [46.748 ms, 47.607 ms]8.752 ms (22.8%)
code_origins43.798 ms [43.441 ms, 44.156 ms]5.373 ms (14.0%)
iast44.029 ms [43.652 ms, 44.406 ms]5.604 ms (14.6%)
profiling48.645 ms [48.179 ms, 49.112 ms]10.22 ms (26.6%)
tracing42.291 ms [41.926 ms, 42.657 ms]3.866 ms (10.1%)

Dacapo

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterkr-igor/dsm-improvements-custom-build
git_commit_date17531872731753193350
git_commit_sha766af68da96233
release_version1.51.1-SNAPSHOT~766af685ed1.52.0-SNAPSHOT~da962336df
See matching parameters
BaselineCandidate
applicationbiojavabiojava
ci_job_date17531957561753195756
ci_job_id10411340781041134078
ci_pipeline_id7131568671315686
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_versionLinux runner-zfyrx7zua-project-304-concurrent-1-hl13wf7x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/LinuxLinux runner-zfyrx7zua-project-304-concurrent-1-hl13wf7x 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenarioΔ mean execution_timecandidate mean execution_timebaseline mean execution_time
scenario:dacapo:tomcat:appsecbetter
[-1.432ms; -1.091ms] or [-38.950%; -29.689%]
2.415ms3.676ms
Execution time for biojava
gantt
title biojava - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section baseline
no_agent (15.488 s) : 15488000, 15488000
. : milestone, 15488000,
appsec (15.232 s) : 15232000, 15232000
. : milestone, 15232000,
iast (18.437 s) : 18437000, 18437000
. : milestone, 18437000,
iast_GLOBAL (17.757 s) : 17757000, 17757000
. : milestone, 17757000,
profiling (15.033 s) : 15033000, 15033000
. : milestone, 15033000,
tracing (14.818 s) : 14818000, 14818000
. : milestone, 14818000,
section candidate
no_agent (15.529 s) : 15529000, 15529000
. : milestone, 15529000,
appsec (14.94 s) : 14940000, 14940000
. : milestone, 14940000,
iast (18.269 s) : 18269000, 18269000
. : milestone, 18269000,
iast_GLOBAL (17.954 s) : 17954000, 17954000
. : milestone, 17954000,
profiling (15.105 s) : 15105000, 15105000
. : milestone, 15105000,
tracing (14.867 s) : 14867000, 14867000
. : milestone, 14867000,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.488 s [15.488 s, 15.488 s]-
appsec15.232 s [15.232 s, 15.232 s]-256.0 ms (-1.7%)
iast18.437 s [18.437 s, 18.437 s]2.949 s (19.0%)
iast_GLOBAL17.757 s [17.757 s, 17.757 s]2.269 s (14.7%)
profiling15.033 s [15.033 s, 15.033 s]-455.0 ms (-2.9%)
tracing14.818 s [14.818 s, 14.818 s]-670.0 ms (-4.3%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent15.529 s [15.529 s, 15.529 s]-
appsec14.94 s [14.94 s, 14.94 s]-589.0 ms (-3.8%)
iast18.269 s [18.269 s, 18.269 s]2.74 s (17.6%)
iast_GLOBAL17.954 s [17.954 s, 17.954 s]2.425 s (15.6%)
profiling15.105 s [15.105 s, 15.105 s]-424.0 ms (-2.7%)
tracing14.867 s [14.867 s, 14.867 s]-662.0 ms (-4.3%)
Execution time for tomcat
gantt
title tomcat - execution time [CI 0.99] : candidate=1.52.0-SNAPSHOT~da962336df, baseline=1.51.1-SNAPSHOT~766af685ed
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1482
. : milestone, 1471,
appsec (3.676 ms) : 3458, 3894
. : milestone, 3676,
iast (2.191 ms) : 2129, 2254
. : milestone, 2191,
iast_GLOBAL (2.246 ms) : 2183, 2309
. : milestone, 2246,
profiling (2.038 ms) : 1987, 2089
. : milestone, 2038,
tracing (2.013 ms) : 1965, 2062
. : milestone, 2013,
section candidate
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.415 ms) : 2365, 2464
. : milestone, 2415,
iast (2.203 ms) : 2141, 2266
. : milestone, 2203,
iast_GLOBAL (2.238 ms) : 2175, 2300
. : milestone, 2238,
profiling (2.044 ms) : 1994, 2094
. : milestone, 2044,
tracing (2.02 ms) : 1971, 2069
. : milestone, 2020,
Loading
  • baseline results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.471 ms [1.459 ms, 1.482 ms]-
appsec3.676 ms [3.458 ms, 3.894 ms]2.205 ms (149.9%)
iast2.191 ms [2.129 ms, 2.254 ms]720.622 µs (49.0%)
iast_GLOBAL2.246 ms [2.183 ms, 2.309 ms]775.118 µs (52.7%)
profiling2.038 ms [1.987 ms, 2.089 ms]567.21 µs (38.6%)
tracing2.013 ms [1.965 ms, 2.062 ms]542.302 µs (36.9%)
  • candidate results
VariantExecution Time [CI 0.99]Δ no_agent
no_agent1.472 ms [1.461 ms, 1.484 ms]-
appsec2.415 ms [2.365 ms, 2.464 ms]942.241 µs (64.0%)
iast2.203 ms [2.141 ms, 2.266 ms]731.067 µs (49.7%)
iast_GLOBAL2.238 ms [2.175 ms, 2.3 ms]765.401 µs (52.0%)
profiling2.044 ms [1.994 ms, 2.094 ms]571.39 µs (38.8%)
tracing2.02 ms [1.971 ms, 2.069 ms]547.962 µs (37.2%)

@pr-commenter

Copy link
Copy Markdown

Kafka / consumer-benchmark

Parameters

BaselineCandidate
baseline_or_candidatebaselinecandidate
git_branchmasterkr-igor/dsm-improvements-custom-build
git_commit_date17520680331753193350
git_commit_sha1126e5eda96233
See matching parameters
BaselineCandidate
ci_job_date17531949161753194916
ci_job_id10411340821041134082
ci_pipeline_id7131568671315686
cpu_modelIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHzIntel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion11.0.2511.0.25
jmhVersion1.361.36
jvm/usr/lib/jvm/java-11-openjdk-amd64/bin/java/usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmNameOpenJDK 64-Bit Server VMOpenJDK 64-Bit Server VM
vmVersion11.0.25+9-post-Ubuntu-1ubuntu122.0411.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenarioΔ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsumesame
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsumesame
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsumesame

@ygreeygree left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved because all the commits have already been approved and merged in separate pull requests.

@kr-igorkr-igor closed this Aug 12, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

@kr-igor@ygree@manuel-alvarez-alvarez@daniel-mohedano