Nikita tkachenko/test env c8886fbcec351b29b985f0e1cda16311baa1fc19 by nikita-tkachenko-datadog · Pull Request #8493 · DataDog/dd-trace-java

nikita-tkachenko-datadog · 2025-03-04T11:57:06Z

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

Introduce the ability to start and stop Debugger features: - Dynamic Instrumentation - Exception Replay - Code Origin - Distributed Debugger dynamically based on RemoteConfig record: APM_TRACING DebuggerAgent is now run every time at startup to have the base of some feature ready and be able to start the minimum required foe each feature. Ability to stop also the feature at any time to uninstall probes. Add smoke tests

pr-commenter · 2025-03-04T12:37:33Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19
git_commit_date	1741082792	1740770051
git_commit_sha	`8f945b0`	`c8886fb`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~c8886fbcec

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741091806	1741091806
ci_job_id	831519274	831519274
ci_pipeline_id	57626523	57626523
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-8ksbllmc-project-304-concurrent-3-fo1vb0z8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-8ksbllmc-project-304-concurrent-3-fo1vb0z8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 64 metrics, 7 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.14 s) : 0, 1139532
Total [baseline] (9.257 s) : 0, 9256919
Agent [candidate] (1.134 s) : 0, 1133714
Total [candidate] (9.265 s) : 0, 9265137
section iast
Agent [baseline] (1.26 s) : 0, 1260359
Total [baseline] (9.845 s) : 0, 9844929
Agent [candidate] (1.255 s) : 0, 1255061
Total [candidate] (9.858 s) : 0, 9857769
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.256 s) : 0, 1255644
Total [baseline] (9.83 s) : 0, 9830461
Agent [candidate] (1.265 s) : 0, 1265424
Total [candidate] (9.835 s) : 0, 9834917
section iast_TELEMETRY_OFF
Agent [baseline] (1.255 s) : 0, 1254583
Total [baseline] (9.886 s) : 0, 9886132
Agent [candidate] (1.254 s) : 0, 1253618
Total [candidate] (9.856 s) : 0, 9855749

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.14 s	-
Agent	iast	1.26 s	120.827 ms (10.6%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.256 s	116.112 ms (10.2%)
Agent	iast_TELEMETRY_OFF	1.255 s	115.052 ms (10.1%)
Total	tracing	9.257 s	-
Total	iast	9.845 s	588.01 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.83 s	573.542 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.886 s	629.213 ms (6.8%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.134 s	-
Agent	iast	1.255 s	121.347 ms (10.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.265 s	131.709 ms (11.6%)
Agent	iast_TELEMETRY_OFF	1.254 s	119.904 ms (10.6%)
Total	tracing	9.265 s	-
Total	iast	9.858 s	592.632 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.835 s	569.779 ms (6.1%)
Total	iast_TELEMETRY_OFF	9.856 s	590.612 ms (6.4%)

gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (720.785 ms) : 0, 720785
BytebuddyAgent [candidate] (716.303 ms) : 0, 716303
GlobalTracer [baseline] (239.802 ms) : 0, 239802
GlobalTracer [candidate] (238.938 ms) : 0, 238938
AppSec [baseline] (55.714 ms) : 0, 55714
AppSec [candidate] (55.642 ms) : 0, 55642
Debugger [baseline] (95.296 ms) : 0, 95296
Debugger [candidate] (94.884 ms) : 0, 94884
Remote Config [baseline] (591.359 µs) : 0, 591
Remote Config [candidate] (581.998 µs) : 0, 582
Telemetry [baseline] (12.312 ms) : 0, 12312
Telemetry [candidate] (12.317 ms) : 0, 12317
section iast
BytebuddyAgent [baseline] (835.836 ms) : 0, 835836
BytebuddyAgent [candidate] (834.508 ms) : 0, 834508
GlobalTracer [baseline] (230.075 ms) : 0, 230075
GlobalTracer [candidate] (229.479 ms) : 0, 229479
IAST [baseline] (23.029 ms) : 0, 23029
IAST [candidate] (22.776 ms) : 0, 22776
AppSec [baseline] (56.621 ms) : 0, 56621
AppSec [candidate] (57.065 ms) : 0, 57065
Debugger [baseline] (83.624 ms) : 0, 83624
Debugger [candidate] (83.481 ms) : 0, 83481
Remote Config [baseline] (518.98 µs) : 0, 519
Remote Config [candidate] (517.994 µs) : 0, 518
Telemetry [baseline] (15.637 ms) : 0, 15637
Telemetry [candidate] (12.172 ms) : 0, 12172
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (834.096 ms) : 0, 834096
BytebuddyAgent [candidate] (842.08 ms) : 0, 842080
GlobalTracer [baseline] (229.779 ms) : 0, 229779
GlobalTracer [candidate] (231.131 ms) : 0, 231131
IAST [baseline] (22.681 ms) : 0, 22681
IAST [candidate] (23.014 ms) : 0, 23014
AppSec [baseline] (57.092 ms) : 0, 57092
AppSec [candidate] (57.327 ms) : 0, 57327
Debugger [baseline] (83.575 ms) : 0, 83575
Debugger [candidate] (83.792 ms) : 0, 83792
Remote Config [baseline] (514.664 µs) : 0, 515
Remote Config [candidate] (530.117 µs) : 0, 530
Telemetry [baseline] (12.813 ms) : 0, 12813
Telemetry [candidate] (12.399 ms) : 0, 12399
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.975 ms) : 0, 832975
BytebuddyAgent [candidate] (832.737 ms) : 0, 832737
GlobalTracer [baseline] (230.743 ms) : 0, 230743
GlobalTracer [candidate] (229.736 ms) : 0, 229736
IAST [baseline] (22.397 ms) : 0, 22397
IAST [candidate] (22.286 ms) : 0, 22286
AppSec [baseline] (57.325 ms) : 0, 57325
AppSec [candidate] (57.482 ms) : 0, 57482
Debugger [baseline] (83.547 ms) : 0, 83547
Debugger [candidate] (83.772 ms) : 0, 83772
Remote Config [baseline] (528.126 µs) : 0, 528
Remote Config [candidate] (549.226 µs) : 0, 549
Telemetry [baseline] (12.033 ms) : 0, 12033
Telemetry [candidate] (12.033 ms) : 0, 12033

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.139 s) : 0, 1139353
Total [baseline] (11.486 s) : 0, 11485932
Agent [candidate] (1.141 s) : 0, 1140818
Total [candidate] (11.496 s) : 0, 11496462
section appsec
Agent [baseline] (1.271 s) : 0, 1271413
Total [baseline] (11.654 s) : 0, 11654483
Agent [candidate] (1.276 s) : 0, 1276137
Total [candidate] (11.728 s) : 0, 11728340
section iast
Agent [baseline] (1.258 s) : 0, 1257784
Total [baseline] (11.91 s) : 0, 11910446
Agent [candidate] (1.272 s) : 0, 1271852
Total [candidate] (11.96 s) : 0, 11960290
section profiling
Agent [baseline] (1.377 s) : 0, 1377247
Total [baseline] (11.793 s) : 0, 11793415
Agent [candidate] (1.389 s) : 0, 1388790
Total [candidate] (11.889 s) : 0, 11889398

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.139 s	-
Agent	appsec	1.271 s	132.06 ms (11.6%)
Agent	iast	1.258 s	118.431 ms (10.4%)
Agent	profiling	1.377 s	237.894 ms (20.9%)
Total	tracing	11.486 s	-
Total	appsec	11.654 s	168.552 ms (1.5%)
Total	iast	11.91 s	424.514 ms (3.7%)
Total	profiling	11.793 s	307.483 ms (2.7%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.141 s	-
Agent	appsec	1.276 s	135.319 ms (11.9%)
Agent	iast	1.272 s	131.034 ms (11.5%)
Agent	profiling	1.389 s	247.972 ms (21.7%)
Total	tracing	11.496 s	-
Total	appsec	11.728 s	231.877 ms (2.0%)
Total	iast	11.96 s	463.828 ms (4.0%)
Total	profiling	11.889 s	392.936 ms (3.4%)

gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.072 ms) : 0, 719072
BytebuddyAgent [candidate] (720.829 ms) : 0, 720829
GlobalTracer [baseline] (240.439 ms) : 0, 240439
GlobalTracer [candidate] (240.481 ms) : 0, 240481
AppSec [baseline] (55.875 ms) : 0, 55875
AppSec [candidate] (55.687 ms) : 0, 55687
Debugger [baseline] (95.773 ms) : 0, 95773
Debugger [candidate] (95.573 ms) : 0, 95573
Remote Config [baseline] (579.95 µs) : 0, 580
Remote Config [candidate] (593.356 µs) : 0, 593
Telemetry [baseline] (12.512 ms) : 0, 12512
Telemetry [candidate] (12.52 ms) : 0, 12520
section appsec
BytebuddyAgent [baseline] (734.107 ms) : 0, 734107
BytebuddyAgent [candidate] (737.462 ms) : 0, 737462
GlobalTracer [baseline] (236.54 ms) : 0, 236540
GlobalTracer [candidate] (236.636 ms) : 0, 236636
IAST [baseline] (21.446 ms) : 0, 21446
IAST [candidate] (21.957 ms) : 0, 21957
AppSec [baseline] (176.499 ms) : 0, 176499
AppSec [candidate] (178.288 ms) : 0, 178288
Debugger [baseline] (85.565 ms) : 0, 85565
Debugger [candidate] (84.574 ms) : 0, 84574
Remote Config [baseline] (629.007 µs) : 0, 629
Remote Config [candidate] (638.092 µs) : 0, 638
Telemetry [baseline] (12.327 ms) : 0, 12327
Telemetry [candidate] (12.432 ms) : 0, 12432
section iast
BytebuddyAgent [baseline] (835.325 ms) : 0, 835325
BytebuddyAgent [candidate] (846.561 ms) : 0, 846561
GlobalTracer [baseline] (230.66 ms) : 0, 230660
GlobalTracer [candidate] (232.201 ms) : 0, 232201
IAST [baseline] (22.576 ms) : 0, 22576
IAST [candidate] (23.881 ms) : 0, 23881
AppSec [baseline] (57.13 ms) : 0, 57130
AppSec [candidate] (56.815 ms) : 0, 56815
Debugger [baseline] (83.502 ms) : 0, 83502
Debugger [candidate] (84.19 ms) : 0, 84190
Remote Config [baseline] (522.13 µs) : 0, 522
Remote Config [candidate] (527.684 µs) : 0, 528
Telemetry [baseline] (12.956 ms) : 0, 12956
Telemetry [candidate] (12.39 ms) : 0, 12390
section profiling
BytebuddyAgent [baseline] (707.777 ms) : 0, 707777
BytebuddyAgent [candidate] (715.189 ms) : 0, 715189
GlobalTracer [baseline] (349.271 ms) : 0, 349271
GlobalTracer [candidate] (353.237 ms) : 0, 353237
AppSec [baseline] (55.092 ms) : 0, 55092
AppSec [candidate] (54.944 ms) : 0, 54944
Debugger [baseline] (88.605 ms) : 0, 88605
Debugger [candidate] (88.883 ms) : 0, 88883
Remote Config [baseline] (617.71 µs) : 0, 618
Remote Config [candidate] (626.462 µs) : 0, 626
Telemetry [baseline] (12.447 ms) : 0, 12447
Telemetry [candidate] (12.736 ms) : 0, 12736
ProfilingAgent [baseline] (123.012 ms) : 0, 123012
ProfilingAgent [candidate] (122.379 ms) : 0, 122379
Profiling [baseline] (123.033 ms) : 0, 123033
Profiling [candidate] (122.399 ms) : 0, 122399

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-03-04T12:04:17	2025-03-04T12:12:09
git_branch	master	nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19
git_commit_date	1741082792	1740770051
git_commit_sha	`8f945b0`	`c8886fb`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~c8886fbcec
start_time	2025-03-04T12:04:03	2025-03-04T12:11:55

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1741090734	1741090734
ci_job_id	831519275	831519275
ci_pipeline_id	57626523	57626523
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner--t2f38de-project-304-concurrent-6-3aupeynl 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner--t2f38de-project-304-concurrent-6-3aupeynl 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (375.692 µs) : 356, 395
. : milestone, 376,
iast (512.046 µs) : 490, 534
. : milestone, 512,
iast_FULL (724.807 µs) : 703, 747
. : milestone, 725,
iast_GLOBAL (551.747 µs) : 530, 574
. : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (508.876 µs) : 487, 530
. : milestone, 509,
iast_INACTIVE (459.054 µs) : 437, 481
. : milestone, 459,
iast_TELEMETRY_OFF (492.298 µs) : 471, 514
. : milestone, 492,
tracing (449.409 µs) : 427, 472
. : milestone, 449,
section candidate
no_agent (378.322 µs) : 358, 399
. : milestone, 378,
iast (512.72 µs) : 490, 535
. : milestone, 513,
iast_FULL (719.804 µs) : 698, 742
. : milestone, 720,
iast_GLOBAL (545.937 µs) : 523, 569
. : milestone, 546,
iast_HARDCODED_SECRET_DISABLED (504.999 µs) : 483, 527
. : milestone, 505,
iast_INACTIVE (463.238 µs) : 442, 485
. : milestone, 463,
iast_TELEMETRY_OFF (495.311 µs) : 473, 517
. : milestone, 495,
tracing (454.856 µs) : 433, 477
. : milestone, 455,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	375.692 µs [356.004 µs, 395.38 µs]	-
iast	512.046 µs [490.106 µs, 533.985 µs]	136.354 µs (36.3%)
iast_FULL	724.807 µs [702.713 µs, 746.901 µs]	349.115 µs (92.9%)
iast_GLOBAL	551.747 µs [529.944 µs, 573.549 µs]	176.055 µs (46.9%)
iast_HARDCODED_SECRET_DISABLED	508.876 µs [487.361 µs, 530.391 µs]	133.184 µs (35.5%)
iast_INACTIVE	459.054 µs [437.008 µs, 481.101 µs]	83.362 µs (22.2%)
iast_TELEMETRY_OFF	492.298 µs [470.627 µs, 513.97 µs]	116.606 µs (31.0%)
tracing	449.409 µs [427.039 µs, 471.779 µs]	73.717 µs (19.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	378.322 µs [357.77 µs, 398.874 µs]	-
iast	512.72 µs [490.324 µs, 535.116 µs]	134.398 µs (35.5%)
iast_FULL	719.804 µs [697.704 µs, 741.904 µs]	341.482 µs (90.3%)
iast_GLOBAL	545.937 µs [523.121 µs, 568.754 µs]	167.615 µs (44.3%)
iast_HARDCODED_SECRET_DISABLED	504.999 µs [483.385 µs, 526.613 µs]	126.677 µs (33.5%)
iast_INACTIVE	463.238 µs [441.919 µs, 484.556 µs]	84.916 µs (22.4%)
iast_TELEMETRY_OFF	495.311 µs [473.24 µs, 517.382 µs]	116.989 µs (30.9%)
tracing	454.856 µs [432.718 µs, 476.993 µs]	76.534 µs (20.2%)

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (1.354 ms) : 1335, 1374
. : milestone, 1354,
appsec (1.735 ms) : 1712, 1759
. : milestone, 1735,
appsec_no_iast (1.717 ms) : 1693, 1741
. : milestone, 1717,
code_origins (1.688 ms) : 1655, 1720
. : milestone, 1688,
iast (1.492 ms) : 1467, 1517
. : milestone, 1492,
profiling (1.566 ms) : 1539, 1592
. : milestone, 1566,
tracing (1.485 ms) : 1462, 1509
. : milestone, 1485,
section candidate
no_agent (1.331 ms) : 1311, 1351
. : milestone, 1331,
appsec (1.719 ms) : 1695, 1743
. : milestone, 1719,
appsec_no_iast (1.717 ms) : 1693, 1742
. : milestone, 1717,
code_origins (1.691 ms) : 1659, 1724
. : milestone, 1691,
iast (1.505 ms) : 1480, 1531
. : milestone, 1505,
profiling (1.551 ms) : 1525, 1576
. : milestone, 1551,
tracing (1.482 ms) : 1457, 1506
. : milestone, 1482,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.354 ms [1.335 ms, 1.374 ms]	-
appsec	1.735 ms [1.712 ms, 1.759 ms]	381.14 µs (28.1%)
appsec_no_iast	1.717 ms [1.693 ms, 1.741 ms]	362.397 µs (26.8%)
code_origins	1.688 ms [1.655 ms, 1.72 ms]	333.147 µs (24.6%)
iast	1.492 ms [1.467 ms, 1.517 ms]	137.818 µs (10.2%)
profiling	1.566 ms [1.539 ms, 1.592 ms]	211.481 µs (15.6%)
tracing	1.485 ms [1.462 ms, 1.509 ms]	130.825 µs (9.7%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.331 ms [1.311 ms, 1.351 ms]	-
appsec	1.719 ms [1.695 ms, 1.743 ms]	388.603 µs (29.2%)
appsec_no_iast	1.717 ms [1.693 ms, 1.742 ms]	386.486 µs (29.0%)
code_origins	1.691 ms [1.659 ms, 1.724 ms]	360.678 µs (27.1%)
iast	1.505 ms [1.48 ms, 1.531 ms]	174.411 µs (13.1%)
profiling	1.551 ms [1.525 ms, 1.576 ms]	220.038 µs (16.5%)
tracing	1.482 ms [1.457 ms, 1.506 ms]	150.932 µs (11.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19
git_commit_date	1741082792	1740770051
git_commit_sha	`8f945b0`	`c8886fb`
release_version	1.47.0-SNAPSHOT~8f945b02a7	1.47.0-SNAPSHOT~c8886fbcec

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1741091287	1741091287
ci_job_id	831519276	831519276
ci_pipeline_id	57626523	57626523
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-8ksbllmc-project-304-concurrent-4-8rg2p9ci 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-8ksbllmc-project-304-concurrent-4-8rg2p9ci 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (1.468 ms) : 1456, 1479
. : milestone, 1468,
appsec (2.355 ms) : 2311, 2399
. : milestone, 2355,
iast (2.127 ms) : 2071, 2183
. : milestone, 2127,
iast_GLOBAL (2.169 ms) : 2113, 2225
. : milestone, 2169,
profiling (1.981 ms) : 1937, 2026
. : milestone, 1981,
tracing (1.954 ms) : 1912, 1997
. : milestone, 1954,
section candidate
no_agent (1.474 ms) : 1462, 1486
. : milestone, 1474,
appsec (2.349 ms) : 2305, 2393
. : milestone, 2349,
iast (2.13 ms) : 2074, 2186
. : milestone, 2130,
iast_GLOBAL (2.163 ms) : 2107, 2219
. : milestone, 2163,
profiling (1.972 ms) : 1928, 2016
. : milestone, 1972,
tracing (1.946 ms) : 1903, 1989
. : milestone, 1946,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.468 ms [1.456 ms, 1.479 ms]	-
appsec	2.355 ms [2.311 ms, 2.399 ms]	887.111 µs (60.4%)
iast	2.127 ms [2.071 ms, 2.183 ms]	659.514 µs (44.9%)
iast_GLOBAL	2.169 ms [2.113 ms, 2.225 ms]	701.723 µs (47.8%)
profiling	1.981 ms [1.937 ms, 2.026 ms]	513.838 µs (35.0%)
tracing	1.954 ms [1.912 ms, 1.997 ms]	486.425 µs (33.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.486 ms]	-
appsec	2.349 ms [2.305 ms, 2.393 ms]	874.803 µs (59.4%)
iast	2.13 ms [2.074 ms, 2.186 ms]	655.831 µs (44.5%)
iast_GLOBAL	2.163 ms [2.107 ms, 2.219 ms]	689.302 µs (46.8%)
profiling	1.972 ms [1.928 ms, 2.016 ms]	497.834 µs (33.8%)
tracing	1.946 ms [1.903 ms, 1.989 ms]	471.971 µs (32.0%)

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~c8886fbcec, baseline=1.47.0-SNAPSHOT~8f945b02a7
dateFormat X
axisFormat %s
section baseline
no_agent (15.078 s) : 15078000, 15078000
. : milestone, 15078000,
appsec (15.027 s) : 15027000, 15027000
. : milestone, 15027000,
iast (18.733 s) : 18733000, 18733000
. : milestone, 18733000,
iast_GLOBAL (18.191 s) : 18191000, 18191000
. : milestone, 18191000,
profiling (15.032 s) : 15032000, 15032000
. : milestone, 15032000,
tracing (14.957 s) : 14957000, 14957000
. : milestone, 14957000,
section candidate
no_agent (15.405 s) : 15405000, 15405000
. : milestone, 15405000,
appsec (14.998 s) : 14998000, 14998000
. : milestone, 14998000,
iast (18.905 s) : 18905000, 18905000
. : milestone, 18905000,
iast_GLOBAL (18.128 s) : 18128000, 18128000
. : milestone, 18128000,
profiling (14.84 s) : 14840000, 14840000
. : milestone, 14840000,
tracing (14.973 s) : 14973000, 14973000
. : milestone, 14973000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.078 s [15.078 s, 15.078 s]	-
appsec	15.027 s [15.027 s, 15.027 s]	-51.0 ms (-0.3%)
iast	18.733 s [18.733 s, 18.733 s]	3.655 s (24.2%)
iast_GLOBAL	18.191 s [18.191 s, 18.191 s]	3.113 s (20.6%)
profiling	15.032 s [15.032 s, 15.032 s]	-46.0 ms (-0.3%)
tracing	14.957 s [14.957 s, 14.957 s]	-121.0 ms (-0.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.405 s [15.405 s, 15.405 s]	-
appsec	14.998 s [14.998 s, 14.998 s]	-407.0 ms (-2.6%)
iast	18.905 s [18.905 s, 18.905 s]	3.5 s (22.7%)
iast_GLOBAL	18.128 s [18.128 s, 18.128 s]	2.723 s (17.7%)
profiling	14.84 s [14.84 s, 14.84 s]	-565.0 ms (-3.7%)
tracing	14.973 s [14.973 s, 14.973 s]	-432.0 ms (-2.8%)

jpbempeland others added 2 commits February 28, 2025 18:55

use proper class def to find interfaces (#8476)
c8886fb

nikita-tkachenko-datadog added the tag: do not merge Do not merge changes label Mar 4, 2025

nikita-tkachenko-datadog closed this Mar 4, 2025

nikita-tkachenko-datadog deleted the nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19 branch March 4, 2025 14:10

Navigation Menu

Uh oh!

Nikita tkachenko/test env c8886fbcec351b29b985f0e1cda16311baa1fc19 - #8493

Nikita tkachenko/test env c8886fbcec351b29b985f0e1cda16311baa1fc19#8493
nikita-tkachenko-datadog wants to merge 2 commits into
nikita-tkachenko/test-env-be03ce5b82b7cc8ca9cf2fe3f8af015d39690559from
nikita-tkachenko/test-env-c8886fbcec351b29b985f0e1cda16311baa1fc19

nikita-tkachenko-datadog commented Mar 4, 2025

Uh oh!

pr-commenterBot commented Mar 4, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

nikita-tkachenko-datadog commented Mar 4, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Mar 4, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants