Disable backend requests for impacted tests data by nikita-tkachenko-datadog · Pull Request #8391 · DataDog/dd-trace-java

nikita-tkachenko-datadog · 2025-02-14T11:45:10Z

What Does This Do

Disables requests to ci/tests/diffs backend endpoint, unless they are explicitly enabled with a config property.

Motivation

The endpoint is not implemented in the backend yet.

Additional Notes

This is a part of the Impacted Tests Detection feature (#8188) that is currently disabled for everyone by org 2.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: SDTEST-1389

pr-commenter · 2025-02-14T12:24:25Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/disable-impacted-tests-backend
git_commit_date	1739520992	1739533303
git_commit_sha	`053a36f`	`7a0b153`
release_version	1.47.0-SNAPSHOT~053a36f28a	1.47.0-SNAPSHOT~7a0b1534d4

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1739535819	1739535819
ci_job_id	808635761	808635761
ci_pipeline_id	55920775	55920775
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-yrr1pra-project-304-concurrent-0-2j6sigyt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-yrr1pra-project-304-concurrent-0-2j6sigyt 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.049 s) : 0, 1048979
Total [baseline] (8.707 s) : 0, 8706509
Agent [candidate] (1.05 s) : 0, 1049565
Total [candidate] (8.658 s) : 0, 8658244
section iast
Agent [baseline] (1.172 s) : 0, 1171962
Total [baseline] (9.267 s) : 0, 9266984
Agent [candidate] (1.17 s) : 0, 1170046
Total [candidate] (9.302 s) : 0, 9302413
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.178 s) : 0, 1178119
Total [baseline] (9.233 s) : 0, 9232632
Agent [candidate] (1.171 s) : 0, 1171491
Total [candidate] (9.257 s) : 0, 9256876
section iast_TELEMETRY_OFF
Agent [baseline] (1.166 s) : 0, 1165872
Total [baseline] (9.282 s) : 0, 9281923
Agent [candidate] (1.179 s) : 0, 1179342
Total [candidate] (9.263 s) : 0, 9263141

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.049 s	-
Agent	iast	1.172 s	122.983 ms (11.7%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.178 s	129.14 ms (12.3%)
Agent	iast_TELEMETRY_OFF	1.166 s	116.893 ms (11.1%)
Total	tracing	8.707 s	-
Total	iast	9.267 s	560.475 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.233 s	526.123 ms (6.0%)
Total	iast_TELEMETRY_OFF	9.282 s	575.414 ms (6.6%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.05 s	-
Agent	iast	1.17 s	120.481 ms (11.5%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.171 s	121.925 ms (11.6%)
Agent	iast_TELEMETRY_OFF	1.179 s	129.776 ms (12.4%)
Total	tracing	8.658 s	-
Total	iast	9.302 s	644.168 ms (7.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.257 s	598.632 ms (6.9%)
Total	iast_TELEMETRY_OFF	9.263 s	604.897 ms (7.0%)

gantt
title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (723.428 ms) : 0, 723428
BytebuddyAgent [candidate] (722.062 ms) : 0, 722062
GlobalTracer [baseline] (240.828 ms) : 0, 240828
GlobalTracer [candidate] (241.925 ms) : 0, 241925
AppSec [baseline] (55.77 ms) : 0, 55770
AppSec [candidate] (55.868 ms) : 0, 55868
Remote Config [baseline] (700.124 µs) : 0, 700
Remote Config [candidate] (709.896 µs) : 0, 710
Telemetry [baseline] (12.835 ms) : 0, 12835
Telemetry [candidate] (13.696 ms) : 0, 13696
section iast
BytebuddyAgent [baseline] (836.688 ms) : 0, 836688
BytebuddyAgent [candidate] (834.498 ms) : 0, 834498
GlobalTracer [baseline] (230.802 ms) : 0, 230802
GlobalTracer [candidate] (230.368 ms) : 0, 230368
IAST [baseline] (22.788 ms) : 0, 22788
IAST [candidate] (22.886 ms) : 0, 22886
AppSec [baseline] (57.147 ms) : 0, 57147
AppSec [candidate] (57.669 ms) : 0, 57669
Remote Config [baseline] (612.762 µs) : 0, 613
Remote Config [candidate] (616.169 µs) : 0, 616
Telemetry [baseline] (8.639 ms) : 0, 8639
Telemetry [candidate] (8.752 ms) : 0, 8752
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (841.586 ms) : 0, 841586
BytebuddyAgent [candidate] (835.602 ms) : 0, 835602
GlobalTracer [baseline] (231.261 ms) : 0, 231261
GlobalTracer [candidate] (230.895 ms) : 0, 230895
IAST [baseline] (22.954 ms) : 0, 22954
IAST [candidate] (22.932 ms) : 0, 22932
AppSec [baseline] (57.644 ms) : 0, 57644
AppSec [candidate] (57.421 ms) : 0, 57421
Remote Config [baseline] (633.086 µs) : 0, 633
Remote Config [candidate] (626.907 µs) : 0, 627
Telemetry [baseline] (8.727 ms) : 0, 8727
Telemetry [candidate] (8.753 ms) : 0, 8753
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (831.948 ms) : 0, 831948
BytebuddyAgent [candidate] (843.646 ms) : 0, 843646
GlobalTracer [baseline] (230.703 ms) : 0, 230703
GlobalTracer [candidate] (231.629 ms) : 0, 231629
IAST [baseline] (25.895 ms) : 0, 25895
IAST [candidate] (23.84 ms) : 0, 23840
AppSec [baseline] (52.923 ms) : 0, 52923
AppSec [candidate] (55.617 ms) : 0, 55617
Remote Config [baseline] (611.755 µs) : 0, 612
Remote Config [candidate] (612.727 µs) : 0, 613
Telemetry [baseline] (8.52 ms) : 0, 8520
Telemetry [candidate] (8.591 ms) : 0, 8591

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.046 s) : 0, 1045503
Total [baseline] (10.624 s) : 0, 10623565
Agent [candidate] (1.049 s) : 0, 1048516
Total [candidate] (10.527 s) : 0, 10527089
section appsec
Agent [baseline] (1.181 s) : 0, 1181406
Total [baseline] (10.728 s) : 0, 10728174
Agent [candidate] (1.188 s) : 0, 1187875
Total [candidate] (10.831 s) : 0, 10831482
section iast
Agent [baseline] (1.171 s) : 0, 1171141
Total [baseline] (10.975 s) : 0, 10974558
Agent [candidate] (1.181 s) : 0, 1180944
Total [candidate] (10.979 s) : 0, 10978884
section profiling
Agent [baseline] (1.262 s) : 0, 1261921
Total [baseline] (10.984 s) : 0, 10983642
Agent [candidate] (1.262 s) : 0, 1262243
Total [candidate] (10.903 s) : 0, 10903386

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.046 s	-
Agent	appsec	1.181 s	135.903 ms (13.0%)
Agent	iast	1.171 s	125.637 ms (12.0%)
Agent	profiling	1.262 s	216.418 ms (20.7%)
Total	tracing	10.624 s	-
Total	appsec	10.728 s	104.609 ms (1.0%)
Total	iast	10.975 s	350.993 ms (3.3%)
Total	profiling	10.984 s	360.077 ms (3.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.049 s	-
Agent	appsec	1.188 s	139.359 ms (13.3%)
Agent	iast	1.181 s	132.428 ms (12.6%)
Agent	profiling	1.262 s	213.728 ms (20.4%)
Total	tracing	10.527 s	-
Total	appsec	10.831 s	304.394 ms (2.9%)
Total	iast	10.979 s	451.795 ms (4.3%)
Total	profiling	10.903 s	376.297 ms (3.6%)

gantt
title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (719.361 ms) : 0, 719361
BytebuddyAgent [candidate] (722.797 ms) : 0, 722797
GlobalTracer [baseline] (241.492 ms) : 0, 241492
GlobalTracer [candidate] (241.513 ms) : 0, 241513
AppSec [baseline] (55.752 ms) : 0, 55752
AppSec [candidate] (55.749 ms) : 0, 55749
Remote Config [baseline] (701.184 µs) : 0, 701
Remote Config [candidate] (700.978 µs) : 0, 701
Telemetry [baseline] (12.908 ms) : 0, 12908
Telemetry [candidate] (12.303 ms) : 0, 12303
section appsec
BytebuddyAgent [baseline] (733.778 ms) : 0, 733778
BytebuddyAgent [candidate] (737.599 ms) : 0, 737599
GlobalTracer [baseline] (236.541 ms) : 0, 236541
GlobalTracer [candidate] (237.506 ms) : 0, 237506
IAST [baseline] (21.253 ms) : 0, 21253
IAST [candidate] (21.426 ms) : 0, 21426
AppSec [baseline] (176.261 ms) : 0, 176261
AppSec [candidate] (177.776 ms) : 0, 177776
Remote Config [baseline] (663.016 µs) : 0, 663
Remote Config [candidate] (669.623 µs) : 0, 670
Telemetry [baseline] (8.287 ms) : 0, 8287
Telemetry [candidate] (8.321 ms) : 0, 8321
section iast
BytebuddyAgent [baseline] (835.661 ms) : 0, 835661
BytebuddyAgent [candidate] (843.932 ms) : 0, 843932
GlobalTracer [baseline] (230.823 ms) : 0, 230823
GlobalTracer [candidate] (232.01 ms) : 0, 232010
IAST [baseline] (22.946 ms) : 0, 22946
IAST [candidate] (22.958 ms) : 0, 22958
AppSec [baseline] (57.129 ms) : 0, 57129
AppSec [candidate] (57.285 ms) : 0, 57285
Remote Config [baseline] (623.197 µs) : 0, 623
Remote Config [candidate] (615.148 µs) : 0, 615
Telemetry [baseline] (8.702 ms) : 0, 8702
Telemetry [candidate] (8.717 ms) : 0, 8717
section profiling
BytebuddyAgent [baseline] (707.061 ms) : 0, 707061
BytebuddyAgent [candidate] (708.277 ms) : 0, 708277
GlobalTracer [baseline] (350.697 ms) : 0, 350697
GlobalTracer [candidate] (351.155 ms) : 0, 351155
AppSec [baseline] (55.386 ms) : 0, 55386
AppSec [candidate] (54.771 ms) : 0, 54771
Remote Config [baseline] (677.567 µs) : 0, 678
Remote Config [candidate] (668.578 µs) : 0, 669
Telemetry [baseline] (9.02 ms) : 0, 9020
Telemetry [candidate] (8.949 ms) : 0, 8949
ProfilingAgent [baseline] (96.908 ms) : 0, 96908
ProfilingAgent [candidate] (96.065 ms) : 0, 96065
Profiling [baseline] (96.932 ms) : 0, 96932
Profiling [candidate] (96.089 ms) : 0, 96089

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-02-14T11:51:24	2025-02-14T11:58:30
git_branch	master	nikita-tkachenko/disable-impacted-tests-backend
git_commit_date	1739520992	1739533303
git_commit_sha	`053a36f`	`7a0b153`
release_version	1.47.0-SNAPSHOT~053a36f28a	1.47.0-SNAPSHOT~7a0b1534d4
start_time	2025-02-14T11:51:10	2025-02-14T11:58:16

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1739534670	1739534670
ci_job_id	808635762	808635762
ci_pipeline_id	55920775	55920775
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-inwry3gs-project-304-concurrent-0-fmygz3fh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-inwry3gs-project-304-concurrent-0-fmygz3fh 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section baseline
no_agent (1.37 ms) : 1351, 1388
. : milestone, 1370,
appsec (1.749 ms) : 1725, 1773
. : milestone, 1749,
appsec_no_iast (1.756 ms) : 1733, 1780
. : milestone, 1756,
iast (1.514 ms) : 1490, 1538
. : milestone, 1514,
profiling (1.503 ms) : 1479, 1527
. : milestone, 1503,
tracing (1.505 ms) : 1480, 1529
. : milestone, 1505,
section candidate
no_agent (1.37 ms) : 1350, 1389
. : milestone, 1370,
appsec (1.766 ms) : 1742, 1789
. : milestone, 1766,
appsec_no_iast (1.76 ms) : 1736, 1783
. : milestone, 1760,
iast (1.499 ms) : 1475, 1523
. : milestone, 1499,
profiling (1.529 ms) : 1503, 1554
. : milestone, 1529,
tracing (1.511 ms) : 1486, 1536
. : milestone, 1511,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.37 ms [1.351 ms, 1.388 ms]	-
appsec	1.749 ms [1.725 ms, 1.773 ms]	379.705 µs (27.7%)
appsec_no_iast	1.756 ms [1.733 ms, 1.78 ms]	386.825 µs (28.2%)
iast	1.514 ms [1.49 ms, 1.538 ms]	144.021 µs (10.5%)
profiling	1.503 ms [1.479 ms, 1.527 ms]	133.279 µs (9.7%)
tracing	1.505 ms [1.48 ms, 1.529 ms]	134.994 µs (9.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.37 ms [1.35 ms, 1.389 ms]	-
appsec	1.766 ms [1.742 ms, 1.789 ms]	396.239 µs (28.9%)
appsec_no_iast	1.76 ms [1.736 ms, 1.783 ms]	390.001 µs (28.5%)
iast	1.499 ms [1.475 ms, 1.523 ms]	129.248 µs (9.4%)
profiling	1.529 ms [1.503 ms, 1.554 ms]	159.221 µs (11.6%)
tracing	1.511 ms [1.486 ms, 1.536 ms]	141.698 µs (10.3%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section baseline
no_agent (377.075 µs) : 357, 397
. : milestone, 377,
iast (512.595 µs) : 491, 534
. : milestone, 513,
iast_FULL (748.529 µs) : 727, 770
. : milestone, 749,
iast_GLOBAL (562.671 µs) : 541, 584
. : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (520.553 µs) : 498, 543
. : milestone, 521,
iast_INACTIVE (474.065 µs) : 452, 496
. : milestone, 474,
iast_TELEMETRY_OFF (500.906 µs) : 478, 524
. : milestone, 501,
tracing (452.983 µs) : 432, 474
. : milestone, 453,
section candidate
no_agent (379.674 µs) : 360, 400
. : milestone, 380,
iast (512.253 µs) : 490, 535
. : milestone, 512,
iast_FULL (754.63 µs) : 732, 777
. : milestone, 755,
iast_GLOBAL (556.804 µs) : 535, 578
. : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (516.465 µs) : 493, 540
. : milestone, 516,
iast_INACTIVE (468.458 µs) : 447, 490
. : milestone, 468,
iast_TELEMETRY_OFF (502.129 µs) : 479, 525
. : milestone, 502,
tracing (457.847 µs) : 437, 479
. : milestone, 458,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	377.075 µs [357.065 µs, 397.085 µs]	-
iast	512.595 µs [490.701 µs, 534.489 µs]	135.52 µs (35.9%)
iast_FULL	748.529 µs [726.662 µs, 770.395 µs]	371.454 µs (98.5%)
iast_GLOBAL	562.671 µs [541.188 µs, 584.155 µs]	185.596 µs (49.2%)
iast_HARDCODED_SECRET_DISABLED	520.553 µs [498.097 µs, 543.009 µs]	143.478 µs (38.1%)
iast_INACTIVE	474.065 µs [451.925 µs, 496.204 µs]	96.99 µs (25.7%)
iast_TELEMETRY_OFF	500.906 µs [477.625 µs, 524.188 µs]	123.831 µs (32.8%)
tracing	452.983 µs [432.385 µs, 473.58 µs]	75.907 µs (20.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.674 µs [359.586 µs, 399.761 µs]	-
iast	512.253 µs [489.665 µs, 534.84 µs]	132.579 µs (34.9%)
iast_FULL	754.63 µs [732.181 µs, 777.08 µs]	374.956 µs (98.8%)
iast_GLOBAL	556.804 µs [535.187 µs, 578.421 µs]	177.13 µs (46.7%)
iast_HARDCODED_SECRET_DISABLED	516.465 µs [493.306 µs, 539.623 µs]	136.791 µs (36.0%)
iast_INACTIVE	468.458 µs [446.571 µs, 490.346 µs]	88.785 µs (23.4%)
iast_TELEMETRY_OFF	502.129 µs [478.764 µs, 525.495 µs]	122.456 µs (32.3%)
tracing	457.847 µs [437.008 µs, 478.687 µs]	78.174 µs (20.6%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/disable-impacted-tests-backend
git_commit_date	1739520992	1739533303
git_commit_sha	`053a36f`	`7a0b153`
release_version	1.47.0-SNAPSHOT~053a36f28a	1.47.0-SNAPSHOT~7a0b1534d4

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1739535353	1739535353
ci_job_id	808635763	808635763
ci_pipeline_id	55920775	55920775
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-sf9mtlkb-project-304-concurrent-0-6m8vm7iy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-sf9mtlkb-project-304-concurrent-0-6m8vm7iy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section baseline
no_agent (14.849 s) : 14849000, 14849000
. : milestone, 14849000,
appsec (15.224 s) : 15224000, 15224000
. : milestone, 15224000,
iast (18.595 s) : 18595000, 18595000
. : milestone, 18595000,
iast_GLOBAL (17.909 s) : 17909000, 17909000
. : milestone, 17909000,
profiling (15.584 s) : 15584000, 15584000
. : milestone, 15584000,
tracing (15.054 s) : 15054000, 15054000
. : milestone, 15054000,
section candidate
no_agent (14.69 s) : 14690000, 14690000
. : milestone, 14690000,
appsec (15.227 s) : 15227000, 15227000
. : milestone, 15227000,
iast (18.703 s) : 18703000, 18703000
. : milestone, 18703000,
iast_GLOBAL (17.78 s) : 17780000, 17780000
. : milestone, 17780000,
profiling (15.068 s) : 15068000, 15068000
. : milestone, 15068000,
tracing (14.693 s) : 14693000, 14693000
. : milestone, 14693000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.849 s [14.849 s, 14.849 s]	-
appsec	15.224 s [15.224 s, 15.224 s]	375.0 ms (2.5%)
iast	18.595 s [18.595 s, 18.595 s]	3.746 s (25.2%)
iast_GLOBAL	17.909 s [17.909 s, 17.909 s]	3.06 s (20.6%)
profiling	15.584 s [15.584 s, 15.584 s]	735.0 ms (4.9%)
tracing	15.054 s [15.054 s, 15.054 s]	205.0 ms (1.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.69 s [14.69 s, 14.69 s]	-
appsec	15.227 s [15.227 s, 15.227 s]	537.0 ms (3.7%)
iast	18.703 s [18.703 s, 18.703 s]	4.013 s (27.3%)
iast_GLOBAL	17.78 s [17.78 s, 17.78 s]	3.09 s (21.0%)
profiling	15.068 s [15.068 s, 15.068 s]	378.0 ms (2.6%)
tracing	14.693 s [14.693 s, 14.693 s]	3.0 ms (0.0%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~7a0b1534d4, baseline=1.47.0-SNAPSHOT~053a36f28a
dateFormat X
axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
. : milestone, 1472,
appsec (2.369 ms) : 2325, 2412
. : milestone, 2369,
iast (2.116 ms) : 2061, 2172
. : milestone, 2116,
iast_GLOBAL (2.158 ms) : 2102, 2213
. : milestone, 2158,
profiling (1.955 ms) : 1912, 1999
. : milestone, 1955,
tracing (1.955 ms) : 1913, 1997
. : milestone, 1955,
section candidate
no_agent (1.474 ms) : 1462, 1485
. : milestone, 1474,
appsec (2.372 ms) : 2329, 2415
. : milestone, 2372,
iast (2.113 ms) : 2058, 2168
. : milestone, 2113,
iast_GLOBAL (2.165 ms) : 2110, 2221
. : milestone, 2165,
profiling (2.266 ms) : 2118, 2414
. : milestone, 2266,
tracing (1.96 ms) : 1918, 2003
. : milestone, 1960,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	2.369 ms [2.325 ms, 2.412 ms]	896.468 µs (60.9%)
iast	2.116 ms [2.061 ms, 2.172 ms]	644.3 µs (43.8%)
iast_GLOBAL	2.158 ms [2.102 ms, 2.213 ms]	685.411 µs (46.6%)
profiling	1.955 ms [1.912 ms, 1.999 ms]	483.15 µs (32.8%)
tracing	1.955 ms [1.913 ms, 1.997 ms]	482.844 µs (32.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.474 ms [1.462 ms, 1.485 ms]	-
appsec	2.372 ms [2.329 ms, 2.415 ms]	898.592 µs (61.0%)
iast	2.113 ms [2.058 ms, 2.168 ms]	639.195 µs (43.4%)
iast_GLOBAL	2.165 ms [2.11 ms, 2.221 ms]	691.86 µs (47.0%)
profiling	2.266 ms [2.118 ms, 2.414 ms]	792.569 µs (53.8%)
tracing	1.96 ms [1.918 ms, 2.003 ms]	486.53 µs (33.0%)

Disable backend requests for impacted tests data
7a0b153

nikita-tkachenko-datadog added tag: no release notes Changes to exclude from release notes type: refactoring comp: ci visibility Continuous Integration Visibility labels Feb 14, 2025

nikita-tkachenko-datadog marked this pull request as ready for review February 14, 2025 12:39

nikita-tkachenko-datadog requested review from a team as code owners February 14, 2025 12:39

nikita-tkachenko-datadog requested review from anmarchenko and dougqh February 14, 2025 12:39

daniel-mohedano approved these changes Feb 14, 2025
View reviewed changes

nikita-tkachenko-datadog merged commit acf173a into masterFeb 14, 2025

nikita-tkachenko-datadog deleted the nikita-tkachenko/disable-impacted-tests-backend branch February 14, 2025 12:45

github-actionsBot added this to the 1.47.0 milestone Feb 14, 2025

Navigation Menu

Uh oh!

Disable backend requests for impacted tests data - #8391

Disable backend requests for impacted tests data#8391
nikita-tkachenko-datadog merged 1 commit into
masterfrom
nikita-tkachenko/disable-impacted-tests-backend

nikita-tkachenko-datadog commented Feb 14, 2025•
edited by atlassian Bot
Loading

Uh oh!

pr-commenterBot commented Feb 14, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

nikita-tkachenko-datadog commented Feb 14, 2025• edited by atlassian BotLoading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Feb 14, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

nikita-tkachenko-datadog commented Feb 14, 2025•
edited by atlassian Bot
Loading