Increase CiVis smoke tests timeout by daniel-mohedano · Pull Request #9062 · DataDog/dd-trace-java

daniel-mohedano · 2025-06-30T08:58:21Z

What Does This Do

Separates the Maven smoke tests' individual timeout between dependency resolution/downloads and test running. The dependency download timeout has been increased to 400s to avoid timeouts on the first test run, the test running timeouts have been reduced to 120s.
Increase Gradle task timeout for Maven smoke test to 25m (from 20m), to account for the increase timeout in dependency download.
Increase Gradle task timeout for Gradle smoke tests to 20m (from 15m).

Motivation

After fixing the Maven smoke test suite timeout in #9040, test failures are being correctly reported. Although the Maven smoke tests are passing, sometimes the first one or two individual smoke tests need a retry after timing out (usually test test_successful_maven_run, v3.5.4, less often test test_successful_maven_run, v3.6.3, which are coincidentally the first two tests in the suite). Currently there are limitations on both the caching of smoke tests dependencies and the caching of maven dependencies, as well as issues related to the Maven smoke tests setup. This changes serve as a patch for now until the implementation can be improved to make use of the dependencies caching capabilities.

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-06-30T09:31:02Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date	1751549586	1751551030
git_commit_sha	`53e4f70`	`99a5b11`
release_version	1.51.0-SNAPSHOT~53e4f70038	1.51.0-SNAPSHOT~99a5b11ce8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751552977	1751552977
ci_job_id	1012328896	1012328896
ci_pipeline_id	69564949	69564949
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-8pyzl8mv 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-8pyzl8mv 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (999.837 ms) : 0, 999837
Total [baseline] (8.587 s) : 0, 8587211
Agent [candidate] (1.003 s) : 0, 1002690
Total [candidate] (8.578 s) : 0, 8577752
section iast
Agent [baseline] (1.142 s) : 0, 1141622
Total [baseline] (9.283 s) : 0, 9282581
Agent [candidate] (1.159 s) : 0, 1159308
Total [candidate] (9.393 s) : 0, 9392591

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	999.837 ms	-
Agent	iast	1.142 s	141.785 ms (14.2%)
Total	tracing	8.587 s	-
Total	iast	9.283 s	695.37 ms (8.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.003 s	-
Agent	iast	1.159 s	156.618 ms (15.6%)
Total	tracing	8.578 s	-
Total	iast	9.393 s	814.839 ms (9.5%)

gantt
title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.87 ms) : 0, 691870
BytebuddyAgent [candidate] (692.35 ms) : 0, 692350
GlobalTracer [baseline] (241.884 ms) : 0, 241884
GlobalTracer [candidate] (243.728 ms) : 0, 243728
AppSec [baseline] (30.2 ms) : 0, 30200
AppSec [candidate] (30.637 ms) : 0, 30637
Debugger [baseline] (6.059 ms) : 0, 6059
Debugger [candidate] (6.105 ms) : 0, 6105
Remote Config [baseline] (681.981 µs) : 0, 682
Remote Config [candidate] (685.716 µs) : 0, 686
Telemetry [baseline] (8.226 ms) : 0, 8226
Telemetry [candidate] (8.268 ms) : 0, 8268
section iast
BytebuddyAgent [baseline] (814.399 ms) : 0, 814399
BytebuddyAgent [candidate] (828.266 ms) : 0, 828266
GlobalTracer [baseline] (233.901 ms) : 0, 233901
GlobalTracer [candidate] (238.095 ms) : 0, 238095
IAST [baseline] (28.056 ms) : 0, 28056
IAST [candidate] (27.798 ms) : 0, 27798
AppSec [baseline] (28.966 ms) : 0, 28966
AppSec [candidate] (28.541 ms) : 0, 28541
Debugger [baseline] (6.708 ms) : 0, 6708
Debugger [candidate] (5.972 ms) : 0, 5972
Remote Config [baseline] (592.25 µs) : 0, 592
Remote Config [candidate] (589.08 µs) : 0, 589
Telemetry [baseline] (8.146 ms) : 0, 8146
Telemetry [candidate] (8.118 ms) : 0, 8118

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (998.571 ms) : 0, 998571
Total [baseline] (10.584 s) : 0, 10584149
Agent [candidate] (1.005 s) : 0, 1005320
Total [candidate] (10.702 s) : 0, 10702208
section appsec
Agent [baseline] (1.176 s) : 0, 1176073
Total [baseline] (10.734 s) : 0, 10733872
Agent [candidate] (1.186 s) : 0, 1185820
Total [candidate] (10.765 s) : 0, 10765000
section iast
Agent [baseline] (1.135 s) : 0, 1134898
Total [baseline] (10.846 s) : 0, 10845962
Agent [candidate] (1.133 s) : 0, 1132651
Total [candidate] (10.847 s) : 0, 10846717
section profiling
Agent [baseline] (1.247 s) : 0, 1246580
Total [baseline] (10.949 s) : 0, 10949141
Agent [candidate] (1.245 s) : 0, 1245384
Total [candidate] (11.024 s) : 0, 11023838

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	998.571 ms	-
Agent	appsec	1.176 s	177.501 ms (17.8%)
Agent	iast	1.135 s	136.326 ms (13.7%)
Agent	profiling	1.247 s	248.008 ms (24.8%)
Total	tracing	10.584 s	-
Total	appsec	10.734 s	149.723 ms (1.4%)
Total	iast	10.846 s	261.813 ms (2.5%)
Total	profiling	10.949 s	364.992 ms (3.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.005 s	-
Agent	appsec	1.186 s	180.5 ms (18.0%)
Agent	iast	1.133 s	127.331 ms (12.7%)
Agent	profiling	1.245 s	240.064 ms (23.9%)
Total	tracing	10.702 s	-
Total	appsec	10.765 s	62.792 ms (0.6%)
Total	iast	10.847 s	144.509 ms (1.4%)
Total	profiling	11.024 s	321.63 ms (3.0%)

gantt
title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.737 ms) : 0, 689737
BytebuddyAgent [candidate] (694.246 ms) : 0, 694246
GlobalTracer [baseline] (242.835 ms) : 0, 242835
GlobalTracer [candidate] (244.27 ms) : 0, 244270
AppSec [baseline] (30.179 ms) : 0, 30179
AppSec [candidate] (30.76 ms) : 0, 30760
Debugger [baseline] (6.095 ms) : 0, 6095
Debugger [candidate] (6.144 ms) : 0, 6144
Remote Config [baseline] (685.831 µs) : 0, 686
Remote Config [candidate] (697.416 µs) : 0, 697
Telemetry [baseline] (8.235 ms) : 0, 8235
Telemetry [candidate] (8.3 ms) : 0, 8300
section appsec
BytebuddyAgent [baseline] (711.053 ms) : 0, 711053
BytebuddyAgent [candidate] (717.758 ms) : 0, 717758
GlobalTracer [baseline] (234.907 ms) : 0, 234907
GlobalTracer [candidate] (237.851 ms) : 0, 237851
IAST [baseline] (23.228 ms) : 0, 23228
IAST [candidate] (22.407 ms) : 0, 22407
AppSec [baseline] (171.531 ms) : 0, 171531
AppSec [candidate] (172.213 ms) : 0, 172213
Debugger [baseline] (5.765 ms) : 0, 5765
Debugger [candidate] (5.852 ms) : 0, 5852
Remote Config [baseline] (601.52 µs) : 0, 602
Remote Config [candidate] (612.811 µs) : 0, 613
Telemetry [baseline] (8.123 ms) : 0, 8123
Telemetry [candidate] (8.211 ms) : 0, 8211
section iast
BytebuddyAgent [baseline] (808.611 ms) : 0, 808611
BytebuddyAgent [candidate] (808.864 ms) : 0, 808864
GlobalTracer [baseline] (233.348 ms) : 0, 233348
GlobalTracer [candidate] (232.952 ms) : 0, 232952
IAST [baseline] (26.411 ms) : 0, 26411
IAST [candidate] (28.64 ms) : 0, 28640
AppSec [baseline] (30.271 ms) : 0, 30271
AppSec [candidate] (26.951 ms) : 0, 26951
Debugger [baseline] (6.758 ms) : 0, 6758
Debugger [candidate] (5.856 ms) : 0, 5856
Remote Config [baseline] (591.246 µs) : 0, 591
Remote Config [candidate] (593.399 µs) : 0, 593
Telemetry [baseline] (8.016 ms) : 0, 8016
Telemetry [candidate] (8.029 ms) : 0, 8029
section profiling
BytebuddyAgent [baseline] (678.917 ms) : 0, 678917
BytebuddyAgent [candidate] (679.349 ms) : 0, 679349
GlobalTracer [baseline] (362.528 ms) : 0, 362528
GlobalTracer [candidate] (361.787 ms) : 0, 361787
AppSec [baseline] (31.579 ms) : 0, 31579
AppSec [candidate] (30.845 ms) : 0, 30845
Debugger [baseline] (12.176 ms) : 0, 12176
Debugger [candidate] (12.018 ms) : 0, 12018
Remote Config [baseline] (650.511 µs) : 0, 651
Remote Config [candidate] (2.141 ms) : 0, 2141
Telemetry [baseline] (8.796 ms) : 0, 8796
Telemetry [candidate] (8.057 ms) : 0, 8057
ProfilingAgent [baseline] (103.328 ms) : 0, 103328
ProfilingAgent [candidate] (102.54 ms) : 0, 102540
Profiling [baseline] (103.353 ms) : 0, 103353
Profiling [candidate] (102.565 ms) : 0, 102565

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date	1751549586	1751551030
git_commit_sha	`53e4f70`	`99a5b11`
release_version	1.51.0-SNAPSHOT~53e4f70038	1.51.0-SNAPSHOT~99a5b11ce8

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751552656	1751552656
ci_job_id	1012328898	1012328898
ci_pipeline_id	69564949	69564949
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-hkw25hov 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-hkw25hov 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-220.465µs; -100.928µs] or [-4.930%; -2.257%]	unstable [-84.711op/s; +159.898op/s] or [-8.253%; +15.578%]	4.312ms	1064.062op/s	4.472ms	1026.469op/s
scenario:load:petclinic:appsec:high_load	better [-2.015ms; -1.118ms] or [-4.211%; -2.336%]	unstable [-3.331op/s; +12.296op/s] or [-3.448%; +12.729%]	46.286ms	101.088op/s	47.853ms	96.605op/s
scenario:load:petclinic:no_agent:high_load	better [-1.649ms; -1.006ms] or [-4.371%; -2.667%]	unstable [-5.799op/s; +11.687op/s] or [-4.621%; +9.313%]	36.394ms	128.425op/s	37.721ms	125.481op/s

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section baseline
no_agent (4.472 ms) : 4411, 4534
. : milestone, 4472,
iast (8.94 ms) : 8796, 9085
. : milestone, 8940,
iast_FULL (14.253 ms) : 13973, 14533
. : milestone, 14253,
iast_GLOBAL (10.349 ms) : 10170, 10528
. : milestone, 10349,
profiling (9.017 ms) : 8871, 9164
. : milestone, 9017,
tracing (7.856 ms) : 7745, 7966
. : milestone, 7856,
section candidate
no_agent (4.312 ms) : 4263, 4360
. : milestone, 4312,
iast (8.967 ms) : 8819, 9116
. : milestone, 8967,
iast_FULL (13.784 ms) : 13510, 14058
. : milestone, 13784,
iast_GLOBAL (10.018 ms) : 9834, 10202
. : milestone, 10018,
profiling (8.774 ms) : 8637, 8910
. : milestone, 8774,
tracing (7.698 ms) : 7578, 7817
. : milestone, 7698,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.472 ms [4.411 ms, 4.534 ms]	-
iast	8.94 ms [8.796 ms, 9.085 ms]	4.468 ms (99.9%)
iast_FULL	14.253 ms [13.973 ms, 14.533 ms]	9.781 ms (218.7%)
iast_GLOBAL	10.349 ms [10.17 ms, 10.528 ms]	5.877 ms (131.4%)
profiling	9.017 ms [8.871 ms, 9.164 ms]	4.545 ms (101.6%)
tracing	7.856 ms [7.745 ms, 7.966 ms]	3.383 ms (75.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.312 ms [4.263 ms, 4.36 ms]	-
iast	8.967 ms [8.819 ms, 9.116 ms]	4.656 ms (108.0%)
iast_FULL	13.784 ms [13.51 ms, 14.058 ms]	9.473 ms (219.7%)
iast_GLOBAL	10.018 ms [9.834 ms, 10.202 ms]	5.706 ms (132.4%)
profiling	8.774 ms [8.637 ms, 8.91 ms]	4.462 ms (103.5%)
tracing	7.698 ms [7.578 ms, 7.817 ms]	3.386 ms (78.5%)

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section baseline
no_agent (37.721 ms) : 37418, 38024
. : milestone, 37721,
appsec (47.853 ms) : 47422, 48284
. : milestone, 47853,
code_origins (44.205 ms) : 43817, 44594
. : milestone, 44205,
iast (44.41 ms) : 44018, 44802
. : milestone, 44410,
profiling (45.822 ms) : 45422, 46222
. : milestone, 45822,
tracing (43.679 ms) : 43310, 44048
. : milestone, 43679,
section candidate
no_agent (36.394 ms) : 36099, 36688
. : milestone, 36394,
appsec (46.286 ms) : 45884, 46689
. : milestone, 46286,
code_origins (44.603 ms) : 44217, 44990
. : milestone, 44603,
iast (45.707 ms) : 45311, 46102
. : milestone, 45707,
profiling (46.528 ms) : 46120, 46936
. : milestone, 46528,
tracing (43.016 ms) : 42662, 43370
. : milestone, 43016,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.721 ms [37.418 ms, 38.024 ms]	-
appsec	47.853 ms [47.422 ms, 48.284 ms]	10.132 ms (26.9%)
code_origins	44.205 ms [43.817 ms, 44.594 ms]	6.484 ms (17.2%)
iast	44.41 ms [44.018 ms, 44.802 ms]	6.689 ms (17.7%)
profiling	45.822 ms [45.422 ms, 46.222 ms]	8.101 ms (21.5%)
tracing	43.679 ms [43.31 ms, 44.048 ms]	5.958 ms (15.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.394 ms [36.099 ms, 36.688 ms]	-
appsec	46.286 ms [45.884 ms, 46.689 ms]	9.893 ms (27.2%)
code_origins	44.603 ms [44.217 ms, 44.99 ms]	8.21 ms (22.6%)
iast	45.707 ms [45.311 ms, 46.102 ms]	9.313 ms (25.6%)
profiling	46.528 ms [46.12 ms, 46.936 ms]	10.134 ms (27.8%)
tracing	43.016 ms [42.662 ms, 43.37 ms]	6.622 ms (18.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	daniel.mohedano/maven-smoke-warmup-timeout
git_commit_date	1751549586	1751551030
git_commit_sha	`53e4f70`	`99a5b11`
release_version	1.51.0-SNAPSHOT~53e4f70038	1.51.0-SNAPSHOT~99a5b11ce8

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1751553221	1751553221
ci_job_id	1012328899	1012328899
ci_pipeline_id	69564949	69564949
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-0zcwcycf 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-0zcwcycf 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section baseline
no_agent (14.773 s) : 14773000, 14773000
. : milestone, 14773000,
appsec (15.266 s) : 15266000, 15266000
. : milestone, 15266000,
iast (18.476 s) : 18476000, 18476000
. : milestone, 18476000,
iast_GLOBAL (18.063 s) : 18063000, 18063000
. : milestone, 18063000,
profiling (15.133 s) : 15133000, 15133000
. : milestone, 15133000,
tracing (14.83 s) : 14830000, 14830000
. : milestone, 14830000,
section candidate
no_agent (14.982 s) : 14982000, 14982000
. : milestone, 14982000,
appsec (14.843 s) : 14843000, 14843000
. : milestone, 14843000,
iast (18.275 s) : 18275000, 18275000
. : milestone, 18275000,
iast_GLOBAL (17.682 s) : 17682000, 17682000
. : milestone, 17682000,
profiling (15.174 s) : 15174000, 15174000
. : milestone, 15174000,
tracing (14.78 s) : 14780000, 14780000
. : milestone, 14780000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.773 s [14.773 s, 14.773 s]	-
appsec	15.266 s [15.266 s, 15.266 s]	493.0 ms (3.3%)
iast	18.476 s [18.476 s, 18.476 s]	3.703 s (25.1%)
iast_GLOBAL	18.063 s [18.063 s, 18.063 s]	3.29 s (22.3%)
profiling	15.133 s [15.133 s, 15.133 s]	360.0 ms (2.4%)
tracing	14.83 s [14.83 s, 14.83 s]	57.0 ms (0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.982 s [14.982 s, 14.982 s]	-
appsec	14.843 s [14.843 s, 14.843 s]	-139.0 ms (-0.9%)
iast	18.275 s [18.275 s, 18.275 s]	3.293 s (22.0%)
iast_GLOBAL	17.682 s [17.682 s, 17.682 s]	2.7 s (18.0%)
profiling	15.174 s [15.174 s, 15.174 s]	192.0 ms (1.3%)
tracing	14.78 s [14.78 s, 14.78 s]	-202.0 ms (-1.3%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~99a5b11ce8, baseline=1.51.0-SNAPSHOT~53e4f70038
dateFormat X
axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1494
. : milestone, 1483,
appsec (2.422 ms) : 2373, 2471
. : milestone, 2422,
iast (2.198 ms) : 2136, 2260
. : milestone, 2198,
iast_GLOBAL (2.257 ms) : 2195, 2320
. : milestone, 2257,
profiling (2.054 ms) : 2003, 2105
. : milestone, 2054,
tracing (2.02 ms) : 1972, 2068
. : milestone, 2020,
section candidate
no_agent (1.479 ms) : 1467, 1490
. : milestone, 1479,
appsec (2.423 ms) : 2373, 2473
. : milestone, 2423,
iast (2.202 ms) : 2139, 2264
. : milestone, 2202,
iast_GLOBAL (2.252 ms) : 2189, 2315
. : milestone, 2252,
profiling (2.059 ms) : 2008, 2110
. : milestone, 2059,
tracing (2.027 ms) : 1979, 2076
. : milestone, 2027,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.471 ms, 1.494 ms]	-
appsec	2.422 ms [2.373 ms, 2.471 ms]	939.299 µs (63.3%)
iast	2.198 ms [2.136 ms, 2.26 ms]	715.135 µs (48.2%)
iast_GLOBAL	2.257 ms [2.195 ms, 2.32 ms]	774.438 µs (52.2%)
profiling	2.054 ms [2.003 ms, 2.105 ms]	570.842 µs (38.5%)
tracing	2.02 ms [1.972 ms, 2.068 ms]	537.025 µs (36.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.479 ms [1.467 ms, 1.49 ms]	-
appsec	2.423 ms [2.373 ms, 2.473 ms]	944.139 µs (63.9%)
iast	2.202 ms [2.139 ms, 2.264 ms]	723.138 µs (48.9%)
iast_GLOBAL	2.252 ms [2.189 ms, 2.315 ms]	773.594 µs (52.3%)
profiling	2.059 ms [2.008 ms, 2.11 ms]	580.321 µs (39.3%)
tracing	2.027 ms [1.979 ms, 2.076 ms]	548.845 µs (37.1%)

This reverts commit abb4997.

nikita-tkachenko-datadog

Should we bump the gradle task timeout for Maven smoke tests module as well?

daniel-mohedano · 2025-07-03T13:42:42Z

Sounds good, let's bump it up to 25min just in case

bric3 · 2025-07-04T07:27:24Z

FYI there's this PR for possibly improving download latencies #9099

daniel-mohedano · 2025-07-04T07:56:15Z

@bric3 We'll hold off on merging this PR to see how the download latencies improve and if those changes are enough 👍

increase maven smoke tests' timeout to 180
1277a43

daniel-mohedano added type: bug fix Bug fix tag: do not merge Do not merge changes tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 30, 2025

daniel-mohedano added 2 commits June 30, 2025 13:58

noop change to trigger ci
200ccc1

increase maven timeout to 240s and gradlesmoke suite timeout to 20m
e101270

daniel-mohedano changed the title ~~Increase individual Maven smoke test timeout to 180~~Increase CiVis smoke tests timeoutJun 30, 2025

daniel-mohedano added 6 commits July 1, 2025 12:54

increase timeout only for dependencies download
e3af0a8

move dependency downloads to build task
abb4997

Revert "move dependency downloads to build task"
dcc6e79
This reverts commit abb4997.

increase dependencies timeout to 400
d29a87f

Merge branch 'master' into daniel.mohedano/maven-smoke-warmup-timeout
862885a

Merge branch 'master' into daniel.mohedano/maven-smoke-warmup-timeout
5dfd72a

daniel-mohedano removed the tag: do not merge Do not merge changes label Jul 3, 2025

daniel-mohedano marked this pull request as ready for review July 3, 2025 13:18

daniel-mohedano requested a review from a team as a code owner July 3, 2025 13:18

daniel-mohedano requested review from Mariovido and nikita-tkachenko-datadog July 3, 2025 13:18

nikita-tkachenko-datadog approved these changes Jul 3, 2025
View reviewed changes

increase maven smoke test gradle task timeout
99a5b11

daniel-mohedano merged commit 37922ad into masterJul 9, 2025
178 checks passed

daniel-mohedano deleted the daniel.mohedano/maven-smoke-warmup-timeout branch July 9, 2025 07:53

github-actionsBot added this to the 1.51.0 milestone Jul 9, 2025

Navigation Menu

Uh oh!

Increase CiVis smoke tests timeout - #9062

Increase CiVis smoke tests timeout#9062
daniel-mohedano merged 10 commits into
masterfrom
daniel.mohedano/maven-smoke-warmup-timeout

daniel-mohedano commented Jun 30, 2025•
edited
Loading

Uh oh!

pr-commenterBot commented Jun 30, 2025•
edited
Loading

Uh oh!

nikita-tkachenko-datadog left a comment

Uh oh!

daniel-mohedano commented Jul 3, 2025

Uh oh!

bric3 commented Jul 4, 2025

Uh oh!

daniel-mohedano commented Jul 4, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

daniel-mohedano commented Jun 30, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Jun 30, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

nikita-tkachenko-datadog left a comment

Choose a reason for hiding this comment

Uh oh!

daniel-mohedano commented Jul 3, 2025

Uh oh!

bric3 commented Jul 4, 2025

Uh oh!

daniel-mohedano commented Jul 4, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

daniel-mohedano commented Jun 30, 2025•
edited
Loading

pr-commenterBot commented Jun 30, 2025•
edited
Loading