Update Maven smoke tests to use repository proxy by nikita-tkachenko-datadog · Pull Request #8979 · DataDog/dd-trace-java

nikita-tkachenko-datadog · 2025-06-13T10:24:33Z

What Does This Do

Updates Maven smoke tests to use caching Maven repository proxy in CI.

Motivation

The tests need to download Maven artifacts for the tested projects.
When downloading directly from Maven Central, the tests fail because of download query rate limits.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2025-06-13T10:59:57Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	nikita-tkachenko/maven-smoke-tests-repo-proxy
git_commit_date	1749808206	1749816503
git_commit_sha	`0b95f68`	`11a70b2`
release_version	1.50.0-SNAPSHOT~0b95f68fa0	1.50.0-SNAPSHOT~11a70b2c8e

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1749818797	1749818797
ci_job_id	980760047	980760047
ci_pipeline_id	67662669	67662669
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zvqazpau-project-304-concurrent-0-ch0jf00r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zvqazpau-project-304-concurrent-0-ch0jf00r 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
startup:insecure-bank:iast	startup:insecure-bank:iast	startup:insecure-bank:iast
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 15 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022714
Total [baseline] (8.532 s) : 0, 8531849
Agent [candidate] (1.024 s) : 0, 1023714
Total [candidate] (8.526 s) : 0, 8526288
section iast
Agent [baseline] (1.149 s) : 0, 1148741
Total [baseline] (9.175 s) : 0, 9174641
Agent [candidate] (1.149 s) : 0, 1148850
Total [candidate] (9.204 s) : 0, 9203599
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.158 s) : 0, 1158281
Total [baseline] (9.164 s) : 0, 9164472
Agent [candidate] (1.157 s) : 0, 1156702
Total [candidate] (9.17 s) : 0, 9170107
section iast_TELEMETRY_OFF
Agent [baseline] (1.145 s) : 0, 1144770
Total [baseline] (9.234 s) : 0, 9234361
Agent [candidate] (1.148 s) : 0, 1148487
Total [candidate] (9.227 s) : 0, 9226905

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.023 s	-
Agent	iast	1.149 s	126.028 ms (12.3%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.158 s	135.567 ms (13.3%)
Agent	iast_TELEMETRY_OFF	1.145 s	122.056 ms (11.9%)
Total	tracing	8.532 s	-
Total	iast	9.175 s	642.791 ms (7.5%)
Total	iast_HARDCODED_SECRET_DISABLED	9.164 s	632.623 ms (7.4%)
Total	iast_TELEMETRY_OFF	9.234 s	702.512 ms (8.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.024 s	-
Agent	iast	1.149 s	125.136 ms (12.2%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.157 s	132.988 ms (13.0%)
Agent	iast_TELEMETRY_OFF	1.148 s	124.773 ms (12.2%)
Total	tracing	8.526 s	-
Total	iast	9.204 s	677.312 ms (7.9%)
Total	iast_HARDCODED_SECRET_DISABLED	9.17 s	643.819 ms (7.6%)
Total	iast_TELEMETRY_OFF	9.227 s	700.618 ms (8.2%)

gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.352 ms) : 0, 683352
BytebuddyAgent [candidate] (682.863 ms) : 0, 682863
GlobalTracer [baseline] (239.972 ms) : 0, 239972
GlobalTracer [candidate] (240.521 ms) : 0, 240521
AppSec [baseline] (56.199 ms) : 0, 56199
AppSec [candidate] (57.809 ms) : 0, 57809
Debugger [baseline] (6.135 ms) : 0, 6135
Debugger [candidate] (6.181 ms) : 0, 6181
Remote Config [baseline] (734.382 µs) : 0, 734
Remote Config [candidate] (727.682 µs) : 0, 728
Telemetry [baseline] (12.788 ms) : 0, 12788
Telemetry [candidate] (12.094 ms) : 0, 12094
section iast
BytebuddyAgent [baseline] (801.229 ms) : 0, 801229
BytebuddyAgent [candidate] (801.833 ms) : 0, 801833
GlobalTracer [baseline] (230.354 ms) : 0, 230354
GlobalTracer [candidate] (230.656 ms) : 0, 230656
AppSec [baseline] (54.715 ms) : 0, 54715
AppSec [candidate] (50.903 ms) : 0, 50903
Debugger [baseline] (5.927 ms) : 0, 5927
Debugger [candidate] (5.92 ms) : 0, 5920
Remote Config [baseline] (594.728 µs) : 0, 595
Remote Config [candidate] (585.856 µs) : 0, 586
Telemetry [baseline] (7.872 ms) : 0, 7872
Telemetry [candidate] (7.857 ms) : 0, 7857
IAST [baseline] (24.621 ms) : 0, 24621
IAST [candidate] (27.61 ms) : 0, 27610
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (807.616 ms) : 0, 807616
BytebuddyAgent [candidate] (806.685 ms) : 0, 806685
GlobalTracer [baseline] (232.123 ms) : 0, 232123
GlobalTracer [candidate] (231.402 ms) : 0, 231402
AppSec [baseline] (52.194 ms) : 0, 52194
AppSec [candidate] (53.699 ms) : 0, 53699
Debugger [baseline] (6.083 ms) : 0, 6083
Debugger [candidate] (5.997 ms) : 0, 5997
Remote Config [baseline] (600.072 µs) : 0, 600
Remote Config [candidate] (601.565 µs) : 0, 602
Telemetry [baseline] (8.06 ms) : 0, 8060
Telemetry [candidate] (7.987 ms) : 0, 7987
IAST [baseline] (27.944 ms) : 0, 27944
IAST [candidate] (26.709 ms) : 0, 26709
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (797.6 ms) : 0, 797600
BytebuddyAgent [candidate] (800.224 ms) : 0, 800224
GlobalTracer [baseline] (230.337 ms) : 0, 230337
GlobalTracer [candidate] (231.034 ms) : 0, 231034
AppSec [baseline] (51.003 ms) : 0, 51003
AppSec [candidate] (48.689 ms) : 0, 48689
Debugger [baseline] (5.944 ms) : 0, 5944
Debugger [candidate] (5.929 ms) : 0, 5929
Remote Config [baseline] (600.676 µs) : 0, 601
Remote Config [candidate] (585.813 µs) : 0, 586
Telemetry [baseline] (7.808 ms) : 0, 7808
Telemetry [candidate] (7.953 ms) : 0, 7953
IAST [baseline] (26.477 ms) : 0, 26477
IAST [candidate] (30.576 ms) : 0, 30576

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1023397
Total [baseline] (10.459 s) : 0, 10458871
Agent [candidate] (1.023 s) : 0, 1022883
Total [candidate] (10.495 s) : 0, 10495401
section appsec
Agent [baseline] (1.169 s) : 0, 1168887
Total [baseline] (10.672 s) : 0, 10671717
Agent [candidate] (1.177 s) : 0, 1176957
Total [candidate] (10.651 s) : 0, 10651067
section iast
Agent [baseline] (1.152 s) : 0, 1152264
Total [baseline] (10.913 s) : 0, 10913056
Agent [candidate] (1.148 s) : 0, 1147721
Total [candidate] (10.841 s) : 0, 10840551
section profiling
Agent [baseline] (1.268 s) : 0, 1267795
Total [baseline] (10.783 s) : 0, 10782691
Agent [candidate] (1.263 s) : 0, 1263388
Total [candidate] (10.784 s) : 0, 10783851

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.023 s	-
Agent	appsec	1.169 s	145.49 ms (14.2%)
Agent	iast	1.152 s	128.867 ms (12.6%)
Agent	profiling	1.268 s	244.398 ms (23.9%)
Total	tracing	10.459 s	-
Total	appsec	10.672 s	212.846 ms (2.0%)
Total	iast	10.913 s	454.184 ms (4.3%)
Total	profiling	10.783 s	323.819 ms (3.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.023 s	-
Agent	appsec	1.177 s	154.074 ms (15.1%)
Agent	iast	1.148 s	124.838 ms (12.2%)
Agent	profiling	1.263 s	240.505 ms (23.5%)
Total	tracing	10.495 s	-
Total	appsec	10.651 s	155.666 ms (1.5%)
Total	iast	10.841 s	345.15 ms (3.3%)
Total	profiling	10.784 s	288.45 ms (2.7%)

gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.577 ms) : 0, 682577
BytebuddyAgent [candidate] (682.733 ms) : 0, 682733
GlobalTracer [baseline] (240.105 ms) : 0, 240105
GlobalTracer [candidate] (240.592 ms) : 0, 240592
AppSec [baseline] (58.294 ms) : 0, 58294
AppSec [candidate] (57.236 ms) : 0, 57236
Debugger [baseline] (6.128 ms) : 0, 6128
Debugger [candidate] (6.167 ms) : 0, 6167
Remote Config [baseline] (717.691 µs) : 0, 718
Remote Config [candidate] (718.901 µs) : 0, 719
Telemetry [baseline] (12.075 ms) : 0, 12075
Telemetry [candidate] (11.99 ms) : 0, 11990
section appsec
BytebuddyAgent [baseline] (701.366 ms) : 0, 701366
BytebuddyAgent [candidate] (708.534 ms) : 0, 708534
GlobalTracer [baseline] (233.554 ms) : 0, 233554
GlobalTracer [candidate] (234.5 ms) : 0, 234500
AppSec [baseline] (174.981 ms) : 0, 174981
AppSec [candidate] (174.742 ms) : 0, 174742
Debugger [baseline] (5.936 ms) : 0, 5936
Debugger [candidate] (5.909 ms) : 0, 5909
Remote Config [baseline] (614.024 µs) : 0, 614
Remote Config [candidate] (664.907 µs) : 0, 665
Telemetry [baseline] (7.258 ms) : 0, 7258
Telemetry [candidate] (7.266 ms) : 0, 7266
IAST [baseline] (21.713 ms) : 0, 21713
IAST [candidate] (21.733 ms) : 0, 21733
section iast
BytebuddyAgent [baseline] (802.553 ms) : 0, 802553
BytebuddyAgent [candidate] (800.108 ms) : 0, 800108
GlobalTracer [baseline] (231.654 ms) : 0, 231654
GlobalTracer [candidate] (230.613 ms) : 0, 230613
AppSec [baseline] (51.292 ms) : 0, 51292
AppSec [candidate] (50.991 ms) : 0, 50991
Debugger [baseline] (6.001 ms) : 0, 6001
Debugger [candidate] (5.91 ms) : 0, 5910
Remote Config [baseline] (597.588 µs) : 0, 598
Remote Config [candidate] (587.627 µs) : 0, 588
Telemetry [baseline] (8.011 ms) : 0, 8011
Telemetry [candidate] (7.889 ms) : 0, 7889
IAST [baseline] (28.647 ms) : 0, 28647
IAST [candidate] (28.169 ms) : 0, 28169
section profiling
BytebuddyAgent [baseline] (677.327 ms) : 0, 677327
BytebuddyAgent [candidate] (674.43 ms) : 0, 674430
GlobalTracer [baseline] (360.591 ms) : 0, 360591
GlobalTracer [candidate] (359.529 ms) : 0, 359529
AppSec [baseline] (61.572 ms) : 0, 61572
AppSec [candidate] (61.629 ms) : 0, 61629
Debugger [baseline] (6.084 ms) : 0, 6084
Debugger [candidate] (6.061 ms) : 0, 6061
Remote Config [baseline] (632.158 µs) : 0, 632
Remote Config [candidate] (653.75 µs) : 0, 654
Telemetry [baseline] (8.115 ms) : 0, 8115
Telemetry [candidate] (8.089 ms) : 0, 8089
ProfilingAgent [baseline] (102.646 ms) : 0, 102646
ProfilingAgent [candidate] (102.292 ms) : 0, 102292
Profiling [baseline] (102.671 ms) : 0, 102671
Profiling [candidate] (102.318 ms) : 0, 102318

Load

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
dateFormat X
axisFormat %s
section baseline
no_agent (7.785 ms) : 7762, 7808
. : milestone, 7785,
appsec (1.439 ms) : 1358, 1519
. : milestone, 1439,
code_origins (117.984 µs) : 91, 145
. : milestone, 118,
iast (781.047 µs) : 717, 845
. : milestone, 781,
profiling (2.111 ms) : 2021, 2200
. : milestone, 2111,
tracing (10.74 ms) : 10663, 10817
. : milestone, 10740,
section candidate
no_agent (8.92 ms) : 8895, 8944
. : milestone, 8920,
appsec (3.306 ms) : 3031, 3581
. : milestone, 3306,
code_origins (1.029 ms) : 790, 1269
. : milestone, 1029,
iast (2.091 ms) : 1837, 2345
. : milestone, 2091,
profiling (10.285 ms) : 10220, 10350
. : milestone, 10285,
tracing (79.588 µs) : 66, 93
. : milestone, 80,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	7.785 ms [7.762 ms, 7.808 ms]	-
appsec	1.439 ms [1.358 ms, 1.519 ms]	-6.346 ms (-81.5%)
code_origins	117.984 µs [91.166 µs, 144.801 µs]	-7.667 ms (-98.5%)
iast	781.047 µs [717.255 µs, 844.839 µs]	-7.004 ms (-90.0%)
profiling	2.111 ms [2.021 ms, 2.2 ms]	-5.674 ms (-72.9%)
tracing	10.74 ms [10.663 ms, 10.817 ms]	2.955 ms (38.0%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	8.92 ms [8.895 ms, 8.944 ms]	-
appsec	3.306 ms [3.031 ms, 3.581 ms]	-5.614 ms (-62.9%)
code_origins	1.029 ms [789.945 µs, 1.269 ms]	-7.89 ms (-88.5%)
iast	2.091 ms [1.837 ms, 2.345 ms]	-6.828 ms (-76.6%)
profiling	10.285 ms [10.22 ms, 10.35 ms]	1.365 ms (15.3%)
tracing	79.588 µs [66.434 µs, 92.743 µs]	-8.84 ms (-99.1%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~11a70b2c8e, baseline=1.50.0-SNAPSHOT~0b95f68fa0
dateFormat X
axisFormat %s
section baseline
no_agent (379.147 µs) : 359, 399
. : milestone, 379,
iast (526.443 µs) : 504, 548
. : milestone, 526,
iast_FULL (740.305 µs) : 718, 762
. : milestone, 740,
iast_GLOBAL (571.188 µs) : 547, 596
. : milestone, 571,
iast_HARDCODED_SECRET_DISABLED (518.688 µs) : 497, 540
. : milestone, 519,
iast_INACTIVE (472.721 µs) : 450, 496
. : milestone, 473,
iast_TELEMETRY_OFF (520.187 µs) : 497, 544
. : milestone, 520,
tracing (462.107 µs) : 440, 485
. : milestone, 462,
section candidate
no_agent (382.936 µs) : 362, 404
. : milestone, 383,
iast (516.155 µs) : 493, 539
. : milestone, 516,
iast_FULL (739.508 µs) : 715, 764
. : milestone, 740,
iast_GLOBAL (577.745 µs) : 554, 602
. : milestone, 578,
iast_HARDCODED_SECRET_DISABLED (519.092 µs) : 497, 541
. : milestone, 519,
iast_INACTIVE (484.328 µs) : 462, 507
. : milestone, 484,
iast_TELEMETRY_OFF (518.26 µs) : 495, 542
. : milestone, 518,
tracing (462.412 µs) : 440, 485
. : milestone, 462,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	379.147 µs [358.932 µs, 399.361 µs]	-
iast	526.443 µs [504.408 µs, 548.479 µs]	147.297 µs (38.8%)
iast_FULL	740.305 µs [718.139 µs, 762.471 µs]	361.158 µs (95.3%)
iast_GLOBAL	571.188 µs [546.762 µs, 595.613 µs]	192.041 µs (50.7%)
iast_HARDCODED_SECRET_DISABLED	518.688 µs [496.912 µs, 540.464 µs]	139.541 µs (36.8%)
iast_INACTIVE	472.721 µs [449.692 µs, 495.751 µs]	93.575 µs (24.7%)
iast_TELEMETRY_OFF	520.187 µs [496.693 µs, 543.681 µs]	141.04 µs (37.2%)
tracing	462.107 µs [439.588 µs, 484.626 µs]	82.961 µs (21.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	382.936 µs [362.144 µs, 403.728 µs]	-
iast	516.155 µs [492.991 µs, 539.318 µs]	133.219 µs (34.8%)
iast_FULL	739.508 µs [715.448 µs, 763.567 µs]	356.572 µs (93.1%)
iast_GLOBAL	577.745 µs [553.896 µs, 601.593 µs]	194.809 µs (50.9%)
iast_HARDCODED_SECRET_DISABLED	519.092 µs [496.822 µs, 541.362 µs]	136.156 µs (35.6%)
iast_INACTIVE	484.328 µs [461.616 µs, 507.039 µs]	101.392 µs (26.5%)
iast_TELEMETRY_OFF	518.26 µs [494.865 µs, 541.655 µs]	135.324 µs (35.3%)
tracing	462.412 µs [440.07 µs, 484.754 µs]	79.476 µs (20.8%)

Dacapo

nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility labels Jun 13, 2025

nikita-tkachenko-datadog marked this pull request as ready for review June 13, 2025 10:52

nikita-tkachenko-datadog requested a review from a team as a code owner June 13, 2025 10:52

nikita-tkachenko-datadog requested a review from daniel-mohedano June 13, 2025 10:52

nikita-tkachenko-datadog force-pushed the nikita-tkachenko/maven-smoke-tests-repo-proxy branch from 4d8bfe0 to b5b0ad6Compare June 13, 2025 12:07

Update Maven smoke tests to use repository proxy
11a70b2

nikita-tkachenko-datadog force-pushed the nikita-tkachenko/maven-smoke-tests-repo-proxy branch from b5b0ad6 to 11a70b2Compare June 13, 2025 12:09

mcculls approved these changes Jun 13, 2025
View reviewed changes

bric3 approved these changes Jun 13, 2025
View reviewed changes

mcculls merged commit ff2b2e9 into masterJun 13, 2025

mcculls deleted the nikita-tkachenko/maven-smoke-tests-repo-proxy branch June 13, 2025 13:36

github-actionsBot added this to the 1.50.0 milestone Jun 13, 2025

randomanderson mentioned this pull request Jul 28, 2025
Use proxy for forbiddenapi plugin dependencies #9263
Merged

Navigation Menu

Uh oh!

Update Maven smoke tests to use repository proxy - #8979

Update Maven smoke tests to use repository proxy#8979
mcculls merged 1 commit into
masterfrom
nikita-tkachenko/maven-smoke-tests-repo-proxy

nikita-tkachenko-datadog commented Jun 13, 2025

Uh oh!

pr-commenterBot commented Jun 13, 2025•
edited
Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

nikita-tkachenko-datadog commented Jun 13, 2025

What Does This Do

Motivation

Contributor Checklist

Uh oh!

pr-commenterBot commented Jun 13, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Dacapo

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

pr-commenterBot commented Jun 13, 2025•
edited
Loading