Increase flare reporter smoke test duration by MattAlp · Pull Request #9452 · DataDog/dd-trace-java

MattAlp · 2025-09-02T19:25:19Z

What Does This Do

This extends the runtime of the flare smoke tests from 15s to 20s.

Motivation

We delay starting the profiling subsystem when running on Oracle's JDK 8, which means this smoke test tends to fail if the triage report timer is set too low.

Additional Notes

This is currently causing our master CI to fail (n.b. this wasn't caught in #9440 because we only run tests on this JDK in the master branch). It's likely that we would have caught it if that PR was tagged as run-tests: oracle8 and/or comp: profiling.

⚠️ I opened this PR by continuing to commit on the branch that introduced this functionality, the diff you're interested in for reviewing is 84e5026

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: PROF-12412

Squashed 9 commits

datadog-official · 2025-09-02T19:49:05Z

🎯 Code Coverage
• Patch Coverage: 100.00%
• Total Coverage: 59.26% (+1.63%)

View detailed report

_{This comment will be updated automatically if new data arrives.

🔗 Commit SHA: d8ad90c | Docs | Was this helpful? Give us feedback!}

pr-commenter · 2025-09-02T19:58:50Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/baseline-flarereporter-smoketesting
git_commit_date	1756829606	1756841172
git_commit_sha	`0a4e9d0`	`d8ad90c`
release_version	1.53.0-SNAPSHOT~0a4e9d0069	1.53.0-SNAPSHOT~d8ad90c648

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1756842898	1756842898
ci_job_id	1109787627	1109787627
ci_pipeline_id	75338534	75338534
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-2jgndhkc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-2jgndhkc 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 11 unstable metrics.

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.057 s) : 0, 1056932
Total [baseline] (8.651 s) : 0, 8651258
Agent [candidate] (1.057 s) : 0, 1056862
Total [candidate] (8.672 s) : 0, 8672111
section iast
Agent [baseline] (1.19 s) : 0, 1190308
Total [baseline] (9.354 s) : 0, 9353851
Agent [candidate] (1.182 s) : 0, 1181642
Total [candidate] (9.352 s) : 0, 9351702

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	iast	1.19 s	133.376 ms (12.6%)
Total	tracing	8.651 s	-
Total	iast	9.354 s	702.593 ms (8.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	iast	1.182 s	124.78 ms (11.8%)
Total	tracing	8.672 s	-
Total	iast	9.352 s	679.591 ms (7.8%)

gantt
title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.478 ms) : 0, 1478
crashtracking [candidate] (1.474 ms) : 0, 1474
BytebuddyAgent [baseline] (740.791 ms) : 0, 740791
BytebuddyAgent [candidate] (738.979 ms) : 0, 738979
GlobalTracer [baseline] (244.816 ms) : 0, 244816
GlobalTracer [candidate] (245.437 ms) : 0, 245437
AppSec [baseline] (30.3 ms) : 0, 30300
AppSec [candidate] (30.705 ms) : 0, 30705
Debugger [baseline] (6.087 ms) : 0, 6087
Debugger [candidate] (6.145 ms) : 0, 6145
Remote Config [baseline] (679.986 µs) : 0, 680
Remote Config [candidate] (683.443 µs) : 0, 683
Telemetry [baseline] (11.631 ms) : 0, 11631
Telemetry [candidate] (12.326 ms) : 0, 12326
section iast
crashtracking [baseline] (1.475 ms) : 0, 1475
crashtracking [candidate] (1.452 ms) : 0, 1452
BytebuddyAgent [baseline] (859.127 ms) : 0, 859127
BytebuddyAgent [candidate] (852.439 ms) : 0, 852439
GlobalTracer [baseline] (234.928 ms) : 0, 234928
GlobalTracer [candidate] (233.596 ms) : 0, 233596
IAST [baseline] (29.003 ms) : 0, 29003
IAST [candidate] (27.941 ms) : 0, 27941
AppSec [baseline] (28.764 ms) : 0, 28764
AppSec [candidate] (28.579 ms) : 0, 28579
Debugger [baseline] (6.782 ms) : 0, 6782
Debugger [candidate] (7.543 ms) : 0, 7543
Remote Config [baseline] (620.239 µs) : 0, 620
Remote Config [candidate] (606.194 µs) : 0, 606
Telemetry [baseline] (8.425 ms) : 0, 8425
Telemetry [candidate] (8.322 ms) : 0, 8322

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.058 s) : 0, 1058212
Total [baseline] (10.817 s) : 0, 10816540
Agent [candidate] (1.062 s) : 0, 1062209
Total [candidate] (10.723 s) : 0, 10722583
section appsec
Agent [baseline] (1.223 s) : 0, 1222858
Total [baseline] (10.818 s) : 0, 10818400
Agent [candidate] (1.225 s) : 0, 1225033
Total [candidate] (10.798 s) : 0, 10797840
section iast
Agent [baseline] (1.189 s) : 0, 1189459
Total [baseline] (10.974 s) : 0, 10973647
Agent [candidate] (1.179 s) : 0, 1178784
Total [candidate] (11.013 s) : 0, 11013232
section profiling
Agent [baseline] (1.199 s) : 0, 1199253
Total [baseline] (10.873 s) : 0, 10872979
Agent [candidate] (1.207 s) : 0, 1206656
Total [candidate] (10.901 s) : 0, 10900664

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.058 s	-
Agent	appsec	1.223 s	164.646 ms (15.6%)
Agent	iast	1.189 s	131.247 ms (12.4%)
Agent	profiling	1.199 s	141.041 ms (13.3%)
Total	tracing	10.817 s	-
Total	appsec	10.818 s	1.86 ms (0.0%)
Total	iast	10.974 s	157.108 ms (1.5%)
Total	profiling	10.873 s	56.44 ms (0.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.062 s	-
Agent	appsec	1.225 s	162.824 ms (15.3%)
Agent	iast	1.179 s	116.575 ms (11.0%)
Agent	profiling	1.207 s	144.446 ms (13.6%)
Total	tracing	10.723 s	-
Total	appsec	10.798 s	75.257 ms (0.7%)
Total	iast	11.013 s	290.649 ms (2.7%)
Total	profiling	10.901 s	178.08 ms (1.7%)

gantt
title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.471 ms) : 0, 1471
crashtracking [candidate] (1.466 ms) : 0, 1466
BytebuddyAgent [baseline] (739.444 ms) : 0, 739444
BytebuddyAgent [candidate] (744.088 ms) : 0, 744088
GlobalTracer [baseline] (245.264 ms) : 0, 245264
GlobalTracer [candidate] (245.24 ms) : 0, 245240
AppSec [baseline] (30.328 ms) : 0, 30328
AppSec [candidate] (30.332 ms) : 0, 30332
Debugger [baseline] (6.11 ms) : 0, 6110
Debugger [candidate] (6.108 ms) : 0, 6108
Remote Config [baseline] (681.674 µs) : 0, 682
Remote Config [candidate] (663.701 µs) : 0, 664
Telemetry [baseline] (13.643 ms) : 0, 13643
Telemetry [candidate] (12.96 ms) : 0, 12960
section appsec
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.456 ms) : 0, 1456
BytebuddyAgent [baseline] (755.465 ms) : 0, 755465
BytebuddyAgent [candidate] (756.469 ms) : 0, 756469
GlobalTracer [baseline] (235.443 ms) : 0, 235443
GlobalTracer [candidate] (236.043 ms) : 0, 236043
AppSec [baseline] (169.422 ms) : 0, 169422
AppSec [candidate] (170.458 ms) : 0, 170458
Debugger [baseline] (6.566 ms) : 0, 6566
Debugger [candidate] (5.755 ms) : 0, 5755
Remote Config [baseline] (642.724 µs) : 0, 643
Remote Config [candidate] (632.579 µs) : 0, 633
Telemetry [baseline] (9.168 ms) : 0, 9168
Telemetry [candidate] (9.338 ms) : 0, 9338
IAST [baseline] (23.523 ms) : 0, 23523
IAST [candidate] (23.697 ms) : 0, 23697
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (858.816 ms) : 0, 858816
BytebuddyAgent [candidate] (850.365 ms) : 0, 850365
GlobalTracer [baseline] (234.577 ms) : 0, 234577
GlobalTracer [candidate] (233.184 ms) : 0, 233184
AppSec [baseline] (26.495 ms) : 0, 26495
AppSec [candidate] (27.087 ms) : 0, 27087
Debugger [baseline] (8.338 ms) : 0, 8338
Debugger [candidate] (5.762 ms) : 0, 5762
Remote Config [baseline] (600.955 µs) : 0, 601
Remote Config [candidate] (601.421 µs) : 0, 601
Telemetry [baseline] (8.205 ms) : 0, 8205
Telemetry [candidate] (8.3 ms) : 0, 8300
IAST [baseline] (29.741 ms) : 0, 29741
IAST [candidate] (30.968 ms) : 0, 30968
section profiling
ProfilingAgent [baseline] (108.313 ms) : 0, 108313
ProfilingAgent [candidate] (108.46 ms) : 0, 108460
crashtracking [baseline] (1.429 ms) : 0, 1429
crashtracking [candidate] (1.446 ms) : 0, 1446
BytebuddyAgent [baseline] (763.311 ms) : 0, 763311
BytebuddyAgent [candidate] (768.292 ms) : 0, 768292
GlobalTracer [baseline] (222.597 ms) : 0, 222597
GlobalTracer [candidate] (224.034 ms) : 0, 224034
AppSec [baseline] (29.965 ms) : 0, 29965
AppSec [candidate] (30.309 ms) : 0, 30309
Debugger [baseline] (6.267 ms) : 0, 6267
Debugger [candidate] (6.366 ms) : 0, 6366
Remote Config [baseline] (727.49 µs) : 0, 727
Remote Config [candidate] (742.439 µs) : 0, 742
Telemetry [baseline] (16.25 ms) : 0, 16250
Telemetry [candidate] (16.299 ms) : 0, 16299
Profiling [baseline] (108.977 ms) : 0, 108977
Profiling [candidate] (109.112 ms) : 0, 109112

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/baseline-flarereporter-smoketesting
git_commit_date	1756829606	1756841172
git_commit_sha	`0a4e9d0`	`d8ad90c`
release_version	1.53.0-SNAPSHOT~0a4e9d0069	1.53.0-SNAPSHOT~d8ad90c648

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1756842575	1756842575
ci_job_id	1109787628	1109787628
ci_pipeline_id	75338534	75338534
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-anlecmie 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-anlecmie 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+158.697µs; +395.860µs] or [+2.166%; +5.404%]	unstable [-94.528op/s; +49.153op/s] or [-14.960%; +7.779%]	7.603ms	609.188op/s	7.325ms	631.875op/s
scenario:load:insecure-bank:profiling:high_load	better [-509.574µs; -226.291µs] or [-5.800%; -2.575%]	unstable [-42.740op/s; +88.490op/s] or [-8.096%; +16.762%]	8.419ms	550.781op/s	8.786ms	527.906op/s
scenario:load:petclinic:code_origins:high_load	worse [+1.529ms; +2.398ms] or [+3.405%; +5.340%]	unstable [-11.134op/s; +2.384op/s] or [-10.686%; +2.288%]	46.878ms	99.812op/s	44.914ms	104.188op/s
scenario:load:petclinic:profiling:high_load	better [-2.549ms; -1.570ms] or [-5.098%; -3.139%]	unstable [-2.813op/s; +10.888op/s] or [-3.006%; +11.634%]	47.948ms	97.625op/s	50.008ms	93.588op/s

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section baseline
no_agent (36.416 ms) : 36136, 36697
. : milestone, 36416,
appsec (48.976 ms) : 48534, 49417
. : milestone, 48976,
code_origins (44.914 ms) : 44529, 45299
. : milestone, 44914,
iast (45.337 ms) : 44934, 45739
. : milestone, 45337,
profiling (50.008 ms) : 49549, 50466
. : milestone, 50008,
tracing (43.036 ms) : 42671, 43401
. : milestone, 43036,
section candidate
no_agent (37.099 ms) : 36808, 37391
. : milestone, 37099,
appsec (48.922 ms) : 48493, 49351
. : milestone, 48922,
code_origins (46.878 ms) : 46455, 47300
. : milestone, 46878,
iast (45.76 ms) : 45361, 46159
. : milestone, 45760,
profiling (47.948 ms) : 47496, 48400
. : milestone, 47948,
tracing (44.074 ms) : 43689, 44459
. : milestone, 44074,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.416 ms [36.136 ms, 36.697 ms]	-
appsec	48.976 ms [48.534 ms, 49.417 ms]	12.559 ms (34.5%)
code_origins	44.914 ms [44.529 ms, 45.299 ms]	8.497 ms (23.3%)
iast	45.337 ms [44.934 ms, 45.739 ms]	8.92 ms (24.5%)
profiling	50.008 ms [49.549 ms, 50.466 ms]	13.591 ms (37.3%)
tracing	43.036 ms [42.671 ms, 43.401 ms]	6.62 ms (18.2%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	37.099 ms [36.808 ms, 37.391 ms]	-
appsec	48.922 ms [48.493 ms, 49.351 ms]	11.823 ms (31.9%)
code_origins	46.878 ms [46.455 ms, 47.3 ms]	9.778 ms (26.4%)
iast	45.76 ms [45.361 ms, 46.159 ms]	8.661 ms (23.3%)
profiling	47.948 ms [47.496 ms, 48.4 ms]	10.849 ms (29.2%)
tracing	44.074 ms [43.689 ms, 44.459 ms]	6.974 ms (18.8%)

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section baseline
no_agent (4.268 ms) : 4218, 4318
. : milestone, 4268,
iast (9.797 ms) : 9624, 9970
. : milestone, 9797,
iast_FULL (13.907 ms) : 13632, 14181
. : milestone, 13907,
iast_GLOBAL (10.529 ms) : 10343, 10715
. : milestone, 10529,
profiling (8.786 ms) : 8651, 8921
. : milestone, 8786,
tracing (7.325 ms) : 7221, 7429
. : milestone, 7325,
section candidate
no_agent (4.339 ms) : 4290, 4387
. : milestone, 4339,
iast (9.508 ms) : 9351, 9665
. : milestone, 9508,
iast_FULL (13.957 ms) : 13681, 14233
. : milestone, 13957,
iast_GLOBAL (10.565 ms) : 10382, 10748
. : milestone, 10565,
profiling (8.419 ms) : 8290, 8547
. : milestone, 8419,
tracing (7.603 ms) : 7487, 7719
. : milestone, 7603,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.268 ms [4.218 ms, 4.318 ms]	-
iast	9.797 ms [9.624 ms, 9.97 ms]	5.529 ms (129.5%)
iast_FULL	13.907 ms [13.632 ms, 14.181 ms]	9.639 ms (225.8%)
iast_GLOBAL	10.529 ms [10.343 ms, 10.715 ms]	6.261 ms (146.7%)
profiling	8.786 ms [8.651 ms, 8.921 ms]	4.519 ms (105.9%)
tracing	7.325 ms [7.221 ms, 7.429 ms]	3.057 ms (71.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.339 ms [4.29 ms, 4.387 ms]	-
iast	9.508 ms [9.351 ms, 9.665 ms]	5.169 ms (119.2%)
iast_FULL	13.957 ms [13.681 ms, 14.233 ms]	9.618 ms (221.7%)
iast_GLOBAL	10.565 ms [10.382 ms, 10.748 ms]	6.227 ms (143.5%)
profiling	8.419 ms [8.29 ms, 8.547 ms]	4.08 ms (94.0%)
tracing	7.603 ms [7.487 ms, 7.719 ms]	3.264 ms (75.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mattalp/baseline-flarereporter-smoketesting
git_commit_date	1756829606	1756841172
git_commit_sha	`0a4e9d0`	`d8ad90c`
release_version	1.53.0-SNAPSHOT~0a4e9d0069	1.53.0-SNAPSHOT~d8ad90c648

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1756843051	1756843051
ci_job_id	1109787629	1109787629
ci_pipeline_id	75338534	75338534
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-f91ukkiv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-f91ukkiv 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 0 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:dacapo:tomcat:appsec	better [-1.373ms; -1.030ms] or [-37.190%; -27.908%]	2.490ms	3.691ms

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
. : milestone, 1485,
appsec (3.691 ms) : 3472, 3910
. : milestone, 3691,
iast (2.228 ms) : 2164, 2291
. : milestone, 2228,
iast_GLOBAL (2.268 ms) : 2204, 2332
. : milestone, 2268,
profiling (2.062 ms) : 2011, 2112
. : milestone, 2062,
tracing (2.054 ms) : 2005, 2104
. : milestone, 2054,
section candidate
no_agent (1.487 ms) : 1475, 1498
. : milestone, 1487,
appsec (2.49 ms) : 2436, 2543
. : milestone, 2490,
iast (2.233 ms) : 2171, 2296
. : milestone, 2233,
iast_GLOBAL (2.257 ms) : 2193, 2320
. : milestone, 2257,
profiling (2.067 ms) : 2016, 2118
. : milestone, 2067,
tracing (2.03 ms) : 1981, 2079
. : milestone, 2030,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.485 ms [1.473 ms, 1.496 ms]	-
appsec	3.691 ms [3.472 ms, 3.91 ms]	2.206 ms (148.6%)
iast	2.228 ms [2.164 ms, 2.291 ms]	742.889 µs (50.0%)
iast_GLOBAL	2.268 ms [2.204 ms, 2.332 ms]	783.08 µs (52.7%)
profiling	2.062 ms [2.011 ms, 2.112 ms]	576.786 µs (38.8%)
tracing	2.054 ms [2.005 ms, 2.104 ms]	569.502 µs (38.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.487 ms [1.475 ms, 1.498 ms]	-
appsec	2.49 ms [2.436 ms, 2.543 ms]	1.003 ms (67.4%)
iast	2.233 ms [2.171 ms, 2.296 ms]	746.429 µs (50.2%)
iast_GLOBAL	2.257 ms [2.193 ms, 2.32 ms]	770.035 µs (51.8%)
profiling	2.067 ms [2.016 ms, 2.118 ms]	579.913 µs (39.0%)
tracing	2.03 ms [1.981 ms, 2.079 ms]	543.542 µs (36.6%)

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~d8ad90c648, baseline=1.53.0-SNAPSHOT~0a4e9d0069
dateFormat X
axisFormat %s
section baseline
no_agent (14.996 s) : 14996000, 14996000
. : milestone, 14996000,
appsec (14.816 s) : 14816000, 14816000
. : milestone, 14816000,
iast (18.095 s) : 18095000, 18095000
. : milestone, 18095000,
iast_GLOBAL (18.208 s) : 18208000, 18208000
. : milestone, 18208000,
profiling (15.296 s) : 15296000, 15296000
. : milestone, 15296000,
tracing (15.06 s) : 15060000, 15060000
. : milestone, 15060000,
section candidate
no_agent (15.266 s) : 15266000, 15266000
. : milestone, 15266000,
appsec (14.988 s) : 14988000, 14988000
. : milestone, 14988000,
iast (18.283 s) : 18283000, 18283000
. : milestone, 18283000,
iast_GLOBAL (18.331 s) : 18331000, 18331000
. : milestone, 18331000,
profiling (15.412 s) : 15412000, 15412000
. : milestone, 15412000,
tracing (14.981 s) : 14981000, 14981000
. : milestone, 14981000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.996 s [14.996 s, 14.996 s]	-
appsec	14.816 s [14.816 s, 14.816 s]	-180.0 ms (-1.2%)
iast	18.095 s [18.095 s, 18.095 s]	3.099 s (20.7%)
iast_GLOBAL	18.208 s [18.208 s, 18.208 s]	3.212 s (21.4%)
profiling	15.296 s [15.296 s, 15.296 s]	300.0 ms (2.0%)
tracing	15.06 s [15.06 s, 15.06 s]	64.0 ms (0.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.266 s [15.266 s, 15.266 s]	-
appsec	14.988 s [14.988 s, 14.988 s]	-278.0 ms (-1.8%)
iast	18.283 s [18.283 s, 18.283 s]	3.017 s (19.8%)
iast_GLOBAL	18.331 s [18.331 s, 18.331 s]	3.065 s (20.1%)
profiling	15.412 s [15.412 s, 15.412 s]	146.0 ms (1.0%)
tracing	14.981 s [14.981 s, 14.981 s]	-285.0 ms (-1.9%)

Matt added 3 commits August 29, 2025 18:48

Initial smoke tests for tracer flare functionality
5f837f1
Squashed 9 commits

Replace naive wait with file watching
2f8c79e

Increase TracerFlare smoke test time
84e5026

MattAlp requested review from a team as code owners September 2, 2025 19:25

MattAlp requested review from AlexeyKuznetsov-DD and amarziali September 2, 2025 19:25

Merge branch 'master' into mattalp/baseline-flarereporter-smoketesting
d8ad90c

MattAlp added type: bug fix Bug fix comp: testing Testing comp: profiling Profiling run-tests: oracle8 Run tests using Oracle 8 JDK labels Sep 2, 2025

DataDog deleted a comment from github-actionsBotSep 2, 2025

AlexeyKuznetsov-DD approved these changes Sep 2, 2025
View reviewed changes

amarziali approved these changes Sep 3, 2025
View reviewed changes

amarziali added the tag: no release notes Changes to exclude from release notes label Sep 3, 2025

jbachorik approved these changes Sep 3, 2025
View reviewed changes

AlexeyKuznetsov-DD merged commit 030f9bb into masterSep 3, 2025
675 of 680 checks passed

AlexeyKuznetsov-DD deleted the mattalp/baseline-flarereporter-smoketesting branch September 3, 2025 12:15

github-actionsBot added this to the 1.53.0 milestone Sep 3, 2025

Navigation Menu

Uh oh!

Increase flare reporter smoke test duration - #9452

Increase flare reporter smoke test duration#9452
AlexeyKuznetsov-DD merged 4 commits into
masterfrom
mattalp/baseline-flarereporter-smoketesting

MattAlp commented Sep 2, 2025•
edited
Loading

Uh oh!

datadog-officialBot commented Sep 2, 2025•
edited by datadog-datadog-prod-us1 Bot
Loading

Uh oh!

pr-commenterBot commented Sep 2, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Uh oh!

Conversation

MattAlp commented Sep 2, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

datadog-officialBot commented Sep 2, 2025• edited by datadog-datadog-prod-us1 BotLoading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenterBot commented Sep 2, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

MattAlp commented Sep 2, 2025•
edited
Loading

datadog-officialBot commented Sep 2, 2025•
edited by datadog-datadog-prod-us1 Bot
Loading