Don't run check-big-regressions on master or release branches by bric3 · Pull Request #9086 · DataDog/dd-trace-java

bric3 · 2025-07-02T15:15:23Z

What Does This Do

Up for discussion, whether running check-big-regression job on master.

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

github-actions · 2025-07-04T16:17:32Z

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

pr-commenter · 2025-07-04T16:51:31Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bdu/dont-run-check-big-regression-on-master
git_commit_date	1751896011	1751896480
git_commit_sha	`6cca46e`	`b04023d`
release_version	1.51.0-SNAPSHOT~6cca46e0b4	1.51.0-SNAPSHOT~b04023d86a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751898225	1751898225
ci_job_id	1016075635	1016075635
ci_pipeline_id	69777988	69777988
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-k6ls7b5o 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-k6ls7b5o 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 7 unstable metrics.

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (999.105 ms) : 0, 999105
Total [baseline] (10.617 s) : 0, 10616714
Agent [candidate] (995.382 ms) : 0, 995382
Total [candidate] (10.589 s) : 0, 10589058
section appsec
Agent [baseline] (1.176 s) : 0, 1176456
Total [baseline] (10.764 s) : 0, 10763717
Agent [candidate] (1.176 s) : 0, 1176279
Total [candidate] (10.745 s) : 0, 10744733
section iast
Agent [baseline] (1.144 s) : 0, 1143815
Total [baseline] (10.845 s) : 0, 10844785
Agent [candidate] (1.134 s) : 0, 1133897
Total [candidate] (10.847 s) : 0, 10847475
section profiling
Agent [baseline] (1.244 s) : 0, 1243991
Total [baseline] (10.886 s) : 0, 10886372
Agent [candidate] (1.248 s) : 0, 1247575
Total [candidate] (10.994 s) : 0, 10994238

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	999.105 ms	-
Agent	appsec	1.176 s	177.351 ms (17.8%)
Agent	iast	1.144 s	144.71 ms (14.5%)
Agent	profiling	1.244 s	244.886 ms (24.5%)
Total	tracing	10.617 s	-
Total	appsec	10.764 s	147.003 ms (1.4%)
Total	iast	10.845 s	228.071 ms (2.1%)
Total	profiling	10.886 s	269.657 ms (2.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	995.382 ms	-
Agent	appsec	1.176 s	180.897 ms (18.2%)
Agent	iast	1.134 s	138.515 ms (13.9%)
Agent	profiling	1.248 s	252.194 ms (25.3%)
Total	tracing	10.589 s	-
Total	appsec	10.745 s	155.675 ms (1.5%)
Total	iast	10.847 s	258.417 ms (2.4%)
Total	profiling	10.994 s	405.18 ms (3.8%)

gantt
title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (689.787 ms) : 0, 689787
BytebuddyAgent [candidate] (687.244 ms) : 0, 687244
GlobalTracer [baseline] (242.911 ms) : 0, 242911
GlobalTracer [candidate] (242.338 ms) : 0, 242338
AppSec [baseline] (30.484 ms) : 0, 30484
AppSec [candidate] (30.081 ms) : 0, 30081
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (6.019 ms) : 0, 6019
Remote Config [baseline] (677.79 µs) : 0, 678
Remote Config [candidate] (680.763 µs) : 0, 681
Telemetry [baseline] (8.198 ms) : 0, 8198
Telemetry [candidate] (8.199 ms) : 0, 8199
section appsec
BytebuddyAgent [baseline] (711.228 ms) : 0, 711228
BytebuddyAgent [candidate] (710.23 ms) : 0, 710230
GlobalTracer [baseline] (235.523 ms) : 0, 235523
GlobalTracer [candidate] (236.043 ms) : 0, 236043
IAST [baseline] (23.127 ms) : 0, 23127
IAST [candidate] (23.345 ms) : 0, 23345
AppSec [baseline] (171.146 ms) : 0, 171146
AppSec [candidate] (171.495 ms) : 0, 171495
Debugger [baseline] (5.778 ms) : 0, 5778
Debugger [candidate] (5.694 ms) : 0, 5694
Remote Config [baseline] (600.449 µs) : 0, 600
Remote Config [candidate] (594.403 µs) : 0, 594
Telemetry [baseline] (8.128 ms) : 0, 8128
Telemetry [candidate] (7.97 ms) : 0, 7970
section iast
BytebuddyAgent [baseline] (815.664 ms) : 0, 815664
BytebuddyAgent [candidate] (808.368 ms) : 0, 808368
GlobalTracer [baseline] (235.057 ms) : 0, 235057
GlobalTracer [candidate] (233.238 ms) : 0, 233238
IAST [baseline] (29.609 ms) : 0, 29609
IAST [candidate] (29.434 ms) : 0, 29434
AppSec [baseline] (27.177 ms) : 0, 27177
AppSec [candidate] (27.671 ms) : 0, 27671
Debugger [baseline] (6.719 ms) : 0, 6719
Debugger [candidate] (5.807 ms) : 0, 5807
Remote Config [baseline] (584.561 µs) : 0, 585
Remote Config [candidate] (579.963 µs) : 0, 580
Telemetry [baseline] (8.06 ms) : 0, 8060
Telemetry [candidate] (7.988 ms) : 0, 7988
section profiling
BytebuddyAgent [baseline] (677.415 ms) : 0, 677415
BytebuddyAgent [candidate] (679.178 ms) : 0, 679178
GlobalTracer [baseline] (361.424 ms) : 0, 361424
GlobalTracer [candidate] (362.673 ms) : 0, 362673
AppSec [baseline] (30.986 ms) : 0, 30986
AppSec [candidate] (31.051 ms) : 0, 31051
Debugger [baseline] (12.776 ms) : 0, 12776
Debugger [candidate] (12.984 ms) : 0, 12984
Remote Config [baseline] (668.15 µs) : 0, 668
Remote Config [candidate] (664.686 µs) : 0, 665
Telemetry [baseline] (8.662 ms) : 0, 8662
Telemetry [candidate] (8.794 ms) : 0, 8794
ProfilingAgent [baseline] (103.605 ms) : 0, 103605
ProfilingAgent [candidate] (103.54 ms) : 0, 103540
Profiling [baseline] (103.629 ms) : 0, 103629
Profiling [candidate] (103.564 ms) : 0, 103564

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (999.791 ms) : 0, 999791
Total [baseline] (8.602 s) : 0, 8602181
Agent [candidate] (1.002 s) : 0, 1001868
Total [candidate] (8.605 s) : 0, 8605296
section iast
Agent [baseline] (1.135 s) : 0, 1135350
Total [baseline] (9.315 s) : 0, 9315236
Agent [candidate] (1.144 s) : 0, 1144019
Total [candidate] (9.33 s) : 0, 9330455

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	999.791 ms	-
Agent	iast	1.135 s	135.559 ms (13.6%)
Total	tracing	8.602 s	-
Total	iast	9.315 s	713.055 ms (8.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.002 s	-
Agent	iast	1.144 s	142.15 ms (14.2%)
Total	tracing	8.605 s	-
Total	iast	9.33 s	725.159 ms (8.4%)

gantt
title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (690.901 ms) : 0, 690901
BytebuddyAgent [candidate] (691.938 ms) : 0, 691938
GlobalTracer [baseline] (242.56 ms) : 0, 242560
GlobalTracer [candidate] (243.466 ms) : 0, 243466
AppSec [baseline] (30.367 ms) : 0, 30367
AppSec [candidate] (30.517 ms) : 0, 30517
Debugger [baseline] (6.083 ms) : 0, 6083
Debugger [candidate] (6.093 ms) : 0, 6093
Remote Config [baseline] (683.655 µs) : 0, 684
Remote Config [candidate] (683.996 µs) : 0, 684
Telemetry [baseline] (8.291 ms) : 0, 8291
Telemetry [candidate] (8.275 ms) : 0, 8275
section iast
BytebuddyAgent [baseline] (809.081 ms) : 0, 809081
BytebuddyAgent [candidate] (815.903 ms) : 0, 815903
GlobalTracer [baseline] (233.422 ms) : 0, 233422
GlobalTracer [candidate] (234.769 ms) : 0, 234769
IAST [baseline] (28.733 ms) : 0, 28733
IAST [candidate] (28.201 ms) : 0, 28201
AppSec [baseline] (28.76 ms) : 0, 28760
AppSec [candidate] (29.531 ms) : 0, 29531
Debugger [baseline] (5.865 ms) : 0, 5865
Debugger [candidate] (5.865 ms) : 0, 5865
Remote Config [baseline] (580.244 µs) : 0, 580
Remote Config [candidate] (591.747 µs) : 0, 592
Telemetry [baseline] (8.071 ms) : 0, 8071
Telemetry [candidate] (8.163 ms) : 0, 8163

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bdu/dont-run-check-big-regression-on-master
git_commit_date	1751896011	1751896480
git_commit_sha	`6cca46e`	`b04023d`
release_version	1.51.0-SNAPSHOT~6cca46e0b4	1.51.0-SNAPSHOT~b04023d86a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751897985	1751897985
ci_job_id	1016075636	1016075636
ci_pipeline_id	69777988	69777988
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-gr6sc0ct 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-gr6sc0ct 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 1 performance regressions! Performance is the same for 8 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:no_agent:high_load	better [-261.554µs; -145.443µs] or [-5.765%; -3.206%]	unstable [-70.500op/s; +163.313op/s] or [-6.964%; +16.131%]	4.334ms	1058.812op/s	4.537ms	1012.406op/s
scenario:load:insecure-bank:tracing:high_load	worse [+189.171µs; +419.350µs] or [+2.581%; +5.722%]	unstable [-103.083op/s; +53.021op/s] or [-16.316%; +8.392%]	7.633ms	606.750op/s	7.329ms	631.781op/s
scenario:load:petclinic:no_agent:high_load	better [-1.527ms; -0.898ms] or [-4.139%; -2.435%]	unstable [-5.026op/s; +13.601op/s] or [-3.966%; +10.734%]	35.677ms	131.000op/s	36.890ms	126.713op/s
scenario:load:petclinic:appsec:high_load	better [-2.126ms; -1.215ms] or [-4.443%; -2.539%]	unstable [-4.156op/s; +11.081op/s] or [-4.248%; +11.327%]	46.192ms	101.287op/s	47.863ms	97.825op/s

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section baseline
no_agent (4.537 ms) : 4478, 4596
. : milestone, 4537,
iast (9.276 ms) : 9118, 9433
. : milestone, 9276,
iast_FULL (14.025 ms) : 13748, 14302
. : milestone, 14025,
iast_GLOBAL (10.362 ms) : 10183, 10542
. : milestone, 10362,
profiling (8.774 ms) : 8630, 8919
. : milestone, 8774,
tracing (7.329 ms) : 7222, 7435
. : milestone, 7329,
section candidate
no_agent (4.334 ms) : 4285, 4382
. : milestone, 4334,
iast (9.5 ms) : 9344, 9656
. : milestone, 9500,
iast_FULL (14.561 ms) : 14270, 14852
. : milestone, 14561,
iast_GLOBAL (10.164 ms) : 9975, 10352
. : milestone, 10164,
profiling (8.918 ms) : 8769, 9067
. : milestone, 8918,
tracing (7.633 ms) : 7525, 7740
. : milestone, 7633,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.537 ms [4.478 ms, 4.596 ms]	-
iast	9.276 ms [9.118 ms, 9.433 ms]	4.738 ms (104.4%)
iast_FULL	14.025 ms [13.748 ms, 14.302 ms]	9.488 ms (209.1%)
iast_GLOBAL	10.362 ms [10.183 ms, 10.542 ms]	5.825 ms (128.4%)
profiling	8.774 ms [8.63 ms, 8.919 ms]	4.237 ms (93.4%)
tracing	7.329 ms [7.222 ms, 7.435 ms]	2.791 ms (61.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.334 ms [4.285 ms, 4.382 ms]	-
iast	9.5 ms [9.344 ms, 9.656 ms]	5.167 ms (119.2%)
iast_FULL	14.561 ms [14.27 ms, 14.852 ms]	10.228 ms (236.0%)
iast_GLOBAL	10.164 ms [9.975 ms, 10.352 ms]	5.83 ms (134.5%)
profiling	8.918 ms [8.769 ms, 9.067 ms]	4.584 ms (105.8%)
tracing	7.633 ms [7.525 ms, 7.74 ms]	3.299 ms (76.1%)

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section baseline
no_agent (36.89 ms) : 36589, 37190
. : milestone, 36890,
appsec (47.863 ms) : 47432, 48294
. : milestone, 47863,
code_origins (44.641 ms) : 44258, 45024
. : milestone, 44641,
iast (45.16 ms) : 44757, 45562
. : milestone, 45160,
profiling (48.504 ms) : 48020, 48988
. : milestone, 48504,
tracing (44.028 ms) : 43647, 44409
. : milestone, 44028,
section candidate
no_agent (35.677 ms) : 35393, 35960
. : milestone, 35677,
appsec (46.192 ms) : 45777, 46608
. : milestone, 46192,
code_origins (45.936 ms) : 45534, 46337
. : milestone, 45936,
iast (45.502 ms) : 45094, 45911
. : milestone, 45502,
profiling (49.444 ms) : 48981, 49906
. : milestone, 49444,
tracing (44.703 ms) : 44313, 45093
. : milestone, 44703,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.89 ms [36.589 ms, 37.19 ms]	-
appsec	47.863 ms [47.432 ms, 48.294 ms]	10.974 ms (29.7%)
code_origins	44.641 ms [44.258 ms, 45.024 ms]	7.751 ms (21.0%)
iast	45.16 ms [44.757 ms, 45.562 ms]	8.27 ms (22.4%)
profiling	48.504 ms [48.02 ms, 48.988 ms]	11.615 ms (31.5%)
tracing	44.028 ms [43.647 ms, 44.409 ms]	7.139 ms (19.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	35.677 ms [35.393 ms, 35.96 ms]	-
appsec	46.192 ms [45.777 ms, 46.608 ms]	10.515 ms (29.5%)
code_origins	45.936 ms [45.534 ms, 46.337 ms]	10.259 ms (28.8%)
iast	45.502 ms [45.094 ms, 45.911 ms]	9.825 ms (27.5%)
profiling	49.444 ms [48.981 ms, 49.906 ms]	13.767 ms (38.6%)
tracing	44.703 ms [44.313 ms, 45.093 ms]	9.026 ms (25.3%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bdu/dont-run-check-big-regression-on-master
git_commit_date	1751896011	1751896480
git_commit_sha	`6cca46e`	`b04023d`
release_version	1.51.0-SNAPSHOT~6cca46e0b4	1.51.0-SNAPSHOT~b04023d86a

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1751898427	1751898427
ci_job_id	1016075637	1016075637
ci_pipeline_id	69777988	69777988
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-b84on53z 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-b84on53z 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section baseline
no_agent (15.667 s) : 15667000, 15667000
. : milestone, 15667000,
appsec (14.621 s) : 14621000, 14621000
. : milestone, 14621000,
iast (18.334 s) : 18334000, 18334000
. : milestone, 18334000,
iast_GLOBAL (17.957 s) : 17957000, 17957000
. : milestone, 17957000,
profiling (15.022 s) : 15022000, 15022000
. : milestone, 15022000,
tracing (14.668 s) : 14668000, 14668000
. : milestone, 14668000,
section candidate
no_agent (14.77 s) : 14770000, 14770000
. : milestone, 14770000,
appsec (14.714 s) : 14714000, 14714000
. : milestone, 14714000,
iast (18.457 s) : 18457000, 18457000
. : milestone, 18457000,
iast_GLOBAL (18.127 s) : 18127000, 18127000
. : milestone, 18127000,
profiling (15.014 s) : 15014000, 15014000
. : milestone, 15014000,
tracing (14.88 s) : 14880000, 14880000
. : milestone, 14880000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.667 s [15.667 s, 15.667 s]	-
appsec	14.621 s [14.621 s, 14.621 s]	-1.046 s (-6.7%)
iast	18.334 s [18.334 s, 18.334 s]	2.667 s (17.0%)
iast_GLOBAL	17.957 s [17.957 s, 17.957 s]	2.29 s (14.6%)
profiling	15.022 s [15.022 s, 15.022 s]	-645.0 ms (-4.1%)
tracing	14.668 s [14.668 s, 14.668 s]	-999.0 ms (-6.4%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.77 s [14.77 s, 14.77 s]	-
appsec	14.714 s [14.714 s, 14.714 s]	-56.0 ms (-0.4%)
iast	18.457 s [18.457 s, 18.457 s]	3.687 s (25.0%)
iast_GLOBAL	18.127 s [18.127 s, 18.127 s]	3.357 s (22.7%)
profiling	15.014 s [15.014 s, 15.014 s]	244.0 ms (1.7%)
tracing	14.88 s [14.88 s, 14.88 s]	110.0 ms (0.7%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~b04023d86a, baseline=1.51.0-SNAPSHOT~6cca46e0b4
dateFormat X
axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1495
. : milestone, 1483,
appsec (2.415 ms) : 2366, 2465
. : milestone, 2415,
iast (2.196 ms) : 2134, 2258
. : milestone, 2196,
iast_GLOBAL (2.24 ms) : 2178, 2302
. : milestone, 2240,
profiling (2.071 ms) : 2019, 2122
. : milestone, 2071,
tracing (2.016 ms) : 1968, 2064
. : milestone, 2016,
section candidate
no_agent (1.482 ms) : 1471, 1494
. : milestone, 1482,
appsec (2.402 ms) : 2353, 2452
. : milestone, 2402,
iast (2.195 ms) : 2133, 2258
. : milestone, 2195,
iast_GLOBAL (2.247 ms) : 2184, 2310
. : milestone, 2247,
profiling (2.053 ms) : 2002, 2104
. : milestone, 2053,
tracing (2.024 ms) : 1976, 2073
. : milestone, 2024,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.471 ms, 1.495 ms]	-
appsec	2.415 ms [2.366 ms, 2.465 ms]	932.431 µs (62.9%)
iast	2.196 ms [2.134 ms, 2.258 ms]	712.989 µs (48.1%)
iast_GLOBAL	2.24 ms [2.178 ms, 2.302 ms]	756.795 µs (51.0%)
profiling	2.071 ms [2.019 ms, 2.122 ms]	587.495 µs (39.6%)
tracing	2.016 ms [1.968 ms, 2.064 ms]	532.627 µs (35.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.482 ms [1.471 ms, 1.494 ms]	-
appsec	2.402 ms [2.353 ms, 2.452 ms]	920.006 µs (62.1%)
iast	2.195 ms [2.133 ms, 2.258 ms]	712.954 µs (48.1%)
iast_GLOBAL	2.247 ms [2.184 ms, 2.31 ms]	764.575 µs (51.6%)
profiling	2.053 ms [2.002 ms, 2.104 ms]	570.883 µs (38.5%)
tracing	2.024 ms [1.976 ms, 2.073 ms]	542.018 µs (36.6%)

…anches

bric3 requested review from a team, ddyurchenko and igoragoli July 2, 2025 15:22

ddyurchenko approved these changes Jul 4, 2025
View reviewed changes

bric3 marked this pull request as ready for review July 4, 2025 16:17

bric3 requested a review from a team as a code owner July 4, 2025 16:17

bric3 requested review from randomanderson and removed request for a teamJuly 4, 2025 16:17

bric3 enabled auto-merge (squash) July 4, 2025 16:17

bric3 force-pushed the bdu/dont-run-check-big-regression-on-master branch from 2e703c4 to 89fdf19Compare July 7, 2025 11:25

chore(build): don't run check-big-regressions on master or release br…
509bbde
…anches

bric3 force-pushed the bdu/dont-run-check-big-regression-on-master branch from 89fdf19 to 509bbdeCompare July 7, 2025 13:18

Merge branch 'master' into bdu/dont-run-check-big-regression-on-master
b04023d

bric3 added comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes tag: performance Performance related changes labels Jul 7, 2025

bric3 merged commit c01b987 into masterJul 7, 2025
509 of 511 checks passed

bric3 deleted the bdu/dont-run-check-big-regression-on-master branch July 7, 2025 14:48

github-actionsBot added this to the 1.51.0 milestone Jul 7, 2025

Navigation Menu

Uh oh!

Don't run check-big-regressions on master or release branches - #9086

Don't run check-big-regressions on master or release branches#9086
bric3 merged 2 commits into
masterfrom
bdu/dont-run-check-big-regression-on-master

bric3 commented Jul 2, 2025

Uh oh!

github-actionsBot commented Jul 4, 2025•
edited
Loading

Uh oh!

pr-commenterBot commented Jul 4, 2025•
edited
Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

bric3 commented Jul 2, 2025

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

github-actionsBot commented Jul 4, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pr-commenterBot commented Jul 4, 2025• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

github-actionsBot commented Jul 4, 2025•
edited
Loading

pr-commenterBot commented Jul 4, 2025•
edited
Loading