Add unit test for unix domain socket support by jpbempel · Pull Request #7766 · DataDog/dd-trace-java

jpbempel · 2024-10-15T13:12:59Z

What Does This Do

add unit test for avoid regression like #7166

Motivation

Additional Notes

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Squash your commits prior merging or merge using GitHub's Squash and merge
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

pr-commenter · 2024-10-15T13:35:38Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1728998577	1728998965
end_time	2024-10-15T13:24:12	2024-10-15T13:30:41
git_branch	master	jpbempel/test-unix-dom-socket
git_commit_sha	`d6c734c`	`db5b500`
start_time	2024-10-15T13:22:58	2024-10-15T13:29:26

See matching parameters

	Baseline	Candidate
ci_job_id	672446950	672446950
ci_pipeline_id	46615424	46615424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1728997907	1728997907

Summary

Found 3 performance improvements and 0 performance regressions! Performance is the same for 6 metrics, 6 unstable metrics.

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:loop	better [-326.491µs; -156.733µs] or [-3.031%; -1.455%]	better [-337.499µs; -156.597µs] or [-3.083%; -1.430%]	better [-345.534µs; -153.765µs] or [-3.135%; -1.395%]	same	unsure [+0.883op/s; +3.307op/s] or [+0.976%; +3.654%]

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-31.436µs; +18.222µs] or [-11.808%; +6.845%]	unstable [-41.834µs; +31.162µs] or [-13.705%; +10.209%]	unstable [-54.925µs; +41.849µs] or [-17.160%; +13.075%]	unstable [-116.868µs; +81.502µs] or [-19.416%; +13.540%]	same
scenario:basic	unsure [+2.648µs; +11.885µs] or [+0.997%; +4.477%]	same	same	unstable [-52.677µs; +41.387µs] or [-9.793%; +7.694%]	unstable [-230.969op/s; +96.016op/s] or [-8.777%; +3.649%]

Request duration reports for reports

gantt
title reports - request duration [CI 0.99] : candidate=None, baseline=None
dateFormat X
axisFormat %s
section baseline
noprobe (305.249 µs) : 263, 347
. : milestone, 305,
basic (293.734 µs) : 284, 304
. : milestone, 294,
loop (10.948 ms) : 10917, 10980
. : milestone, 10948,
section candidate
noprobe (299.913 µs) : 274, 326
. : milestone, 300,
basic (300.271 µs) : 292, 308
. : milestone, 300,
loop (10.701 ms) : 10587, 10816
. : milestone, 10701,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	305.249 µs [263.327 µs, 347.171 µs]
basic	293.734 µs [283.921 µs, 303.547 µs]
loop	10.948 ms [10.917 ms, 10.98 ms]

candidate results

Scenario	Request median duration [CI 0.99]
noprobe	299.913 µs [274.106 µs, 325.721 µs]
basic	300.271 µs [292.276 µs, 308.267 µs]
loop	10.701 ms [10.587 ms, 10.816 ms]

pr-commenter · 2024-10-15T13:58:19Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/test-unix-dom-socket
git_commit_date	1728980020	1728997907
git_commit_sha	`d6c734c`	`db5b500`
release_version	1.41.0-SNAPSHOT~d6c734ceba	1.41.0-SNAPSHOT~db5b50020f

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1729000528	1729000528
ci_job_id	672446938	672446938
ci_pipeline_id	46615424	46615424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 53 metrics, 10 unstable metrics.

Startup time reports for petclinic

gantt
title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071730
Total [baseline] (10.333 s) : 0, 10333187
Agent [candidate] (1.066 s) : 0, 1065525
Total [candidate] (10.409 s) : 0, 10409378
section appsec
Agent [baseline] (1.201 s) : 0, 1201181
Total [baseline] (10.572 s) : 0, 10571621
Agent [candidate] (1.212 s) : 0, 1212123
Total [candidate] (10.597 s) : 0, 10596636
section iast
Agent [baseline] (1.196 s) : 0, 1195875
Total [baseline] (10.811 s) : 0, 10811320
Agent [candidate] (1.203 s) : 0, 1203453
Total [candidate] (10.824 s) : 0, 10823783
section profiling
Agent [baseline] (1.264 s) : 0, 1264162
Total [baseline] (10.552 s) : 0, 10551728
Agent [candidate] (1.266 s) : 0, 1265598
Total [candidate] (10.684 s) : 0, 10684131

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.072 s	-
Agent	appsec	1.201 s	129.452 ms (12.1%)
Agent	iast	1.196 s	124.145 ms (11.6%)
Agent	profiling	1.264 s	192.432 ms (18.0%)
Total	tracing	10.333 s	-
Total	appsec	10.572 s	238.434 ms (2.3%)
Total	iast	10.811 s	478.132 ms (4.6%)
Total	profiling	10.552 s	218.541 ms (2.1%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.066 s	-
Agent	appsec	1.212 s	146.598 ms (13.8%)
Agent	iast	1.203 s	137.929 ms (12.9%)
Agent	profiling	1.266 s	200.073 ms (18.8%)
Total	tracing	10.409 s	-
Total	appsec	10.597 s	187.258 ms (1.8%)
Total	iast	10.824 s	414.405 ms (4.0%)
Total	profiling	10.684 s	274.754 ms (2.6%)

gantt
title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (684.75 ms) : 0, 684750
BytebuddyAgent [candidate] (680.192 ms) : 0, 680192
GlobalTracer [baseline] (311.296 ms) : 0, 311296
GlobalTracer [candidate] (309.858 ms) : 0, 309858
AppSec [baseline] (53.744 ms) : 0, 53744
AppSec [candidate] (53.734 ms) : 0, 53734
Remote Config [baseline] (673.631 µs) : 0, 674
Remote Config [candidate] (664.79 µs) : 0, 665
Telemetry [baseline] (7.573 ms) : 0, 7573
Telemetry [candidate] (7.481 ms) : 0, 7481
section appsec
BytebuddyAgent [baseline] (698.654 ms) : 0, 698654
BytebuddyAgent [candidate] (705.399 ms) : 0, 705399
GlobalTracer [baseline] (307.287 ms) : 0, 307287
GlobalTracer [candidate] (309.798 ms) : 0, 309798
AppSec [baseline] (162.915 ms) : 0, 162915
AppSec [candidate] (163.535 ms) : 0, 163535
IAST [baseline] (21.355 ms) : 0, 21355
IAST [candidate] (21.664 ms) : 0, 21664
Remote Config [baseline] (637.347 µs) : 0, 637
Remote Config [candidate] (638.094 µs) : 0, 638
Telemetry [baseline] (7.412 ms) : 0, 7412
Telemetry [candidate] (8.148 ms) : 0, 8148
section iast
BytebuddyAgent [baseline] (797.267 ms) : 0, 797267
BytebuddyAgent [candidate] (802.74 ms) : 0, 802740
GlobalTracer [baseline] (299.085 ms) : 0, 299085
GlobalTracer [candidate] (300.545 ms) : 0, 300545
AppSec [baseline] (56.289 ms) : 0, 56289
AppSec [candidate] (55.639 ms) : 0, 55639
IAST [baseline] (21.914 ms) : 0, 21914
IAST [candidate] (23.014 ms) : 0, 23014
Remote Config [baseline] (615.664 µs) : 0, 616
Remote Config [candidate] (614.447 µs) : 0, 614
Telemetry [baseline] (7.075 ms) : 0, 7075
Telemetry [candidate] (7.147 ms) : 0, 7147
section profiling
BytebuddyAgent [baseline] (674.435 ms) : 0, 674435
BytebuddyAgent [candidate] (675.289 ms) : 0, 675289
GlobalTracer [baseline] (392.967 ms) : 0, 392967
GlobalTracer [candidate] (392.649 ms) : 0, 392649
AppSec [baseline] (54.447 ms) : 0, 54447
AppSec [candidate] (54.484 ms) : 0, 54484
Remote Config [baseline] (652.704 µs) : 0, 653
Remote Config [candidate] (647.77 µs) : 0, 648
Telemetry [baseline] (7.398 ms) : 0, 7398
Telemetry [candidate] (7.373 ms) : 0, 7373
ProfilingAgent [baseline] (95.807 ms) : 0, 95807
ProfilingAgent [candidate] (96.576 ms) : 0, 96576
Profiling [baseline] (95.831 ms) : 0, 95831
Profiling [candidate] (96.599 ms) : 0, 96599

Startup time reports for insecure-bank

gantt
title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067651
Total [baseline] (8.539 s) : 0, 8538593
Agent [candidate] (1.074 s) : 0, 1073693
Total [candidate] (8.537 s) : 0, 8536631
section iast
Agent [baseline] (1.198 s) : 0, 1197840
Total [baseline] (9.054 s) : 0, 9053520
Agent [candidate] (1.202 s) : 0, 1201581
Total [candidate] (9.085 s) : 0, 9085054
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.192 s) : 0, 1192254
Total [baseline] (9.034 s) : 0, 9033790
Agent [candidate] (1.205 s) : 0, 1205398
Total [candidate] (9.096 s) : 0, 9095791
section iast_TELEMETRY_OFF
Agent [baseline] (1.19 s) : 0, 1190126
Total [baseline] (9.068 s) : 0, 9067735
Agent [candidate] (1.193 s) : 0, 1192561
Total [candidate] (9.045 s) : 0, 9045121

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.068 s	-
Agent	iast	1.198 s	130.189 ms (12.2%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.192 s	124.603 ms (11.7%)
Agent	iast_TELEMETRY_OFF	1.19 s	122.474 ms (11.5%)
Total	tracing	8.539 s	-
Total	iast	9.054 s	514.927 ms (6.0%)
Total	iast_HARDCODED_SECRET_DISABLED	9.034 s	495.198 ms (5.8%)
Total	iast_TELEMETRY_OFF	9.068 s	529.142 ms (6.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.074 s	-
Agent	iast	1.202 s	127.888 ms (11.9%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.205 s	131.704 ms (12.3%)
Agent	iast_TELEMETRY_OFF	1.193 s	118.868 ms (11.1%)
Total	tracing	8.537 s	-
Total	iast	9.085 s	548.423 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.096 s	559.159 ms (6.6%)
Total	iast_TELEMETRY_OFF	9.045 s	508.489 ms (6.0%)

gantt
title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.248 ms) : 0, 682248
BytebuddyAgent [candidate] (685.482 ms) : 0, 685482
GlobalTracer [baseline] (309.725 ms) : 0, 309725
GlobalTracer [candidate] (311.914 ms) : 0, 311914
AppSec [baseline] (53.828 ms) : 0, 53828
AppSec [candidate] (54.386 ms) : 0, 54386
Remote Config [baseline] (670.162 µs) : 0, 670
Remote Config [candidate] (671.968 µs) : 0, 672
Telemetry [baseline] (7.501 ms) : 0, 7501
Telemetry [candidate] (7.55 ms) : 0, 7550
section iast
BytebuddyAgent [baseline] (799.649 ms) : 0, 799649
BytebuddyAgent [candidate] (801.841 ms) : 0, 801841
GlobalTracer [baseline] (298.531 ms) : 0, 298531
GlobalTracer [candidate] (299.824 ms) : 0, 299824
AppSec [baseline] (55.411 ms) : 0, 55411
AppSec [candidate] (55.587 ms) : 0, 55587
IAST [baseline] (22.877 ms) : 0, 22877
IAST [candidate] (22.831 ms) : 0, 22831
Remote Config [baseline] (622.491 µs) : 0, 622
Remote Config [candidate] (615.932 µs) : 0, 616
Telemetry [baseline] (7.056 ms) : 0, 7056
Telemetry [candidate] (7.109 ms) : 0, 7109
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (794.466 ms) : 0, 794466
BytebuddyAgent [candidate] (802.846 ms) : 0, 802846
GlobalTracer [baseline] (298.488 ms) : 0, 298488
GlobalTracer [candidate] (301.714 ms) : 0, 301714
AppSec [baseline] (55.358 ms) : 0, 55358
AppSec [candidate] (53.11 ms) : 0, 53110
IAST [baseline] (22.668 ms) : 0, 22668
IAST [candidate] (26.302 ms) : 0, 26302
Remote Config [baseline] (605.849 µs) : 0, 606
Remote Config [candidate] (606.408 µs) : 0, 606
Telemetry [baseline] (7.02 ms) : 0, 7020
Telemetry [candidate] (7.036 ms) : 0, 7036
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (792.81 ms) : 0, 792810
BytebuddyAgent [candidate] (793.777 ms) : 0, 793777
GlobalTracer [baseline] (298.796 ms) : 0, 298796
GlobalTracer [candidate] (299.302 ms) : 0, 299302
AppSec [baseline] (55.773 ms) : 0, 55773
AppSec [candidate] (53.3 ms) : 0, 53300
IAST [baseline] (21.592 ms) : 0, 21592
IAST [candidate] (24.959 ms) : 0, 24959
Remote Config [baseline] (621.587 µs) : 0, 622
Remote Config [candidate] (624.925 µs) : 0, 625
Telemetry [baseline] (6.898 ms) : 0, 6898
Telemetry [candidate] (6.898 ms) : 0, 6898

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2024-10-15T13:23:58	2024-10-15T13:30:50
git_branch	master	jpbempel/test-unix-dom-socket
git_commit_date	1728980020	1728997907
git_commit_sha	`d6c734c`	`db5b500`
release_version	1.41.0-SNAPSHOT~d6c734ceba	1.41.0-SNAPSHOT~db5b50020f
start_time	2024-10-15T13:23:44	2024-10-15T13:30:36

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1728999401	1728999401
ci_job_id	672446941	672446941
ci_pipeline_id	46615424	46615424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	iast	iast

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 10 metrics, 17 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:petclinic:profiling	worse [+35.167µs; +89.209µs] or [+2.382%; +6.044%]	unstable [-651.763op/s; +405.610op/s] or [-20.368%; +12.675%]	1.538ms	3076.923op/s	1.476ms	3200.000op/s

Request duration reports for insecure-bank

gantt
title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section baseline
no_agent (371.06 µs) : 351, 391
. : milestone, 371,
iast (499.776 µs) : 478, 522
. : milestone, 500,
iast_FULL (567.673 µs) : 546, 589
. : milestone, 568,
iast_GLOBAL (513.268 µs) : 492, 535
. : milestone, 513,
iast_HARDCODED_SECRET_DISABLED (491.166 µs) : 470, 513
. : milestone, 491,
iast_INACTIVE (456.415 µs) : 435, 478
. : milestone, 456,
iast_TELEMETRY_OFF (483.053 µs) : 462, 504
. : milestone, 483,
tracing (455.972 µs) : 435, 477
. : milestone, 456,
section candidate
no_agent (370.238 µs) : 350, 390
. : milestone, 370,
iast (492.657 µs) : 471, 514
. : milestone, 493,
iast_FULL (562.819 µs) : 542, 584
. : milestone, 563,
iast_GLOBAL (511.529 µs) : 490, 533
. : milestone, 512,
iast_HARDCODED_SECRET_DISABLED (491.905 µs) : 471, 513
. : milestone, 492,
iast_INACTIVE (455.846 µs) : 435, 477
. : milestone, 456,
iast_TELEMETRY_OFF (477.174 µs) : 456, 498
. : milestone, 477,
tracing (454.465 µs) : 433, 476
. : milestone, 454,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	371.06 µs [351.24 µs, 390.879 µs]	-
iast	499.776 µs [477.707 µs, 521.845 µs]	128.716 µs (34.7%)
iast_FULL	567.673 µs [546.263 µs, 589.083 µs]	196.613 µs (53.0%)
iast_GLOBAL	513.268 µs [491.836 µs, 534.7 µs]	142.208 µs (38.3%)
iast_HARDCODED_SECRET_DISABLED	491.166 µs [469.819 µs, 512.514 µs]	120.107 µs (32.4%)
iast_INACTIVE	456.415 µs [435.11 µs, 477.721 µs]	85.356 µs (23.0%)
iast_TELEMETRY_OFF	483.053 µs [461.845 µs, 504.261 µs]	111.993 µs (30.2%)
tracing	455.972 µs [434.95 µs, 476.994 µs]	84.912 µs (22.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	370.238 µs [350.348 µs, 390.127 µs]	-
iast	492.657 µs [471.138 µs, 514.176 µs]	122.42 µs (33.1%)
iast_FULL	562.819 µs [541.615 µs, 584.022 µs]	192.581 µs (52.0%)
iast_GLOBAL	511.529 µs [490.36 µs, 532.697 µs]	141.291 µs (38.2%)
iast_HARDCODED_SECRET_DISABLED	491.905 µs [470.516 µs, 513.295 µs]	121.668 µs (32.9%)
iast_INACTIVE	455.846 µs [434.645 µs, 477.046 µs]	85.608 µs (23.1%)
iast_TELEMETRY_OFF	477.174 µs [455.908 µs, 498.44 µs]	106.936 µs (28.9%)
tracing	454.465 µs [433.077 µs, 475.853 µs]	84.227 µs (22.7%)

Request duration reports for petclinic

gantt
title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section baseline
no_agent (1.349 ms) : 1330, 1369
. : milestone, 1349,
appsec (1.723 ms) : 1698, 1748
. : milestone, 1723,
appsec_no_iast (1.721 ms) : 1697, 1744
. : milestone, 1721,
iast (1.478 ms) : 1455, 1501
. : milestone, 1478,
profiling (1.476 ms) : 1452, 1501
. : milestone, 1476,
tracing (1.459 ms) : 1434, 1483
. : milestone, 1459,
section candidate
no_agent (1.338 ms) : 1319, 1357
. : milestone, 1338,
appsec (1.723 ms) : 1699, 1747
. : milestone, 1723,
appsec_no_iast (1.729 ms) : 1706, 1753
. : milestone, 1729,
iast (1.497 ms) : 1474, 1520
. : milestone, 1497,
profiling (1.538 ms) : 1513, 1564
. : milestone, 1538,
tracing (1.479 ms) : 1454, 1503
. : milestone, 1479,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.349 ms [1.33 ms, 1.369 ms]	-
appsec	1.723 ms [1.698 ms, 1.748 ms]	373.46 µs (27.7%)
appsec_no_iast	1.721 ms [1.697 ms, 1.744 ms]	371.456 µs (27.5%)
iast	1.478 ms [1.455 ms, 1.501 ms]	128.793 µs (9.5%)
profiling	1.476 ms [1.452 ms, 1.501 ms]	126.874 µs (9.4%)
tracing	1.459 ms [1.434 ms, 1.483 ms]	109.521 µs (8.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.338 ms [1.319 ms, 1.357 ms]	-
appsec	1.723 ms [1.699 ms, 1.747 ms]	384.442 µs (28.7%)
appsec_no_iast	1.729 ms [1.706 ms, 1.753 ms]	390.83 µs (29.2%)
iast	1.497 ms [1.474 ms, 1.52 ms]	158.731 µs (11.9%)
profiling	1.538 ms [1.513 ms, 1.564 ms]	200.011 µs (14.9%)
tracing	1.479 ms [1.454 ms, 1.503 ms]	140.334 µs (10.5%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	jpbempel/test-unix-dom-socket
git_commit_date	1728980020	1728997907
git_commit_sha	`d6c734c`	`db5b500`
release_version	1.41.0-SNAPSHOT~d6c734ceba	1.41.0-SNAPSHOT~db5b50020f

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1728999947	1728999947
ci_job_id	672446943	672446943
ci_pipeline_id	46615424	46615424
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section baseline
no_agent (15.516 s) : 15516000, 15516000
. : milestone, 15516000,
appsec (15.261 s) : 15261000, 15261000
. : milestone, 15261000,
iast (18.88 s) : 18880000, 18880000
. : milestone, 18880000,
iast_GLOBAL (18.105 s) : 18105000, 18105000
. : milestone, 18105000,
profiling (14.9 s) : 14900000, 14900000
. : milestone, 14900000,
tracing (15.1 s) : 15100000, 15100000
. : milestone, 15100000,
section candidate
no_agent (15.545 s) : 15545000, 15545000
. : milestone, 15545000,
appsec (15.056 s) : 15056000, 15056000
. : milestone, 15056000,
iast (18.852 s) : 18852000, 18852000
. : milestone, 18852000,
iast_GLOBAL (18.175 s) : 18175000, 18175000
. : milestone, 18175000,
profiling (15.215 s) : 15215000, 15215000
. : milestone, 15215000,
tracing (15.452 s) : 15452000, 15452000
. : milestone, 15452000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.516 s [15.516 s, 15.516 s]	-
appsec	15.261 s [15.261 s, 15.261 s]	-255.0 ms (-1.6%)
iast	18.88 s [18.88 s, 18.88 s]	3.364 s (21.7%)
iast_GLOBAL	18.105 s [18.105 s, 18.105 s]	2.589 s (16.7%)
profiling	14.9 s [14.9 s, 14.9 s]	-616.0 ms (-4.0%)
tracing	15.1 s [15.1 s, 15.1 s]	-416.0 ms (-2.7%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.545 s [15.545 s, 15.545 s]	-
appsec	15.056 s [15.056 s, 15.056 s]	-489.0 ms (-3.1%)
iast	18.852 s [18.852 s, 18.852 s]	3.307 s (21.3%)
iast_GLOBAL	18.175 s [18.175 s, 18.175 s]	2.63 s (16.9%)
profiling	15.215 s [15.215 s, 15.215 s]	-330.0 ms (-2.1%)
tracing	15.452 s [15.452 s, 15.452 s]	-93.0 ms (-0.6%)

Execution time for tomcat

gantt
title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~db5b50020f, baseline=1.41.0-SNAPSHOT~d6c734ceba
dateFormat X
axisFormat %s
section baseline
no_agent (1.46 ms) : 1449, 1472
. : milestone, 1460,
appsec (2.311 ms) : 2271, 2352
. : milestone, 2311,
iast (2.068 ms) : 2016, 2120
. : milestone, 2068,
iast_GLOBAL (2.107 ms) : 2054, 2159
. : milestone, 2107,
profiling (1.917 ms) : 1876, 1958
. : milestone, 1917,
tracing (1.907 ms) : 1868, 1947
. : milestone, 1907,
section candidate
no_agent (1.463 ms) : 1451, 1474
. : milestone, 1463,
appsec (2.331 ms) : 2290, 2373
. : milestone, 2331,
iast (2.07 ms) : 2018, 2122
. : milestone, 2070,
iast_GLOBAL (2.105 ms) : 2053, 2157
. : milestone, 2105,
profiling (1.94 ms) : 1899, 1982
. : milestone, 1940,
tracing (1.911 ms) : 1871, 1950
. : milestone, 1911,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.46 ms [1.449 ms, 1.472 ms]	-
appsec	2.311 ms [2.271 ms, 2.352 ms]	851.258 µs (58.3%)
iast	2.068 ms [2.016 ms, 2.12 ms]	607.611 µs (41.6%)
iast_GLOBAL	2.107 ms [2.054 ms, 2.159 ms]	646.469 µs (44.3%)
profiling	1.917 ms [1.876 ms, 1.958 ms]	457.244 µs (31.3%)
tracing	1.907 ms [1.868 ms, 1.947 ms]	447.122 µs (30.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.463 ms [1.451 ms, 1.474 ms]	-
appsec	2.331 ms [2.29 ms, 2.373 ms]	868.71 µs (59.4%)
iast	2.07 ms [2.018 ms, 2.122 ms]	607.486 µs (41.5%)
iast_GLOBAL	2.105 ms [2.053 ms, 2.157 ms]	642.458 µs (43.9%)
profiling	1.94 ms [1.899 ms, 1.982 ms]	477.644 µs (32.7%)
tracing	1.911 ms [1.871 ms, 1.95 ms]	447.789 µs (30.6%)

Add unit test for unix domain socket support
db5b500

jpbempel added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: debugger Dynamic Instrumentation labels Oct 15, 2024

jpbempel requested review from a team as code owners October 15, 2024 13:13

jpbempel requested review from ojung and ygree and removed request for a teamOctober 15, 2024 13:13

ojung approved these changes Oct 15, 2024
View reviewed changes

jpbempel merged commit a1c2f48 into masterOct 15, 2024

jpbempel deleted the jpbempel/test-unix-dom-socket branch October 15, 2024 15:58

github-actionsBot added this to the 1.41.0 milestone Oct 15, 2024

Navigation Menu

Uh oh!

Add unit test for unix domain socket support - #7766

Add unit test for unix domain socket support#7766
jpbempel merged 1 commit into
masterfrom
jpbempel/test-unix-dom-socket

jpbempel commented Oct 15, 2024

Uh oh!

pr-commenterBot commented Oct 15, 2024

Uh oh!

pr-commenterBot commented Oct 15, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Conversation

jpbempel commented Oct 15, 2024

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenterBot commented Oct 15, 2024

Debugger benchmarks

Parameters

Summary

Uh oh!

pr-commenterBot commented Oct 15, 2024

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants