Skip to content

Fixing and simplifying background compiler benchmarks - #16501

Merged
psfinaki merged 3 commits into
mainfrom
bench/8
Jan 8, 2024
Merged

Fixing and simplifying background compiler benchmarks#16501
psfinaki merged 3 commits into
mainfrom
bench/8

Conversation

@psfinaki

Copy link
Copy Markdown
Contributor

2 of 8 benchmarks were broken here.

MethodUseGetSourceUseChangeNotificationsEmptyCacheMeanErrorStdDevMedianGen0Gen1Allocated
ExampleWorkflowFalseFalseFalse6.248 s0.3708 s1.0150 s5.761 s5000.00001000.00006032595592 B
ExampleWorkflowFalseFalseTrue6.919 s0.3501 s0.9760 s6.648 s5000.00001000.00006143764208 B
ExampleWorkflowFalseTrueFalse7.086 s0.1505 s0.4318 s7.074 s5000.00001000.00006032798168 B
ExampleWorkflowFalseTrueTrue6.951 s0.1351 s0.2401 s6.888 s5000.00001000.00006144653048 B
ExampleWorkflowTrueFalseFalseNANANANA---
ExampleWorkflowTrueFalseTrueNANANANA---
ExampleWorkflowTrueTrueFalse7.376 s0.3092 s0.9019 s7.344 s5000.00001000.00006041351816 B
ExampleWorkflowTrueTrueTrue6.129 s0.1767 s0.5097 s5.905 s5000.00001000.00006151601544 B

After a brief consultation with @0101, decided to keep the benchmark for the exemplary purposes but to shrink it to the scenarios that work and make the most sense.

Current benchmark results on my machine.


// * Summary *

BenchmarkDotNet=v0.13.2, OS=Windows 11 (10.0.22621.2861)
11th Gen Intel Core i7-1185G7 3.00GHz, 1 CPU, 8 logical and 4 physical cores
.NET SDK=8.0.100
[Host] : .NET 8.0.0 (8.0.23.53103), X64 RyuJIT AVX2 DEBUG
Job-ZMGPSB : .NET 8.0.0 (8.0.23.53103), X64 RyuJIT AVX2

InvocationCount=1 UnrollFactor=1

MethodUseChangeNotificationsEmptyCacheMeanErrorStdDevMedianGen0Gen1Allocated
ExampleWorkflowFalseFalse6.749 s0.3663 s1.0090 s6.266 s5000.00001000.00005.62 GB
ExampleWorkflowFalseTrue6.729 s0.2630 s0.7502 s6.410 s5000.00001000.00005.72 GB
ExampleWorkflowTrueFalse6.925 s0.3304 s0.9534 s6.583 s5000.00001000.00005.63 GB
ExampleWorkflowTrueTrue6.656 s0.2270 s0.6366 s6.433 s5000.00001000.00005.73 GB

@psfinaki
psfinaki requested a review from a team as a code ownerJanuary 8, 2024 14:59
@psfinaki
psfinaki requested a review from 0101January 8, 2024 14:59
@github-actions

Copy link
Copy Markdown
Contributor

✅ No release notes required

Comment threadtests/FSharp.Test.Utilities/ProjectGeneration.fs
0101
0101 approved these changes Jan 8, 2024
@psfinaki
psfinaki merged commit 777da0a into mainJan 8, 2024
@psfinaki
psfinaki deleted the bench/8 branch January 8, 2024 16:31
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

Archived in project

Development

Successfully merging this pull request may close these issues.

3 participants

@psfinaki@0101@abonie