Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

Description

@performanceautofiler

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Collections.CtorDefaultSize<Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

graph
graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Collections.TryAddDefaultSize<Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Collections.CreateAddAndClear<Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in System.Collections.Concurrent.IsEmpty<String>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturearm64
OSWindows 10.0.25094
Baselineee5b738d482b2bf72a5d6aab486e770490ade194
Comparebb97114906869daef02425e7c2f971bad6d97d64
DiffDiff

Regressions in BenchmarksGame.SpectralNorm_3

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
Details

Payloads

Baseline
Compare

Histogram

BenchmarksGame.SpectralNorm_3.RunBench

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Labels

area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

    , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
     blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
    }
    } catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
    })();
    (function(){
    try {
    var __m = "github.com";
    var __re = new RegExp('^' + "github\\.com" + '
    
    Skip to content

    Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

    Description

    @performanceautofiler

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Collections.CtorDefaultSize<Int32>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    ### Run Information
    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
    SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
    SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
    SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
    SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

    graph
    graph
    graph
    graph
    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
    ```log
    

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
    ```log
    

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
    ```log
    

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
    ```log
    

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Collections.TryAddDefaultSize<Int32>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Collections.CreateAddAndClear<Int32>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in System.Collections.Concurrent.IsEmpty<String>

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Run Information

    Architecturearm64
    OSWindows 10.0.25094
    Baselineee5b738d482b2bf72a5d6aab486e770490ade194
    Comparebb97114906869daef02425e7c2f971bad6d97d64
    DiffDiff

    Regressions in BenchmarksGame.SpectralNorm_3

    BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
    RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

    graph
    Test Report

    Repro

    git clone https://github.com/dotnet/performance.git
    py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
    Details

    Payloads

    Baseline
    Compare

    Histogram

    BenchmarksGame.SpectralNorm_3.RunBench

    Description of detection logic

    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
    IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
    IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
    IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
    IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
    IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
    IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
    

    Docs

    Profiling workflow for dotnet/runtime repository
    Benchmarking workflow for dotnet/runtime repository

    Metadata

    Metadata

    Assignees

    Labels

    area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
      Skip to content

      Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

      Description

      @performanceautofiler

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Collections.CtorDefaultSize<Int32>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      ### Run Information
      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
      SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
      SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
      SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
      SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

      graph
      graph
      graph
      graph
      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Collections.TryAddDefaultSize<Int32>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Collections.CreateAddAndClear<Int32>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in System.Collections.Concurrent.IsEmpty<String>

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturearm64
      OSWindows 10.0.25094
      Baselineee5b738d482b2bf72a5d6aab486e770490ade194
      Comparebb97114906869daef02425e7c2f971bad6d97d64
      DiffDiff

      Regressions in BenchmarksGame.SpectralNorm_3

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

      graph
      Test Report

      Repro

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      BenchmarksGame.SpectralNorm_3.RunBench

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
      IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
      IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Metadata

      Metadata

      Assignees

      Labels

      area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

      Type

      No type

      Projects

      No projects

        Milestone

        Relationships

        None yet

        Development

        No branches or pull requests

        Issue actions

        , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
        Skip to content

        Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

        Description

        @performanceautofiler

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Collections.CtorDefaultSize<Int32>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        ### Run Information
        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
        SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
        SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
        SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
        SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

        graph
        graph
        graph
        graph
        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
        ```log
        

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
        ```log
        

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
        ```log
        

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
        ```log
        

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Collections.TryAddDefaultSize<Int32>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Collections.CreateAddAndClear<Int32>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in System.Collections.Concurrent.IsEmpty<String>

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Run Information

        Architecturearm64
        OSWindows 10.0.25094
        Baselineee5b738d482b2bf72a5d6aab486e770490ade194
        Comparebb97114906869daef02425e7c2f971bad6d97d64
        DiffDiff

        Regressions in BenchmarksGame.SpectralNorm_3

        BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
        RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

        graph
        Test Report

        Repro

        git clone https://github.com/dotnet/performance.git
        py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
        Details

        Payloads

        Baseline
        Compare

        Histogram

        BenchmarksGame.SpectralNorm_3.RunBench

        Description of detection logic

        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
        IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
        IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
        IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
        IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
        IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
        IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
        

        Docs

        Profiling workflow for dotnet/runtime repository
        Benchmarking workflow for dotnet/runtime repository

        Metadata

        Metadata

        Assignees

        Labels

        area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

        Type

        No type

        Projects

        No projects

          Milestone

          Relationships

          None yet

          Development

          No branches or pull requests

          Issue actions

          , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
          Skip to content

          Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

          Description

          @performanceautofiler

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Collections.CtorDefaultSize<Int32>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          ### Run Information
          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
          SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
          SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
          SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
          SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

          graph
          graph
          graph
          graph
          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Collections.TryAddDefaultSize<Int32>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Collections.CreateAddAndClear<Int32>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in System.Collections.Concurrent.IsEmpty<String>

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturearm64
          OSWindows 10.0.25094
          Baselineee5b738d482b2bf72a5d6aab486e770490ade194
          Comparebb97114906869daef02425e7c2f971bad6d97d64
          DiffDiff

          Regressions in BenchmarksGame.SpectralNorm_3

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

          graph
          Test Report

          Repro

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          BenchmarksGame.SpectralNorm_3.RunBench

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
          IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
          IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Metadata

          Metadata

          Assignees

          Labels

          area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

          Type

          No type

          Projects

          No projects

            Milestone

            Relationships

            None yet

            Development

            No branches or pull requests

            Issue actions

            , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
            Skip to content

            Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

            Description

            @performanceautofiler

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Collections.CtorDefaultSize<Int32>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            ### Run Information
            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
            SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
            SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
            SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
            SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

            graph
            graph
            graph
            graph
            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
            ```log
            

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
            ```log
            

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
            ```log
            

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
            ```log
            

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Collections.TryAddDefaultSize<Int32>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Collections.CreateAddAndClear<Int32>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in System.Collections.Concurrent.IsEmpty<String>

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Run Information

            Architecturearm64
            OSWindows 10.0.25094
            Baselineee5b738d482b2bf72a5d6aab486e770490ade194
            Comparebb97114906869daef02425e7c2f971bad6d97d64
            DiffDiff

            Regressions in BenchmarksGame.SpectralNorm_3

            BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
            RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

            graph
            Test Report

            Repro

            git clone https://github.com/dotnet/performance.git
            py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
            Details

            Payloads

            Baseline
            Compare

            Histogram

            BenchmarksGame.SpectralNorm_3.RunBench

            Description of detection logic

            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
            IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
            IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
            IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
            IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
            IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
            IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
            

            Docs

            Profiling workflow for dotnet/runtime repository
            Benchmarking workflow for dotnet/runtime repository

            Metadata

            Metadata

            Assignees

            Labels

            area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

            Type

            No type

            Projects

            No projects

              Milestone

              Relationships

              None yet

              Development

              No branches or pull requests

              Issue actions

              , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
              Skip to content

              Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

              Description

              @performanceautofiler

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Collections.CtorDefaultSize<Int32>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              ### Run Information
              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
              SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
              SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
              SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
              SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

              graph
              graph
              graph
              graph
              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Collections.TryAddDefaultSize<Int32>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Collections.CreateAddAndClear<Int32>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in System.Collections.Concurrent.IsEmpty<String>

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturearm64
              OSWindows 10.0.25094
              Baselineee5b738d482b2bf72a5d6aab486e770490ade194
              Comparebb97114906869daef02425e7c2f971bad6d97d64
              DiffDiff

              Regressions in BenchmarksGame.SpectralNorm_3

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

              graph
              Test Report

              Repro

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              BenchmarksGame.SpectralNorm_3.RunBench

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
              IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
              IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Metadata

              Metadata

              Assignees

              Labels

              area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

              Type

              No type

              Projects

              No projects

                Milestone

                Relationships

                None yet

                Development

                No branches or pull requests

                Issue actions

                , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
                Skip to content

                Regression in BenchmarksGame.SpectralNorm_3.RunBench #79178

                Description

                @performanceautofiler

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Collections.CtorDefaultSize<Int32>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                ConcurrentDictionary - Duration of single invocation398.93 ns1.56 μs3.900.71False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorDefaultSize&lt;Int32&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Collections.CtorDefaultSize<Int32>.ConcurrentDictionary

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -3.764189811332933 (T) = (0 -1466.1697547435504) / Math.Sqrt((195045.37524450794 / (6)) + (16154.364848186735 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.8729246379270864 = (782.8236785684427 - 1466.1697547435504) / 782.8236785684427 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                ### Run Information
                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Buffers.Tests.RentReturnArrayPoolTests<Byte>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                SingleParallel - Duration of single invocation10.64 μs50.98 μs4.790.58False
                SingleParallel - Duration of single invocation64.18 ns217.17 ns3.380.71False
                SingleParallel - Duration of single invocation1.84 μs8.41 μs4.570.60False
                SingleParallel - Duration of single invocation11.03 μs55.69 μs5.050.54False
                SingleParallel - Duration of single invocation11.57 μs12.76 μs1.100.54False

                graph
                graph
                graph
                graph
                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Buffers.Tests.RentReturnArrayPoolTests<Byte>.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: True, UseSharedPool: False)

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -3.404825682825995 (T) = (0 -50655.35255340683) / Math.Sqrt((301564967.29012877 / (6)) + (2322324.7785957134 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9114218325834994 = (26501.398953333333 - 50655.35255340683) / 26501.398953333333 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: True)
                ```log
                

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -5.905333015052591 (T) = (0 -219.1578288135524) / Math.Sqrt((1777.8507405102741 / (6)) + (818.7176138614402 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.9279021597673053 = (113.67684179574985 - 219.1578288135524) / 113.67684179574985 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: True)
                ```log
                

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -5.748635253673775 (T) = (0 -7598.546598426023) / Math.Sqrt((2951969.155684131 / (5)) + (986337.9749516164 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -1.466953639152025 = (3080.1335208868777 - 7598.546598426023) / 3080.1335208868777 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: True, Async: False, UseSharedPool: False)
                ```log
                

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -4.20978470839608 (T) = (0 -54438.23243373626) / Math.Sqrt((273130745.75530803 / (5)) + (3112536.6934363293 / (37))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (37) - 2, .025) and -1.3364074579014957 = (23299.973747999997 - 54438.23243373626) / 23299.973747999997 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                ```#### System.Buffers.Tests.RentReturnArrayPoolTests&lt;Byte&gt;.SingleParallel(RentalSize: 4096, ManipulateArray: False, Async: False, UseSharedPool: False)
                ```log
                

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 5:14:51 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -2.957375517339656 (T) = (0 -14097.843935134706) / Math.Sqrt((23007565.529022705 / (5)) + (1054842.9475649332 / (36))) is less than -2.0226909200346674 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (5) + (36) - 2, .025) and -0.8228939212782949 = (7733.770885169592 - 14097.843935134706) / 7733.770885169592 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Collections.TryAddDefaultSize<Int32>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                ConcurrentDictionary - Duration of single invocation108.02 μs152.02 μs1.410.70False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryAddDefaultSize&lt;Int32&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Collections.TryAddDefaultSize<Int32>.ConcurrentDictionary(Count: 512)

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 6/22/2022 11:10:17 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -7.207636407145145 (T) = (0 -153359.26107124833) / Math.Sqrt((105215729.89492527 / (6)) + (114948250.7533222 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2722310281836673 = (120543.5629802203 - 153359.26107124833) / 120543.5629802203 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Collections.ContainsKeyFalse<Int32, Int32>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                ConcurrentDictionary - Duration of single invocation8.25 μs10.16 μs1.230.72False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsKeyFalse&lt;Int32, Int32&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Collections.ContainsKeyFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -6.768329737364618 (T) = (0 -9733.575794494174) / Math.Sqrt((330922.69957275706 / (6)) + (1148771.7892948198 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.2581417513944518 = (7736.469903892817 - 9733.575794494174) / 7736.469903892817 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Collections.CreateAddAndClear<Int32>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                ConcurrentDictionary - Duration of single invocation117.56 μs166.58 μs1.420.73False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CreateAddAndClear&lt;Int32&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Collections.CreateAddAndClear<Int32>.ConcurrentDictionary(Size: 512)

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 6/22/2022 1:08:18 PM, 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -6.2938946422853395 (T) = (0 -197377.1850791642) / Math.Sqrt((533659365.80713236 / (6)) + (265353228.98127037 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.4554868653860941 = (135609.0458616446 - 197377.1850791642) / 135609.0458616446 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Collections.TryGetValueFalse<Int32, Int32>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                ConcurrentDictionary - Duration of single invocation6.12 μs10.72 μs1.750.67False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.TryGetValueFalse&lt;Int32, Int32&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Collections.TryGetValueFalse<Int32, Int32>.ConcurrentDictionary(Size: 512)

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -4.0807930312536165 (T) = (0 -8448.165153384609) / Math.Sqrt((546131.0221927919 / (6)) + (705153.0284785373 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -0.19139679485266783 = (7090.9752232708815 - 8448.165153384609) / 7090.9752232708815 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in System.Collections.Concurrent.IsEmpty<String>

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                Dictionary - Duration of single invocation633.59 ns2.49 μs3.930.75False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Concurrent.IsEmpty&lt;String&gt;*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                System.Collections.Concurrent.IsEmpty<String>.Dictionary(Size: 0)

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -4.956551800551829 (T) = (0 -2596.5709583118833) / Math.Sqrt((520326.0295450867 / (6)) + (83911.90097717417 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.3236399162681527 = (1117.458406585676 - 2596.5709583118833) / 1117.458406585676 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Run Information

                Architecturearm64
                OSWindows 10.0.25094
                Baselineee5b738d482b2bf72a5d6aab486e770490ade194
                Comparebb97114906869daef02425e7c2f971bad6d97d64
                DiffDiff

                Regressions in BenchmarksGame.SpectralNorm_3

                BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                RunBench - Duration of single invocation17.24 ms22.87 ms1.330.65False

                graph
                Test Report

                Repro

                git clone https://github.com/dotnet/performance.git
                py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'BenchmarksGame.SpectralNorm_3*'
                Details

                Payloads

                Baseline
                Compare

                Histogram

                BenchmarksGame.SpectralNorm_3.RunBench

                Description of detection logic

                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
                IsChangePoint: Marked as a change because one of 8/10/2022 11:28:06 PM, 8/18/2022 11:13:04 AM falls between 8/9/2022 9:33:37 PM and 8/18/2022 11:13:04 AM.
                IsRegressionStdDev: Marked as regression because -4.60418331078665 (T) = (0 -25129659.398106743) / Math.Sqrt((49905291396343.64 / (6)) + (8336890832618.489 / (36))) is less than -2.0210753903043583 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (6) + (36) - 2, .025) and -1.1538101496463542 = (11667536.900702653 - 25129659.398106743) / 11667536.900702653 is less than -0.05.
                IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                

                Docs

                Profiling workflow for dotnet/runtime repository
                Benchmarking workflow for dotnet/runtime repository

                Metadata

                Metadata

                Assignees

                Labels

                area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMItenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

                Type

                No type

                Projects

                No projects

                  Milestone

                  Relationships

                  None yet

                  Development

                  No branches or pull requests

                  Issue actions