Skip to content

Perf regressions in Perf_Matrix benchmarks #59415

Description

@performanceautofiler

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.IO.Tests.BinaryWriterTests

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
WriteAsciiChar - Duration of single invocation3.44 ns4.71 ns1.370.17True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.BinaryWriterTests*'
Details

Payloads

Baseline
Compare

Histogram

System.IO.Tests.BinaryWriterTests.WriteAsciiChar

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information
Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Numerics.Tests.Perf_Matrix3x2

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
InequalityOperatorBenchmark - Duration of single invocation6.33 ns12.21 ns1.930.07True
LerpBenchmark - Duration of single invocation8.16 ns13.30 ns1.630.04True
NegationOperatorBenchmark - Duration of single invocation6.35 ns10.87 ns1.710.10False
AddBenchmark - Duration of single invocation8.96 ns15.89 ns1.770.08True

graph
graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Matrix3x2*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Matrix3x2.InequalityOperatorBenchmark

System.Numerics.Tests.Perf_Matrix3x2.LerpBenchmark

System.Numerics.Tests.Perf_Matrix3x2.NegationOperatorBenchmark

System.Numerics.Tests.Perf_Matrix3x2.AddBenchmark

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Text.Json.Serialization.Tests.ReadJson<Nullable<DateTimeOffset>>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
DeserializeFromUtf8Bytes - Duration of single invocation130.22 ns140.77 ns1.080.05True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.Json.Serialization.Tests.ReadJson&lt;Nullable&lt;DateTimeOffset&gt;&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Text.Json.Serialization.Tests.ReadJson<Nullable<DateTimeOffset>>.DeserializeFromUtf8Bytes

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Collections.Sort<BigStruct>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
Array_ComparerStruct - Duration of single invocation33.94 μs46.92 μs1.380.02True
Array_Comparison - Duration of single invocation30.67 μs45.16 μs1.470.03True
Array_ComparerClass - Duration of single invocation31.22 μs44.95 μs1.440.07True

graph
graph
graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort&lt;BigStruct&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<BigStruct>.Array_ComparerStruct(Size: 512)

System.Collections.Sort<BigStruct>.Array_Comparison(Size: 512)

System.Collections.Sort<BigStruct>.Array_ComparerClass(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Collections.IterateForEachNonGeneric<Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
Queue - Duration of single invocation3.61 μs3.85 μs1.070.06False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEachNonGeneric&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEachNonGeneric<Int32>.Queue(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Collections.IterateForEach<Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ConcurrentStack - Duration of single invocation2.49 μs2.69 μs1.080.01False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateForEach&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.IterateForEach<Int32>.ConcurrentStack(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Collections.ContainsFalse<Int32>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
ImmutableSortedSet - Duration of single invocation28.60 μs31.25 μs1.090.00True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.ContainsFalse&lt;Int32&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Collections.ContainsFalse<Int32>.ImmutableSortedSet(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Numerics.Tests.Perf_Vector2

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
TransformNormalByMatrix3x2Benchmark - Duration of single invocation1.99 ns8.09 ns4.060.14True

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Numerics.Tests.Perf_Vector2*'
Details

Payloads

Baseline
Compare

Histogram

System.Numerics.Tests.Perf_Vector2.TransformNormalByMatrix3x2Benchmark

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Memory.Span<Byte>

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
SequenceCompareTo - Duration of single invocation9.92 ns12.15 ns1.230.08False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Memory.Span&lt;Byte&gt;*'
Details

Payloads

Baseline
Compare

Histogram

System.Memory.Span<Byte>.SequenceCompareTo(Size: 512)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSubuntu 18.04
Baseline10b2f7c858934c27c56aa13845cb47064bfe87e9
Comparea842e7a1dc6c241c928c6291411393cdb2516608
DiffDiff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Common

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
Uri_IsMatch - Duration of single invocation132.85 ns143.51 ns1.080.04False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Common*'
Details

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Common.Uri_IsMatch(Options: IgnoreCase, Compiled)

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Labels

arch-x64area-CodeGen-coreclrCLR JIT compiler in src/coreclr/src/jit and related components such as SuperPMIos-linuxLinux OS (any supported distro)tenet-performancePerformance related issuetenet-performance-benchmarksIssue from performance benchmark

Type

No type

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions