Regressions in System.Text.RegularExpressions.Tests #83399

Description

@performanceautofiler

Run Information

Architecturex64
OSalpine 3.15
Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
DiffDiff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
Details

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Run Information

Architecturex64
OSalpine 3.15
Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
DiffDiff

Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

graph
Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

Payloads

Baseline
Compare

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
Details

Payloads

Baseline
Compare

Histogram

System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

      Milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions

      , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
       blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
      }
      } catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
      })();
      (function(){
      try {
      var __m = "github.com";
      var __re = new RegExp('^' + "github\\.com" + '
      
      Skip to content

      Regressions in System.Text.RegularExpressions.Tests #83399

      Description

      @performanceautofiler

      Run Information

      Architecturex64
      OSalpine 3.15
      Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
      Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
      DiffDiff

      Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
      Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
      Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
      Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
      Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
      Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
      Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
      Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
      Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
      Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
      Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
      Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
      Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
      Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
      Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
      Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
      Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
      Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
      Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
      Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
      Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
      Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      graph
      Test Report

      Repro

      General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

      Payloads

      Baseline
      Compare

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
      ```log
      

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Run Information

      Architecturex64
      OSalpine 3.15
      Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
      Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
      DiffDiff

      Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
      Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

      graph
      Test Report

      Repro

      General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

      Payloads

      Baseline
      Compare

      git clone https://github.com/dotnet/performance.git
      py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
      Details

      Payloads

      Baseline
      Compare

      Histogram

      System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

      Description of detection logic

      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
      IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
      IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
      

      Docs

      Profiling workflow for dotnet/runtime repository
      Benchmarking workflow for dotnet/runtime repository

      Metadata

      Metadata

      Assignees

      No one assigned

        Type

        No type

        Projects

        No projects

          Milestone

          Relationships

          None yet

          Development

          No branches or pull requests

          Issue actions

          , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
          Skip to content

          Regressions in System.Text.RegularExpressions.Tests #83399

          Description

          @performanceautofiler

          Run Information

          Architecturex64
          OSalpine 3.15
          Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
          Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
          DiffDiff

          Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
          Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
          Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
          Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
          Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
          Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
          Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
          Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
          Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
          Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
          Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
          Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
          Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
          Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
          Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
          Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
          Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
          Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
          Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
          Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
          Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
          Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          graph
          Test Report

          Repro

          General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

          Payloads

          Baseline
          Compare

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
          ```log
          

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Run Information

          Architecturex64
          OSalpine 3.15
          Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
          Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
          DiffDiff

          Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
          Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

          graph
          Test Report

          Repro

          General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

          Payloads

          Baseline
          Compare

          git clone https://github.com/dotnet/performance.git
          py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
          Details

          Payloads

          Baseline
          Compare

          Histogram

          System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

          Description of detection logic

          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
          IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
          IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
          

          Docs

          Profiling workflow for dotnet/runtime repository
          Benchmarking workflow for dotnet/runtime repository

          Metadata

          Metadata

          Assignees

          No one assigned

            Type

            No type

            Projects

            No projects

              Milestone

              Relationships

              None yet

              Development

              No branches or pull requests

              Issue actions

              , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
              Skip to content

              Regressions in System.Text.RegularExpressions.Tests #83399

              Description

              @performanceautofiler

              Run Information

              Architecturex64
              OSalpine 3.15
              Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
              Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
              DiffDiff

              Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
              Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
              Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
              Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
              Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
              Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
              Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
              Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
              Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
              Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
              Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
              Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
              Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
              Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
              Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
              Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
              Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
              Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
              Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
              Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
              Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
              Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              graph
              Test Report

              Repro

              General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

              Payloads

              Baseline
              Compare

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
              ```log
              

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Run Information

              Architecturex64
              OSalpine 3.15
              Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
              Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
              DiffDiff

              Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
              Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

              graph
              Test Report

              Repro

              General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

              Payloads

              Baseline
              Compare

              git clone https://github.com/dotnet/performance.git
              py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
              Details

              Payloads

              Baseline
              Compare

              Histogram

              System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

              Description of detection logic

              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
              IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
              IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
              

              Docs

              Profiling workflow for dotnet/runtime repository
              Benchmarking workflow for dotnet/runtime repository

              Metadata

              Metadata

              Assignees

              No one assigned

                Type

                No type

                Projects

                No projects

                  Milestone

                  Relationships

                  None yet

                  Development

                  No branches or pull requests

                  Issue actions

                  , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
                  Skip to content

                  Regressions in System.Text.RegularExpressions.Tests #83399

                  Description

                  @performanceautofiler

                  Run Information

                  Architecturex64
                  OSalpine 3.15
                  Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
                  Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                  DiffDiff

                  Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

                  BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                  Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
                  Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
                  Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
                  Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
                  Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
                  Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
                  Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
                  Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
                  Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
                  Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
                  Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
                  Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
                  Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
                  Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
                  Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
                  Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
                  Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
                  Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
                  Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
                  Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
                  Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
                  Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  graph
                  Test Report

                  Repro

                  General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                  Payloads

                  Baseline
                  Compare

                  git clone https://github.com/dotnet/performance.git
                  py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
                  Details

                  Payloads

                  Baseline
                  Compare

                  Histogram

                  System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
                  ```log
                  

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  

                  Docs

                  Profiling workflow for dotnet/runtime repository
                  Benchmarking workflow for dotnet/runtime repository

                  Run Information

                  Architecturex64
                  OSalpine 3.15
                  Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
                  Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                  DiffDiff

                  Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

                  BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                  Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

                  graph
                  Test Report

                  Repro

                  General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                  Payloads

                  Baseline
                  Compare

                  git clone https://github.com/dotnet/performance.git
                  py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
                  Details

                  Payloads

                  Baseline
                  Compare

                  Histogram

                  System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

                  Description of detection logic

                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                  IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                  IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
                  IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                  IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
                  IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                  IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                  

                  Docs

                  Profiling workflow for dotnet/runtime repository
                  Benchmarking workflow for dotnet/runtime repository

                  Metadata

                  Metadata

                  Assignees

                  No one assigned

                    Type

                    No type

                    Projects

                    No projects

                      Milestone

                      Relationships

                      None yet

                      Development

                      No branches or pull requests

                      Issue actions

                      , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
                      Skip to content

                      Regressions in System.Text.RegularExpressions.Tests #83399

                      Description

                      @performanceautofiler

                      Run Information

                      Architecturex64
                      OSalpine 3.15
                      Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
                      Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                      DiffDiff

                      Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

                      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                      Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
                      Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
                      Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
                      Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
                      Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
                      Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
                      Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
                      Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
                      Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
                      Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
                      Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
                      Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
                      Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
                      Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
                      Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
                      Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
                      Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
                      Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
                      Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
                      Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
                      Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
                      Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      graph
                      Test Report

                      Repro

                      General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                      Payloads

                      Baseline
                      Compare

                      git clone https://github.com/dotnet/performance.git
                      py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
                      Details

                      Payloads

                      Baseline
                      Compare

                      Histogram

                      System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
                      ```log
                      

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      

                      Docs

                      Profiling workflow for dotnet/runtime repository
                      Benchmarking workflow for dotnet/runtime repository

                      Run Information

                      Architecturex64
                      OSalpine 3.15
                      Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
                      Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                      DiffDiff

                      Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

                      BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                      Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

                      graph
                      Test Report

                      Repro

                      General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                      Payloads

                      Baseline
                      Compare

                      git clone https://github.com/dotnet/performance.git
                      py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
                      Details

                      Payloads

                      Baseline
                      Compare

                      Histogram

                      System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

                      Description of detection logic

                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                      IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                      IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
                      IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                      IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
                      IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                      IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                      

                      Docs

                      Profiling workflow for dotnet/runtime repository
                      Benchmarking workflow for dotnet/runtime repository

                      Metadata

                      Metadata

                      Assignees

                      No one assigned

                        Type

                        No type

                        Projects

                        No projects

                          Milestone

                          Relationships

                          None yet

                          Development

                          No branches or pull requests

                          Issue actions

                          , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
                          Skip to content

                          Regressions in System.Text.RegularExpressions.Tests #83399

                          Description

                          @performanceautofiler

                          Run Information

                          Architecturex64
                          OSalpine 3.15
                          Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
                          Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                          DiffDiff

                          Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

                          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                          Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
                          Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
                          Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
                          Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
                          Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
                          Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
                          Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
                          Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
                          Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
                          Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
                          Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
                          Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
                          Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
                          Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
                          Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
                          Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
                          Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
                          Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
                          Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
                          Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
                          Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
                          Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          graph
                          Test Report

                          Repro

                          General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                          Payloads

                          Baseline
                          Compare

                          git clone https://github.com/dotnet/performance.git
                          py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
                          Details

                          Payloads

                          Baseline
                          Compare

                          Histogram

                          System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
                          ```log
                          

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          

                          Docs

                          Profiling workflow for dotnet/runtime repository
                          Benchmarking workflow for dotnet/runtime repository

                          Run Information

                          Architecturex64
                          OSalpine 3.15
                          Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
                          Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                          DiffDiff

                          Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

                          BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                          Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

                          graph
                          Test Report

                          Repro

                          General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                          Payloads

                          Baseline
                          Compare

                          git clone https://github.com/dotnet/performance.git
                          py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
                          Details

                          Payloads

                          Baseline
                          Compare

                          Histogram

                          System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

                          Description of detection logic

                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                          IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                          IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
                          IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                          IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
                          IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                          IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                          

                          Docs

                          Profiling workflow for dotnet/runtime repository
                          Benchmarking workflow for dotnet/runtime repository

                          Metadata

                          Metadata

                          Assignees

                          No one assigned

                            Type

                            No type

                            Projects

                            No projects

                              Milestone

                              Relationships

                              None yet

                              Development

                              No branches or pull requests

                              Issue actions

                              , 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
                              Skip to content

                              Regressions in System.Text.RegularExpressions.Tests #83399

                              Description

                              @performanceautofiler

                              Run Information

                              Architecturex64
                              OSalpine 3.15
                              Baseline3db965d1c9fcc8d9c4bc4c2dc9b644f61e7bb6ce
                              Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                              DiffDiff

                              Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock

                              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                              Count - Duration of single invocation47.30 μs75.07 μs1.590.11False
                              Count - Duration of single invocation42.00 μs71.07 μs1.690.06False
                              Count - Duration of single invocation42.60 μs70.52 μs1.660.05False
                              Count - Duration of single invocation56.63 μs76.73 μs1.350.14False
                              Count - Duration of single invocation56.97 μs83.60 μs1.470.06False
                              Count - Duration of single invocation106.90 μs124.46 μs1.160.05False
                              Count - Duration of single invocation44.81 μs64.22 μs1.430.04False
                              Count - Duration of single invocation85.12 μs111.95 μs1.320.12False
                              Count - Duration of single invocation38.08 μs57.54 μs1.510.26False
                              Count - Duration of single invocation46.27 μs74.63 μs1.610.11False
                              Count - Duration of single invocation51.65 μs80.53 μs1.560.13False
                              Count - Duration of single invocation49.21 μs68.42 μs1.390.12False
                              Count - Duration of single invocation52.03 μs80.10 μs1.540.14False
                              Count - Duration of single invocation37.81 μs57.71 μs1.530.26False
                              Count - Duration of single invocation37.87 μs66.27 μs1.750.24False
                              Count - Duration of single invocation51.45 μs80.30 μs1.560.09False
                              Count - Duration of single invocation37.90 μs57.63 μs1.520.21False
                              Count - Duration of single invocation42.54 μs69.97 μs1.640.11False
                              Count - Duration of single invocation68.75 μs96.68 μs1.410.17False
                              Count - Duration of single invocation51.75 μs71.20 μs1.380.07False
                              Count - Duration of single invocation37.87 μs57.51 μs1.520.23False
                              Count - Duration of single invocation51.85 μs71.08 μs1.370.07False

                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              graph
                              Test Report

                              Repro

                              General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                              Payloads

                              Baseline
                              Compare

                              git clone https://github.com/dotnet/performance.git
                              py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock*'
                              Details

                              Payloads

                              Baseline
                              Compare

                              Histogram

                              System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: None)

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 75.06905521911982 > 49.84993622159091.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.46507433705709 (T) = (0 -68382.21867572729) / Math.Sqrt((121859.39607552288 / (44)) + (18654866.479383383 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.44451469315402725 = (47339.23372313926 - 68382.21867572729) / 47339.23372313926 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: Compiled)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 71.06764059469943 > 44.176141361830176.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -18.406979549339365 (T) = (0 -64830.77504184153) / Math.Sqrt((433547.4214354688 / (44)) + (23486799.55100716 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5270637170426158 = (42454.53173846334 - 64830.77504184153) / 42454.53173846334 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: Compiled)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 70.52240841562715 > 44.78084116017388.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -18.337686748832795 (T) = (0 -64996.760129393544) / Math.Sqrt((277318.6442704769 / (44)) + (21490198.04969028 / (15))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (15) - 2, .025) and -0.5115767705654861 = (42999.31131190778 - 64996.760129393544) / 42999.31131190778 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: Compiled)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 76.73260289861838 > 60.15591392374458.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.669438272744454 (T) = (0 -80345.23551675743) / Math.Sqrt((1189409.4579182486 / (44)) + (21432975.836474337 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4009291079952546 = (57351.3927708536 - 80345.23551675743) / 57351.3927708536 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock\\s+Holmes", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 83.6043568677626 > 59.07387163815878.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -21.983780835249824 (T) = (0 -81391.61907530572) / Math.Sqrt((635615.4136294585 / (44)) + (20729722.54997691 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4474891728463224 = (56229.51839788783 - 81391.61907530572) / 56229.51839788783 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 124.45791620606573 > 111.90338938262225.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -17.852015768945282 (T) = (0 -130279.10368497873) / Math.Sqrt((4030500.115076858 / (44)) + (25740469.53024647 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.21755818404272903 = (107000.3104512061 - 130279.10368497873) / 107000.3104512061 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 64.2221871523712 > 47.903463794397574.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.94945201990967 (T) = (0 -67023.4129718117) / Math.Sqrt((150622.89612897404 / (44)) + (19098021.382624667 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.48292499990036386 = (45196.76516095887 - 67023.4129718117) / 45196.76516095887 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "The", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 111.94887376373626 > 88.6550499545832.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -18.136461981491767 (T) = (0 -108416.46184671449) / Math.Sqrt((4655757.999053398 / (44)) + (24676167.036326442 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.27348973203144544 = (85133.36159669753 - 108416.46184671449) / 85133.36159669753 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 57.54310710784313 > 40.059840233993896.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.21359146606723 (T) = (0 -61571.68923271897) / Math.Sqrt((1149052.80401432 / (44)) + (22504236.81561939 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5961776143909362 = (38574.459807979 - 61571.68923271897) / 38574.459807979 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 74.62963235119048 > 48.26364460390191.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.487029210598575 (T) = (0 -69601.03086970725) / Math.Sqrt((75364.4524885213 / (44)) + (23338753.262543254 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.511368546750202 = (46051.66027794203 - 69601.03086970725) / 46051.66027794203 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 80.52634251373625 > 54.358727324412115.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.135352550707996 (T) = (0 -75698.64118944944) / Math.Sqrt((121057.71994057954 / (43)) + (25164543.24325142 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.46477410058172464 = (51679.39626962701 - 75698.64118944944) / 51679.39626962701 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 68.41998307860263 > 51.92924335754104.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.359329740229096 (T) = (0 -72587.7999003866) / Math.Sqrt((179893.627797046 / (44)) + (22511041.51851902 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.46371495139043134 = (49591.486259966834 - 72587.7999003866) / 49591.486259966834 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Sherlock Holmes", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 80.09520619047619 > 54.177646443920324.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -18.596694461632826 (T) = (0 -74052.45638196774) / Math.Sqrt((79887.39686957936 / (43)) + (23043706.66655745 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.4317887770048441 = (51720.2380485744 - 74052.45638196774) / 51720.2380485744 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 57.70624532156036 > 39.90146960964196.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.83825235469215 (T) = (0 -62301.72982542477) / Math.Sqrt((922393.6223055285 / (44)) + (22482666.926505283 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6135850083014053 = (38610.75152836775 - 62301.72982542477) / 38610.75152836775 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 66.27024732113755 > 39.99218386320045.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -21.176946640614755 (T) = (0 -63193.9434122576) / Math.Sqrt((816895.8347909031 / (43)) + (21300807.903057806 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.6377496390251314 = (38585.83870601475 - 63193.9434122576) / 38585.83870601475 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 80.29674070512822 > 54.00615025621915.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -21.209115002413824 (T) = (0 -76927.32568565477) / Math.Sqrt((1192530.3900537482 / (44)) + (21806298.010871124 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.4815889437675378 = (51922.17855651379 - 76927.32568565477) / 51922.17855651379 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aqj", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 57.63128768382353 > 39.87633966887626.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.06371880002277 (T) = (0 -60662.83451721839) / Math.Sqrt((852163.191530582 / (44)) + (21353174.25911988 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.5764569241319812 = (38480.48975433958 - 60662.83451721839) / 38480.48975433958 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "(?m)^Sherlock Holmes|Sherlock Holmes$", Options: Compiled)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 69.96676582442221 > 44.60229246400285.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -20.498167240880587 (T) = (0 -67029.07402151138) / Math.Sqrt((68311.62738736703 / (43)) + (22851129.268528443 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.5764617591993996 = (42518.68060253606 - 67029.07402151138) / 42518.68060253606 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "Holmes", Options: None)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 96.68262861000882 > 72.29617196289394.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -20.660408875520513 (T) = (0 -93600.65256738964) / Math.Sqrt((3033373.6789347054 / (44)) + (19792097.0089048 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.3373365735443279 = (69990.34829304107 - 93600.65256738964) / 69990.34829304107 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: Compiled)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 71.19809652534965 > 54.305586608189.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -20.301565697771025 (T) = (0 -76260.0311985342) / Math.Sqrt((695997.4403433456 / (44)) + (23305719.935552154 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.47718068669842534 = (51625.391453620534 - 76260.0311985342) / 51625.391453620534 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "zqj", Options: Compiled)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 57.50598115808823 > 39.76493934572496.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -20.05034561711685 (T) = (0 -62759.29209376103) / Math.Sqrt((694671.911755774 / (44)) + (23512442.45983944 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.6376305992459426 = (38323.22876884381 - 62759.29209376103) / 38323.22876884381 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              ```#### System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock.Count(Pattern: "aei", Options: NonBacktracking)
                              ```log
                              

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 71.0786281452922 > 53.97238132191589.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -19.58656775128648 (T) = (0 -76432.58975932671) / Math.Sqrt((1374165.3032640663 / (44)) + (24247767.91929889 / (16))) is less than -2.001717484144427 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (44) + (16) - 2, .025) and -0.467787024230693 = (52073.3515813625 - 76432.58975932671) / 52073.3515813625 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              

                              Docs

                              Profiling workflow for dotnet/runtime repository
                              Benchmarking workflow for dotnet/runtime repository

                              Run Information

                              Architecturex64
                              OSalpine 3.15
                              Baselinef1e6a83b4e5694febe354b5fc1cf16f5f320af36
                              Comparea923c644067c4a37f0bb7c7a331a791d2e51c183
                              DiffDiff

                              Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas

                              BenchmarkBaselineTestTest/BaseTest QualityEdge DetectorBaseline IRCompare IRIR RatioBaseline ETLCompare ETL
                              Count - Duration of single invocation2.67 ms2.93 ms1.100.05False

                              graph
                              Test Report

                              Repro

                              General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

                              Payloads

                              Baseline
                              Compare

                              git clone https://github.com/dotnet/performance.git
                              py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas*'
                              Details

                              Payloads

                              Baseline
                              Compare

                              Histogram

                              System.Text.RegularExpressions.Tests.Perf_Regex_Industry_Mariomkas.Count(Pattern: "[\w]+://[^/\\s?#]+[^\\s?#]+(?:\?[^\\s#])?(?:#[^\\s])?", Options: NonBacktracking)

                              Description of detection logic

                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
                              IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
                              IsRegressionWindowed: Marked as regression because 2.9346793846153845 > 2.813872867474917.
                              IsChangePoint: Marked as a change because one of 1/13/2023 4:18:46 AM, 3/10/2023 12:53:36 AM, 3/14/2023 5:57:45 AM falls between 3/5/2023 5:50:49 PM and 3/14/2023 5:57:45 AM.
                              IsRegressionStdDev: Marked as regression because -15.571413200623827 (T) = (0 -2892946.5964159775) / Math.Sqrt((1323164932.7356968 / (43)) + (2036377120.9937906 / (16))) is less than -2.0024654592901125 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (43) + (16) - 2, .025) and -0.07257829968440427 = (2697189.1910056346 - 2892946.5964159775) / 2697189.1910056346 is less than -0.05.
                              IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
                              IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
                              

                              Docs

                              Profiling workflow for dotnet/runtime repository
                              Benchmarking workflow for dotnet/runtime repository

                              Metadata

                              Metadata

                              Assignees

                              No one assigned

                                Type

                                No type

                                Projects

                                No projects

                                  Milestone

                                  Relationships

                                  None yet

                                  Development

                                  No branches or pull requests

                                  Issue actions