SIMDify ToLowerInvariant/ToUpperInvariant

[EgorBo]

This PR does:

• Adds more tests
• SIMDify large inputs for ToLowerInvariant/ToUpperInvariant (for spans)

publicIEnumerable<string>TestData(){yieldreturn"Ab";// 2 chars: no SIMD pathyieldreturn"Abcd";// 4 chars: no SIMD pathyieldreturn"Abcd123";// 7 chars: no SIMD pathyieldreturn"Abcd1234";// 8 chars: 1xV128yieldreturn"Abcd1234Ab";// 10 chars: 1xV128 + 2 trailing charsyieldreturn"Abcd1234Abcd123";// 15 chars: 1xV128 + 7 trailing charsyieldreturn"Licensed to the NET Foundation";// 32 charsyieldreturn"We always welcome bug reports, API proposals and overall feedback. Here are a few tips on how you can make reporting your issue as effective as possible.";}privatestaticreadonlychar[]OutputBuffer=newchar[1024];[Benchmark][ArgumentsSource(nameof(TestData))]publicvoidToLowerInvariant(stringstr)=>str.AsSpan().ToLowerInvariant(OutputBuffer.AsSpan());

Method	Toolchain	str	Mean	Ratio
ToLowerInvariant	\Core_Root\corerun.exe	Ab	6.924 ns	1.03
ToLowerInvariant	\Core_Root_base\corerun.exe	Ab	6.778 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	Abcd	7.623 ns	1.03
ToLowerInvariant	\Core_Root_base\corerun.exe	Abcd	7.379 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	Abcd123	8.461 ns	0.97
ToLowerInvariant	\Core_Root_base\corerun.exe	Abcd123	8.683 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	Abcd1234	6.275 ns	0.73
ToLowerInvariant	\Core_Root_base\corerun.exe	Abcd1234	8.580 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	Abcd1234Ab	6.858 ns	0.75
ToLowerInvariant	\Core_Root_base\corerun.exe	Abcd1234Ab	9.165 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	Abcd1234Abcd123	7.001 ns	0.64
ToLowerInvariant	\Core_Root_base\corerun.exe	Abcd1234Abcd123	10.871 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	Licen(...)ation [30]	9.250 ns	0.61
ToLowerInvariant	\Core_Root_base\corerun.exe	Licen(...)ation [30]	15.027 ns	1.00
ToLowerInvariant	\Core_Root\corerun.exe	We a(...)ble. [153]	20.832 ns	0.42
ToLowerInvariant	\Core_Root_base\corerun.exe	We a(...)ble. [153]	49.970 ns	1.00

ToUpperInvariant() shows the same numbers.

[ghost]

I couldn't figure out the best area label to add to this PR. If you have write-permissions please help me learn by adding exactly one area label.

[stephentoub]

numbers.

What's the overhead when non-ASCII is encountered?

[EgorBo]

numbers.

What's the overhead when non-ASCII is encountered?

The worst case for this algorithm is a short (>7 chars) full non-ASCII string, but the cost of SIMD "is ascii" check is not too big.
ASCII with non-ASCII can be faster with this PR depending how many ASCII characters we manage to process in SIMD before we encounter non-ASCII.

publicIEnumerable<string>TestData(){// worst case: short full non-ASCIIyieldreturn"Привет Мир";yieldreturn"ASCII-string with non-ASCII chars: ыц!";}privatestaticreadonlychar[]OutputBuffer=newchar[1024];[Benchmark][ArgumentsSource(nameof(TestData))]publicvoidToLowerInvariant(stringstr)=>str.AsSpan().ToLowerInvariant(OutputBuffer.AsSpan());

Method	Toolchain	str	Mean
ToLowerInvariant	\Core_Root\corerun.exe	Привет Мир	52.19 ns
ToLowerInvariant	\Core_Root_base\corerun.exe	Привет Мир	48.52 ns
ToLowerInvariant	\Core_Root\corerun.exe	ASCII(...): ыц! [38]	32.36 ns
ToLowerInvariant	\Core_Root_base\corerun.exe	ASCII(...): ыц! [38]	34.92 ns

I've pushed a change to call the Scalar path if we encounter non-ASCII in a vector - because we still want to process as many ASCII chars as we can before we switch to extremely slow NLS/ICU fallback.

[EgorBo]

Improvements on x64:

• [Perf] Alpine/x64: 5 Improvements on 11/24/2022 9:42:44 PM perf-autofiling-issues#10118
• [Perf] Windows/x64: 4 Improvements on 11/24/2022 9:42:44 PM perf-autofiling-issues#10132
• [Perf] Windows/x64: 5 Improvements on 11/24/2022 9:42:44 PM perf-autofiling-issues#10226