[Benchmark X64] [ericstj] Update to zlib-ng 2.2.5

[MihuBot]

Job completed in 1 hour 48 minutes (remote runner delay: 47 seconds).

Using arguments: benchmark System.IO.Compression -medium -NoPRLink

System.IO.Compression.ZLib

BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=Default IterationCount=15
LaunchCount=2 MemoryRandomization=Default WarmupCount=10

Method	Toolchain	level	file	Mean	Error	Ratio	Allocated	Alloc Ratio
Compress	Main	Optimal	alice29.txt	2,685.08 μs	1.928 μs	1.00	8.25 KB	1.00
Compress	PR	Optimal	alice29.txt	2,697.28 μs	1.272 μs	1.00	8.25 KB	1.00
Decompress	Main	Optimal	alice29.txt	204.44 μs	5.174 μs	1.00	8.27 KB	1.00
Decompress	PR	Optimal	alice29.txt	214.87 μs	4.405 μs	1.05	8.27 KB	1.00
Compress	Main	Optimal	sum	350.72 μs	4.315 μs	1.00	8.25 KB	1.00
Compress	PR	Optimal	sum	361.78 μs	7.558 μs	1.03	8.25 KB	1.00
Decompress	Main	Optimal	sum	48.98 μs	0.167 μs	1.00	8.27 KB	1.00
Decompress	PR	Optimal	sum	48.57 μs	0.032 μs	0.99	8.27 KB	1.00
Compress	Main	Optimal	TestDocument.pdf	1,800.34 μs	2.774 μs	1.00	8.25 KB	1.00
Compress	PR	Optimal	TestDocument.pdf	1,758.32 μs	1.175 μs	0.98	8.25 KB	1.00
Decompress	Main	Optimal	TestDocument.pdf	284.05 μs	0.100 μs	1.00	8.27 KB	1.00
Decompress	PR	Optimal	TestDocument.pdf	283.43 μs	0.091 μs	1.00	8.27 KB	1.00
Compress	Main	Fastest	alice29.txt	687.71 μs	3.410 μs	1.00	8.25 KB	1.00
Compress	PR	Fastest	alice29.txt	686.38 μs	1.667 μs	1.00	8.25 KB	1.00
Decompress	Main	Fastest	alice29.txt	373.38 μs	2.114 μs	1.00	8.27 KB	1.00
Decompress	PR	Fastest	alice29.txt	388.97 μs	11.924 μs	1.04	8.27 KB	1.00
Compress	Main	Fastest	sum	132.85 μs	0.633 μs	1.00	8.25 KB	1.00
Compress	PR	Fastest	sum	133.33 μs	1.670 μs	1.00	8.25 KB	1.00
Decompress	Main	Fastest	sum	49.65 μs	0.024 μs	1.00	8.27 KB	1.00
Decompress	PR	Fastest	sum	49.63 μs	0.050 μs	1.00	8.27 KB	1.00
Compress	Main	Fastest	TestDocument.pdf	1,036.41 μs	2.219 μs	1.00	8.25 KB	1.00
Compress	PR	Fastest	TestDocument.pdf	1,026.79 μs	4.324 μs	0.99	8.25 KB	1.00
Decompress	Main	Fastest	TestDocument.pdf	303.57 μs	0.118 μs	1.00	8.27 KB	1.00
Decompress	PR	Fastest	TestDocument.pdf	303.59 μs	0.259 μs	1.00	8.27 KB	1.00

System.IO.Compression.Gzip

BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=Default IterationCount=15
LaunchCount=2 MemoryRandomization=Default WarmupCount=10

Method	Toolchain	level	file	Mean	Error	Ratio	Allocated	Alloc Ratio
Compress	Main	Optimal	alice29.txt	2,686.48 μs	2.062 μs	1.00	8.25 KB	1.00
Compress	PR	Optimal	alice29.txt	2,699.04 μs	1.165 μs	1.00	8.25 KB	1.00
Decompress	Main	Optimal	alice29.txt	201.16 μs	1.824 μs	1.00	8.27 KB	1.00
Decompress	PR	Optimal	alice29.txt	218.94 μs	6.258 μs	1.09	8.27 KB	1.00
Compress	Main	Optimal	sum	361.98 μs	5.154 μs	1.00	8.25 KB	1.00
Compress	PR	Optimal	sum	348.83 μs	5.751 μs	0.96	8.25 KB	1.00
Decompress	Main	Optimal	sum	48.84 μs	0.061 μs	1.00	8.27 KB	1.00
Decompress	PR	Optimal	sum	47.00 μs	0.044 μs	0.96	8.27 KB	1.00
Compress	Main	Optimal	TestDocument.pdf	1,805.10 μs	1.352 μs	1.00	8.25 KB	1.00
Compress	PR	Optimal	TestDocument.pdf	1,761.85 μs	2.214 μs	0.98	8.25 KB	1.00
Decompress	Main	Optimal	TestDocument.pdf	276.31 μs	5.508 μs	1.00	8.27 KB	1.00
Decompress	PR	Optimal	TestDocument.pdf	283.03 μs	0.946 μs	1.03	8.27 KB	1.00
Compress	Main	Fastest	alice29.txt	694.93 μs	1.900 μs	1.00	8.25 KB	1.00
Compress	PR	Fastest	alice29.txt	687.91 μs	1.981 μs	0.99	8.25 KB	1.00
Decompress	Main	Fastest	alice29.txt	375.61 μs	3.202 μs	1.00	8.27 KB	1.00
Decompress	PR	Fastest	alice29.txt	370.74 μs	1.868 μs	0.99	8.27 KB	1.00
Compress	Main	Fastest	sum	134.18 μs	2.288 μs	1.00	8.25 KB	1.00
Compress	PR	Fastest	sum	134.75 μs	2.404 μs	1.00	8.25 KB	1.00
Decompress	Main	Fastest	sum	48.86 μs	0.558 μs	1.00	8.27 KB	1.00
Decompress	PR	Fastest	sum	50.27 μs	0.313 μs	1.03	8.27 KB	1.00
Compress	Main	Fastest	TestDocument.pdf	1,043.67 μs	2.681 μs	1.00	8.25 KB	1.00
Compress	PR	Fastest	TestDocument.pdf	1,030.75 μs	6.953 μs	0.99	8.25 KB	1.00
Decompress	Main	Fastest	TestDocument.pdf	304.39 μs	0.097 μs	1.00	8.27 KB	1.00
Decompress	PR	Fastest	TestDocument.pdf	296.51 μs	4.262 μs	0.97	8.27 KB	1.00

System.IO.Compression.Deflate

BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun OutlierMode=Default IterationCount=15
LaunchCount=2 MemoryRandomization=Default WarmupCount=10

Method	Toolchain	level	file	Mean	Error	Ratio	Allocated	Alloc Ratio
Compress	Main	Optimal	alice29.txt	2,686.65 μs	1.635 μs	1.00	8.22 KB	1.00
Compress	PR	Optimal	alice29.txt	2,711.11 μs	1.528 μs	1.01	8.22 KB	1.00
Decompress	Main	Optimal	alice29.txt	200.15 μs	3.039 μs	1.00	8.23 KB	1.00
Decompress	PR	Optimal	alice29.txt	216.96 μs	4.390 μs	1.08	8.23 KB	1.00
Compress	Main	Optimal	sum	355.64 μs	8.010 μs	1.00	8.22 KB	1.00
Compress	PR	Optimal	sum	358.17 μs	1.904 μs	1.01	8.22 KB	1.00
Decompress	Main	Optimal	sum	49.10 μs	0.142 μs	1.00	8.23 KB	1.00
Decompress	PR	Optimal	sum	49.29 μs	0.138 μs	1.00	8.23 KB	1.00
Compress	Main	Optimal	TestDocument.pdf	1,805.47 μs	4.331 μs	1.00	8.22 KB	1.00
Compress	PR	Optimal	TestDocument.pdf	1,765.84 μs	4.171 μs	0.98	8.22 KB	1.00
Decompress	Main	Optimal	TestDocument.pdf	284.19 μs	0.082 μs	1.00	8.23 KB	1.00
Decompress	PR	Optimal	TestDocument.pdf	283.77 μs	0.259 μs	1.00	8.23 KB	1.00
Compress	Main	Fastest	alice29.txt	680.68 μs	3.395 μs	1.00	8.22 KB	1.00
Compress	PR	Fastest	alice29.txt	692.89 μs	3.146 μs	1.02	8.22 KB	1.00
Decompress	Main	Fastest	alice29.txt	375.78 μs	2.461 μs	1.00	8.23 KB	1.00
Decompress	PR	Fastest	alice29.txt	371.20 μs	1.547 μs	0.99	8.23 KB	1.00
Compress	Main	Fastest	sum	135.46 μs	1.532 μs	1.00	8.22 KB	1.00
Compress	PR	Fastest	sum	133.50 μs	0.303 μs	0.99	8.22 KB	1.00
Decompress	Main	Fastest	sum	51.40 μs	0.519 μs	1.00	8.23 KB	1.00
Decompress	PR	Fastest	sum	50.11 μs	0.162 μs	0.98	8.23 KB	1.00
Compress	Main	Fastest	TestDocument.pdf	1,033.96 μs	2.928 μs	1.00	8.22 KB	1.00
Compress	PR	Fastest	TestDocument.pdf	1,030.43 μs	2.210 μs	1.00	8.22 KB	1.00
Decompress	Main	Fastest	TestDocument.pdf	304.84 μs	0.471 μs	1.00	8.23 KB	1.00
Decompress	PR	Fastest	TestDocument.pdf	304.47 μs	0.588 μs	1.00	8.23 KB	1.00

System.IO.Compression.Brotli

BenchmarkDotNet v0.14.1-nightly.20250107.205, Linux Ubuntu 22.04.5 LTS (Jammy Jellyfish)
AMD EPYC 9V74, 1 CPU, 8 logical and 4 physical cores
MediumRun : .NET 10.0.0 (42.42.42.42424), X64 RyuJIT AVX-512F+CD+BW+DQ+VL+VBMI
Job=MediumRun IterationCount=15 LaunchCount=2
WarmupCount=10

Method	Toolchain	level	file	Mean	Error	Ratio	Allocated	Alloc Ratio
Compress_WithState	Main	Optimal	alice29.txt	183,758.191 μs	112.3952 μs	1.00	237 B	1.00
Compress_WithState	PR	Optimal	alice29.txt	184,076.489 μs	162.7037 μs	1.00	237 B	1.00
Decompress_WithState	Main	Optimal	alice29.txt	287.331 μs	0.3428 μs	1.00	32 B	1.00
Decompress_WithState	PR	Optimal	alice29.txt	292.056 μs	1.0781 μs	1.02	32 B	1.00
Decompress_WithoutState	Main	Optimal	alice29.txt	289.650 μs	1.0639 μs	1.00	-	NA
Decompress_WithoutState	PR	Optimal	alice29.txt	292.025 μs	1.8991 μs	1.01	-	NA
Compress	Main	Optimal	alice29.txt	1,698.235 μs	7.1909 μs	1.00	65681 B	1.00
Compress	PR	Optimal	alice29.txt	1,711.973 μs	11.6640 μs	1.01	65682 B	1.00
Decompress	Main	Optimal	alice29.txt	301.026 μs	1.3657 μs	1.00	65681 B	1.00
Decompress	PR	Optimal	alice29.txt	302.598 μs	1.1775 μs	1.01	65681 B	1.00
Compress_WithoutState	Main	Optimal	alice29.txt	183,212.098 μs	337.9202 μs	1.00	133 B	1.00
Compress_WithoutState	PR	Optimal	alice29.txt	184,194.937 μs	342.8802 μs	1.01	133 B	1.00
Compress_WithState	Main	Optimal	sum	39,948.471 μs	101.7275 μs	1.00	79 B	1.00
Compress_WithState	PR	Optimal	sum	39,756.830 μs	27.2650 μs	1.00	79 B	1.00
Decompress_WithState	Main	Optimal	sum	64.231 μs	0.9901 μs	1.00	32 B	1.00
Decompress_WithState	PR	Optimal	sum	62.909 μs	0.1314 μs	0.98	32 B	1.00
Decompress_WithoutState	Main	Optimal	sum	62.737 μs	0.1143 μs	1.00	-	NA
Decompress_WithoutState	PR	Optimal	sum	63.026 μs	0.2688 μs	1.00	-	NA
Compress	Main	Optimal	sum	2.130 μs	0.0411 μs	1.00	65681 B	1.00
Compress	PR	Optimal	sum	2.160 μs	0.0553 μs	1.02	65681 B	1.00
Decompress	Main	Optimal	sum	66.832 μs	0.1148 μs	1.00	65681 B	1.00
Decompress	PR	Optimal	sum	66.685 μs	0.1344 μs	1.00	65681 B	1.00
Compress_WithoutState	Main	Optimal	sum	39,787.134 μs	66.0688 μs	1.00	31 B	1.00
Compress_WithoutState	PR	Optimal	sum	39,752.148 μs	26.4475 μs	1.00	31 B	1.00
Compress_WithState	Main	Optimal	TestDocument.pdf	517,040.634 μs	168.4925 μs	1.00	648 B	1.00
Compress_WithState	PR	Optimal	TestDocument.pdf	517,524.082 μs	195.9937 μs	1.00	648 B	1.00
Decompress_WithState	Main	Optimal	TestDocument.pdf	291.161 μs	0.1006 μs	1.00	32 B	1.00
Decompress_WithState	PR	Optimal	TestDocument.pdf	291.175 μs	0.1766 μs	1.00	32 B	1.00
Decompress_WithoutState	Main	Optimal	TestDocument.pdf	291.098 μs	0.2641 μs	1.00	-	NA
Decompress_WithoutState	PR	Optimal	TestDocument.pdf	292.379 μs	1.1879 μs	1.00	-	NA
Compress	Main	Optimal	TestDocument.pdf	218.242 μs	12.7818 μs	1.01	65681 B	1.00
Compress	PR	Optimal	TestDocument.pdf	220.028 μs	12.0805 μs	1.02	65681 B	1.00
Decompress	Main	Optimal	TestDocument.pdf	302.356 μs	0.1090 μs	1.00	65681 B	1.00
Decompress	PR	Optimal	TestDocument.pdf	301.655 μs	0.0587 μs	1.00	65681 B	1.00
Compress_WithoutState	Main	Optimal	TestDocument.pdf	517,601.656 μs	423.8760 μs	1.00	400 B	1.00
Compress_WithoutState	PR	Optimal	TestDocument.pdf	517,471.307 μs	201.3337 μs	1.00	400 B	1.00
Compress_WithState	Main	Fastest	alice29.txt	660.965 μs	1.7646 μs	1.00	33 B	1.00
Compress_WithState	PR	Fastest	alice29.txt	652.926 μs	9.1751 μs	0.99	33 B	1.00
Decompress_WithState	Main	Fastest	alice29.txt	367.626 μs	0.1293 μs	1.00	32 B	1.00
Decompress_WithState	PR	Fastest	alice29.txt	368.542 μs	0.1915 μs	1.00	32 B	1.00
Decompress_WithoutState	Main	Fastest	alice29.txt	367.412 μs	0.5606 μs	1.00	-	NA
Decompress_WithoutState	PR	Fastest	alice29.txt	367.315 μs	0.4447 μs	1.00	-	NA
Compress	Main	Fastest	alice29.txt	759.606 μs	1.2460 μs	1.00	65681 B	1.00
Compress	PR	Fastest	alice29.txt	768.947 μs	5.0775 μs	1.01	65681 B	1.00
Decompress	Main	Fastest	alice29.txt	384.628 μs	0.3414 μs	1.00	65681 B	1.00
Decompress	PR	Fastest	alice29.txt	386.246 μs	0.2534 μs	1.00	65681 B	1.00
Compress_WithoutState	Main	Fastest	alice29.txt	664.428 μs	2.2322 μs	1.00	-	NA
Compress_WithoutState	PR	Fastest	alice29.txt	670.081 μs	2.2301 μs	1.01	-	NA
Compress_WithState	Main	Fastest	sum	106.626 μs	0.2013 μs	1.00	32 B	1.00
Compress_WithState	PR	Fastest	sum	107.331 μs	0.3667 μs	1.01	32 B	1.00
Decompress_WithState	Main	Fastest	sum	68.365 μs	1.5054 μs	1.00	32 B	1.00
Decompress_WithState	PR	Fastest	sum	66.890 μs	0.0299 μs	0.98	32 B	1.00
Decompress_WithoutState	Main	Fastest	sum	67.152 μs	0.4757 μs	1.00	-	NA
Decompress_WithoutState	PR	Fastest	sum	66.928 μs	0.0719 μs	1.00	-	NA
Compress	Main	Fastest	sum	125.209 μs	0.2055 μs	1.00	65681 B	1.00
Compress	PR	Fastest	sum	125.915 μs	0.1934 μs	1.01	65681 B	1.00
Decompress	Main	Fastest	sum	69.816 μs	0.0810 μs	1.00	65681 B	1.00
Decompress	PR	Fastest	sum	69.734 μs	0.0759 μs	1.00	65681 B	1.00
Compress_WithoutState	Main	Fastest	sum	106.285 μs	0.2727 μs	1.00	-	NA
Compress_WithoutState	PR	Fastest	sum	108.033 μs	0.2190 μs	1.02	-	NA
Compress_WithState	Main	Fastest	TestDocument.pdf	320.500 μs	0.0764 μs	1.00	32 B	1.00
Compress_WithState	PR	Fastest	TestDocument.pdf	322.967 μs	1.4245 μs	1.01	32 B	1.00
Decompress_WithState	Main	Fastest	TestDocument.pdf	280.132 μs	1.6373 μs	1.00	32 B	1.00
Decompress_WithState	PR	Fastest	TestDocument.pdf	278.059 μs	0.0533 μs	0.99	32 B	1.00
Decompress_WithoutState	Main	Fastest	TestDocument.pdf	279.999 μs	1.3091 μs	1.00	-	NA
Decompress_WithoutState	PR	Fastest	TestDocument.pdf	278.536 μs	0.9912 μs	0.99	-	NA
Compress	Main	Fastest	TestDocument.pdf	382.508 μs	0.4959 μs	1.00	65681 B	1.00
Compress	PR	Fastest	TestDocument.pdf	383.729 μs	2.1345 μs	1.00	65681 B	1.00
Decompress	Main	Fastest	TestDocument.pdf	289.386 μs	0.4826 μs	1.00	65681 B	1.00
Decompress	PR	Fastest	TestDocument.pdf	289.332 μs	0.3096 μs	1.00	65681 B	1.00
Compress_WithoutState	Main	Fastest	TestDocument.pdf	319.927 μs	0.2544 μs	1.00	-	NA
Compress_WithoutState	PR	Fastest	TestDocument.pdf	320.607 μs	0.5446 μs	1.00	-	NA

Artifacts:

• BDN_Artifacts.zip (800 KB)
• results.md (29 KB)

[MihaZupan]

dotnet/runtime#118457

Added you to the allow list for commands now @ericstj

[MihuBot]

@MihaZupan

[ericstj]

@MihaZupan are we sure these numbers are testing the updated native code? I can run a custom benchmark manually and see a substantial difference for highly-compressible data as is shown in the PR details. I would have expected that to show up for alice29.txt.

[MihaZupan]

Presumably rerunning build.sh clr+libs -c Release with the changes from your PR should have rebuilt the relevant logic, right?

I'll see if the numbers look the same on Intel just in case - #1359

[ericstj]

Yeah, that will have the relevant bits - if you use the test framework we build it will contain runtime+native bits. Just wanted to double check we weren't doing something unusual with trying to patch a runtime.

I guess I wouldn't have expected these benchmarks to catch this fix, since they didn't spot the original regression. I think they are testing payload sizes too small. The test that found this regression added 100 iterations of writes. dotnet/performance#4900