Bump Datafusion to 55 by AdamGS · Pull Request #9334 · vortex-data/vortex

AdamGS · 2026-08-10T12:30:50Z

Rationale for this change

Periodic update to DataFusion

What changes are included in this PR?

Bump Arrow to 59.2
Bump DF to 55.0.0 (Release DataFusion 55.0.0 (Jul / Aug 2026) apache/datafusion#22393)
Bump geoarrow dependency (requires release to support Arrow 59)

~ Currently this PR also includes bumping our MSRV to 1.95 because geoarrow requires that (DataFusion only requires 1.94) ~ Now #9334.

What APIs are changed? Are there any user-facing changes?

Just the dependency changes

codspeed-hq · 2026-08-10T12:58:53Z

Merging this PR will improve performance by 49.81%

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 1 improved benchmark
✅ 2153 untouched benchmarks
🆕 18 new benchmarks
⏩ 64 skipped benchmarks¹
🗄️ 5 archived benchmarks run²

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
⚡	WallTime	`arrow_checked_add_u32_neon[16384]`	20.3 µs	13.6 µs	+49.81%
🆕	WallTime	`infallible_bool_neon[i32, ConstantPerRow]`	N/A	4.3 µs	N/A
🆕	WallTime	`infallible_bool_neon[i32, PerRowConstant]`	N/A	4.4 µs	N/A
🆕	WallTime	`infallible_bool_neon[i32, PerRowPerRow]`	N/A	3.6 µs	N/A
🆕	WallTime	`infallible_bool_neon[i64, ConstantPerRow]`	N/A	5.6 µs	N/A
🆕	WallTime	`infallible_bool_neon[i64, PerRowConstant]`	N/A	5.7 µs	N/A
🆕	WallTime	`infallible_bool_neon[i64, PerRowPerRow]`	N/A	5.6 µs	N/A
🆕	WallTime	`infallible_bool_avx512[i32, ConstantPerRow]`	N/A	3.3 µs	N/A
🆕	WallTime	`infallible_bool_avx512[i32, PerRowConstant]`	N/A	3.2 µs	N/A
🆕	WallTime	`infallible_bool_avx512[i32, PerRowPerRow]`	N/A	2.3 µs	N/A
🆕	WallTime	`infallible_bool_avx512[i64, ConstantPerRow]`	N/A	4 µs	N/A
🆕	WallTime	`infallible_bool_avx512[i64, PerRowConstant]`	N/A	3.9 µs	N/A
🆕	WallTime	`infallible_bool_avx512[i64, PerRowPerRow]`	N/A	3.8 µs	N/A
🆕	WallTime	`infallible_bool_avx2[i32, ConstantPerRow]`	N/A	3.7 µs	N/A
🆕	WallTime	`infallible_bool_avx2[i32, PerRowConstant]`	N/A	3.7 µs	N/A
🆕	WallTime	`infallible_bool_avx2[i32, PerRowPerRow]`	N/A	2.8 µs	N/A
🆕	WallTime	`infallible_bool_avx2[i64, ConstantPerRow]`	N/A	10 µs	N/A
🆕	WallTime	`infallible_bool_avx2[i64, PerRowConstant]`	N/A	9.9 µs	N/A
🆕	WallTime	`infallible_bool_avx2[i64, PerRowPerRow]`	N/A	10.3 µs	N/A

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing adamg/df-55 (325bfa3) with develop (0a128b6)³}

64 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
5 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩
No successful run was found on develop (28f7cf0) during the generation of this report, so 0a128b6 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

github-actions · 2026-08-14T12:12:15Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`a65d744`	statpopgen	1	Explore Profiling Data
🟢 Done	`a65d744`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`a65d744`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`a65d744`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`a65d744`	fineweb	1	Explore Profiling Data
🟢 Done	`a65d744`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`a65d744`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`a65d744`	polarsignals	1	Explore Profiling Data
🟢 Done	`a65d744`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`a65d744`	tpch-s3	1	Explore Profiling Data

Previous Runs (55)

Status	Commit	Job	Attempt	Link
🟢 Done	`3f8ba0b`	statpopgen	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	clickbench-sorted-nvme	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	tpch-nvme-10	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	fineweb-s3	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	fineweb	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	clickbench-nvme	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	tpcds-nvme	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	polarsignals	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	tpch-s3	2	Explore Profiling Data
🟢 Done	`3f8ba0b`	tpch-nvme	2	Explore Profiling Data
🟢 Done	`0a464a1`	statpopgen	1	Explore Profiling Data
🟢 Done	`0a464a1`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`0a464a1`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`0a464a1`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`0a464a1`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`0a464a1`	fineweb	1	Explore Profiling Data
🟢 Done	`0a464a1`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`0a464a1`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`0a464a1`	appian-nvme	1	Explore Profiling Data
🟢 Done	`0a464a1`	polarsignals	1	Explore Profiling Data
🟢 Done	`0a464a1`	tpch-s3	1	Explore Profiling Data
🟢 Done	`0a464a1`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`0a464a1`	random-access-bench	1	Explore Profiling Data
🟢 Done	`0a464a1`	compress-bench	1	Explore Profiling Data
🟢 Done	`0a464a1`	string-bench	1	Explore Profiling Data
🟢 Done	`7152f4c`	statpopgen	1	Explore Profiling Data
🟢 Done	`7152f4c`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`7152f4c`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`7152f4c`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`7152f4c`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`7152f4c`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`7152f4c`	fineweb	1	Explore Profiling Data
🟢 Done	`7152f4c`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`7152f4c`	random-access-bench	1	Explore Profiling Data
🟢 Done	`7152f4c`	appian-nvme	1	Explore Profiling Data
🟢 Done	`7152f4c`	polarsignals	1	Explore Profiling Data
🟢 Done	`7152f4c`	tpch-s3	1	Explore Profiling Data
🟢 Done	`7152f4c`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`7152f4c`	string-bench	1	Explore Profiling Data
🟢 Done	`7152f4c`	compress-bench	1	Explore Profiling Data
🟢 Done	`9dd15ac`	statpopgen	1	Explore Profiling Data
🟢 Done	`9dd15ac`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`9dd15ac`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`9dd15ac`	tpch-s3-10	1	Explore Profiling Data
🟢 Done	`9dd15ac`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`9dd15ac`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`9dd15ac`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`9dd15ac`	fineweb	1	Explore Profiling Data
🟢 Done	`9dd15ac`	appian-nvme	1	Explore Profiling Data
🟢 Done	`9dd15ac`	polarsignals	1	Explore Profiling Data
🟢 Done	`9dd15ac`	tpch-s3	1	Explore Profiling Data
🟢 Done	`9dd15ac`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`9dd15ac`	random-access-bench	1	Explore Profiling Data
🟢 Done	`9dd15ac`	string-bench	1	Explore Profiling Data
🟢 Done	`9dd15ac`	compress-bench	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-08-14T12:16:37Z

Benchmarks: String Encoding 📖

Commits: PR 0a464a16 vs base 17bd9e27

vortex / vortex-file-compressed / ms (1.005x ➖, 0↑ 0↓)

name	ms (PR / base / %diff)
read/clickbench/URL/shard-0/fsst	48.340877 / 48.575839 / -0.5%
read/clickbench/URL/shard-0/onpair-12	38.017118 / 38.017365 / -0.0%
read/tpch/l_comment/fsst	96.790492 / 96.458862 / +0.3%
read/tpch/l_comment/onpair-12	109.012692 / 107.643914 / +1.3%
write/clickbench/URL/shard-0/fsst	864.400057 / 868.769656 / -0.5%
write/clickbench/URL/shard-0/onpair-12	2083.52875 / 2037.84467 / +2.2%
write/tpch/l_comment/fsst	3097.66469 / 3081.93447 / +0.5%
write/tpch/l_comment/onpair-12	3969.96858 / 3946.09877 / +0.6%

vortex / vortex-file-compressed / % (1.000x ➖, 0↑ 0↓)

name	% (PR / base / %diff)
size/clickbench/URL/shard-0/fsst	47.4687942 / 47.4687942 / +0.0%
size/clickbench/URL/shard-0/onpair-12	29.7508863 / 29.7508863 / +0.0%
size/tpch/l_comment/fsst	30.5060597 / 30.5060597 / +0.0%
size/tpch/l_comment/onpair-12	23.2389616 / 23.2389616 / +0.0%

github-actions · 2026-08-14T12:20:06Z

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on NVME (pr-all) failed! Check the workflow run for details.

github-actions · 2026-08-14T12:20:55Z

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=1 on S3 (pr-all) failed! Check the workflow run for details.

github-actions · 2026-08-14T12:21:04Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR 0a464a16 vs base 17bd9e27
Vortex (geomean): hot 0.994x ➖ · cold 1.013x ➖

datafusion / vortex-file-compressed / ns (0.994x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	99427574 / 114397560 / -13.1% 🟢	195935450 / 200267203 / -2.2%	0.51 / 0.57 / -11.2%
polarsignals_q01/datafusion:vortex-file-compressed	155603706 / 159037656 / -2.2%	265097464 / 266936168 / -0.7%	0.59 / 0.60 / -1.5%
polarsignals_q02/datafusion:vortex-file-compressed	21013393 / 20914258 / +0.5%	84811676 / 79741522 / +6.4%	0.25 / 0.26 / -5.5%
polarsignals_q03/datafusion:vortex-file-compressed	157133688 / 164825572 / -4.7%	259959118 / 267601721 / -2.9%	0.60 / 0.62 / -1.9%
polarsignals_q04/datafusion:vortex-file-compressed	10081554 / 11255690 / -10.4% 🟢	69606100 / 69112511 / +0.7%	0.14 / 0.16 / -11.1%
polarsignals_q05/datafusion:vortex-file-compressed	13926786 / 14385990 / -3.2%	77515322 / 80750606 / -4.0%	0.18 / 0.18 / +0.8%
polarsignals_q06/datafusion:vortex-file-compressed	31312324 / 23807786 / +31.5% 🔴	87845202 / 86786580 / +1.2%	0.36 / 0.27 / +29.9%
polarsignals_q07/datafusion:vortex-file-compressed	12184475 / 11729864 / +3.9%	74558896 / 74353872 / +0.3%	0.16 / 0.16 / +3.6%
polarsignals_q08/datafusion:vortex-file-compressed	284428320 / 279132286 / +1.9%	395254177 / 375239080 / +5.3%	0.72 / 0.74 / -3.3%
polarsignals_q09/datafusion:vortex-file-compressed	12179204 / 12666912 / -3.9%	73470142 / 66975912 / +9.7%	0.17 / 0.19 / -12.3%

No file size changes detected.

github-actions · 2026-08-14T12:21:23Z

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-DS SF=1 on NVME (pr-all) failed! Check the workflow run for details.

github-actions · 2026-08-14T12:22:19Z

Benchmarks: FineWeb NVMe 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.1%
Engines: DataFusion No clear signal (+1.1%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.991x ➖ · cold 0.991x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.983x ➖
Shifts: Parquet (control) -0.7% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	8296502 / 8623330 / -3.8%	38432942 / 36057984 / +6.6%	0.22 / 0.24 / -9.7%
fineweb_q01/datafusion:vortex-file-compressed	28970242 / 28677068 / +1.0%	103763583 / 103048519 / +0.7%	0.28 / 0.28 / +0.3%
fineweb_q02/datafusion:vortex-file-compressed	34008978 / 33023122 / +3.0%	111905337 / 106921231 / +4.7%	0.30 / 0.31 / -1.6%
fineweb_q03/datafusion:vortex-file-compressed	43358964 / 43330196 / +0.1%	182514823 / 182754525 / -0.1%	0.24 / 0.24 / +0.2%
fineweb_q04/datafusion:vortex-file-compressed	209591964 / 206679574 / +1.4%	345643369 / 321334209 / +7.6%	0.61 / 0.64 / -5.7%
fineweb_q05/datafusion:vortex-file-compressed	153955296 / 152090434 / +1.2%	287527648 / 278137343 / +3.4%	0.54 / 0.55 / -2.1%
fineweb_q06/datafusion:vortex-file-compressed	39564577 / 37744855 / +4.8%	195824748 / 184441678 / +6.2%	0.20 / 0.20 / -1.3%
fineweb_q07/datafusion:vortex-file-compressed	36755446 / 38273886 / -4.0%	192066152 / 178652010 / +7.5%	0.19 / 0.21 / -10.7%
fineweb_q08/datafusion:vortex-file-compressed	18174772 / 18641613 / -2.5%	67624417 / 78351061 / -13.7% 🟢	0.27 / 0.24 / +13.0%

datafusion / vortex-compact / ns (1.000x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	8833746 / 9064592 / -2.5%	38362010 / 36670676 / +4.6%	0.23 / 0.25 / -6.8%
fineweb_q01/datafusion:vortex-compact	103001094 / 99789837 / +3.2%	170373104 / 169131419 / +0.7%	0.60 / 0.59 / +2.5%
fineweb_q02/datafusion:vortex-compact	100654612 / 100048016 / +0.6%	174826519 / 163988890 / +6.6%	0.58 / 0.61 / -5.6%
fineweb_q03/datafusion:vortex-compact	535115660 / 530377401 / +0.9%	633526222 / 631249980 / +0.4%	0.84 / 0.84 / +0.5%
fineweb_q04/datafusion:vortex-compact	562638658 / 582168176 / -3.4%	661803742 / 664587042 / -0.4%	0.85 / 0.88 / -2.9%
fineweb_q05/datafusion:vortex-compact	514341819 / 501787279 / +2.5%	598659358 / 636921265 / -6.0%	0.86 / 0.79 / +9.1%
fineweb_q06/datafusion:vortex-compact	288543491 / 286713286 / +0.6%	406020629 / 421634092 / -3.7%	0.71 / 0.68 / +4.5%
fineweb_q07/datafusion:vortex-compact	297252016 / 293084380 / +1.4%	410558657 / 428977738 / -4.3%	0.72 / 0.68 / +6.0%
fineweb_q08/datafusion:vortex-compact	16864047 / 17400048 / -3.1%	74211663 / 71321060 / +4.1%	0.23 / 0.24 / -6.9%

datafusion / parquet / ns (0.990x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	8520145 / 8486138 / +0.4%	55573569 / 50359049 / +10.4% 🔴	0.15 / 0.17 / -9.0%
fineweb_q01/datafusion:parquet	188022896 / 196812876 / -4.5%	283149174 / 328402794 / -13.8% 🟢	0.66 / 0.60 / +10.8%
fineweb_q02/datafusion:parquet	188708313 / 196543086 / -4.0%	287531830 / 327279256 / -12.1% 🟢	0.66 / 0.60 / +9.3%
fineweb_q03/datafusion:parquet	188211698 / 190425544 / -1.2%	295391199 / 293275990 / +0.7%	0.64 / 0.65 / -1.9%
fineweb_q04/datafusion:parquet	207734120 / 207860532 / -0.1%	299303006 / 304758054 / -1.8%	0.69 / 0.68 / +1.8%
fineweb_q05/datafusion:parquet	205288282 / 203715638 / +0.8%	295069039 / 293523012 / +0.5%	0.70 / 0.69 / +0.2%
fineweb_q06/datafusion:parquet	192504608 / 196003382 / -1.8%	288674802 / 332649873 / -13.2% 🟢	0.67 / 0.59 / +13.2%
fineweb_q07/datafusion:parquet	191756446 / 191222285 / +0.3%	285585370 / 283770144 / +0.6%	0.67 / 0.67 / -0.4%
fineweb_q08/datafusion:parquet	187982966 / 186224804 / +0.9%	285652773 / 282526935 / +1.1%	0.66 / 0.66 / -0.2%

duckdb / vortex-file-compressed / ns (0.936x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	3107401 / 4985404 / -37.7% 🟢	17845323 / 14318499 / +24.6% 🔴	0.17 / 0.35 / -50.0%
fineweb_q01/duckdb:vortex-file-compressed	41036936 / 40299518 / +1.8%	110982326 / 116336801 / -4.6%	0.37 / 0.35 / +6.7%
fineweb_q02/duckdb:vortex-file-compressed	49327120 / 50010728 / -1.4%	134102234 / 127015148 / +5.6%	0.37 / 0.39 / -6.6%
fineweb_q03/duckdb:vortex-file-compressed	64643166 / 65348373 / -1.1%	177328347 / 218731506 / -18.9% 🟢	0.36 / 0.30 / +22.0%
fineweb_q04/duckdb:vortex-file-compressed	282956686 / 290388896 / -2.6%	405645569 / 422174821 / -3.9%	0.70 / 0.69 / +1.4%
fineweb_q05/duckdb:vortex-file-compressed	214424219 / 219273494 / -2.2%	329330990 / 332164202 / -0.9%	0.65 / 0.66 / -1.4%
fineweb_q06/duckdb:vortex-file-compressed	59276242 / 64583907 / -8.2%	214428452 / 267771763 / -19.9% 🟢	0.28 / 0.24 / +14.6%
fineweb_q07/duckdb:vortex-file-compressed	58679602 / 60402936 / -2.9%	199223324 / 184933700 / +7.7%	0.29 / 0.33 / -9.8%
fineweb_q08/duckdb:vortex-file-compressed	27558817 / 26188212 / +5.2%	95383708 / 90873961 / +5.0%	0.29 / 0.29 / +0.3%

duckdb / vortex-compact / ns (1.031x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	4577311 / 3720470 / +23.0% 🔴	15026371 / 15784611 / -4.8%	0.30 / 0.24 / +29.2%
fineweb_q01/duckdb:vortex-compact	102751196 / 101682582 / +1.1%	214623635 / 185613559 / +15.6% 🔴	0.48 / 0.55 / -12.6%
fineweb_q02/duckdb:vortex-compact	109543534 / 109086319 / +0.4%	166860434 / 193703297 / -13.9% 🟢	0.66 / 0.56 / +16.6%
fineweb_q03/duckdb:vortex-compact	400918548 / 407080349 / -1.5%	560098300 / 552708482 / +1.3%	0.72 / 0.74 / -2.8%
fineweb_q04/duckdb:vortex-compact	456511146 / 456190780 / +0.1%	543059812 / 557137380 / -2.5%	0.84 / 0.82 / +2.7%
fineweb_q05/duckdb:vortex-compact	410328712 / 401268366 / +2.3%	523997081 / 610533163 / -14.2% 🟢	0.78 / 0.66 / +19.1%
fineweb_q06/duckdb:vortex-compact	245705591 / 235890642 / +4.2%	422260655 / 431294546 / -2.1%	0.58 / 0.55 / +6.4%
fineweb_q07/duckdb:vortex-compact	244813088 / 243279094 / +0.6%	357486597 / 366745306 / -2.5%	0.68 / 0.66 / +3.2%
fineweb_q08/duckdb:vortex-compact	24297066 / 24413357 / -0.5%	86780525 / 101343485 / -14.4% 🟢	0.28 / 0.24 / +16.2%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	34911105 / 36885892 / -5.4%	43085854 / 40515254 / +6.3%	0.81 / 0.91 / -11.0%
fineweb_q01/duckdb:parquet	77148820 / 75662060 / +2.0%	108812978 / 108692189 / +0.1%	0.71 / 0.70 / +1.9%
fineweb_q02/duckdb:parquet	77544609 / 78417496 / -1.1%	101697359 / 107931851 / -5.8%	0.76 / 0.73 / +4.9%
fineweb_q03/duckdb:parquet	209061612 / 207568736 / +0.7%	412137375 / 432269894 / -4.7%	0.51 / 0.48 / +5.6%
fineweb_q04/duckdb:parquet	229916532 / 232588622 / -1.1%	414691609 / 426062366 / -2.7%	0.55 / 0.55 / +1.6%
fineweb_q05/duckdb:parquet	203517040 / 203532040 / -0.0%	428151750 / 424259153 / +0.9%	0.48 / 0.48 / -0.9%
fineweb_q06/duckdb:parquet	144243256 / 142377556 / +1.3%	280581104 / 277169951 / +1.2%	0.51 / 0.51 / +0.1%
fineweb_q07/duckdb:parquet	145039688 / 144764786 / +0.2%	327906965 / 333053490 / -1.5%	0.44 / 0.43 / +1.8%
fineweb_q08/duckdb:parquet	37936708 / 38023190 / -0.2%	46093156 / 42973922 / +7.3%	0.82 / 0.88 / -7.0%

No file size changes detected.

github-actions · 2026-08-14T12:23:52Z

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on NVME (pr-all) failed! Check the workflow run for details.

github-actions · 2026-08-14T12:24:38Z

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Benchmark TPC-H SF=10 on S3 (pr-all) failed! Check the workflow run for details.

github-actions · 2026-08-14T12:25:38Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +10.3%
Engines: DataFusion No clear signal (+22.5%, environment too noisy confidence) · DuckDB No clear signal (-0.8%, low confidence)
Vortex (geomean): hot 1.009x ➖ · cold 1.018x ➖
Parquet (geomean): hot 0.916x ➖ · cold 0.938x ➖
Shifts: Parquet (control) -8.4% · Median polish -0.4%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.028x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	431358206 / 353746119 / +21.9% 🔴	964105210 / 813660453 / +18.5% 🔴	0.45 / 0.43 / +2.9%
clickbench-sorted_q24/datafusion:vortex-file-compressed	26593022 / 24587699 / +8.2%	91594017 / 85182992 / +7.5%	0.29 / 0.29 / +0.6%
clickbench-sorted_q26/datafusion:vortex-file-compressed	26916878 / 27135075 / -0.8%	88721795 / 84981913 / +4.4%	0.30 / 0.32 / -5.0%
clickbench-sorted_q36/datafusion:vortex-file-compressed	47687618 / 47861286 / -0.4%	126529639 / 123562674 / +2.4%	0.38 / 0.39 / -2.7%
clickbench-sorted_q37/datafusion:vortex-file-compressed	36307306 / 35733284 / +1.6%	111272148 / 102718860 / +8.3%	0.33 / 0.35 / -6.2%
clickbench-sorted_q38/datafusion:vortex-file-compressed	33255653 / 33197116 / +0.2%	103383455 / 102339168 / +1.0%	0.32 / 0.32 / -0.8%
clickbench-sorted_q39/datafusion:vortex-file-compressed	85503818 / 84974242 / +0.6%	172181687 / 167417201 / +2.8%	0.50 / 0.51 / -2.2%
clickbench-sorted_q40/datafusion:vortex-file-compressed	17503776 / 16714150 / +4.7%	80482970 / 75953623 / +6.0%	0.22 / 0.22 / -1.2%
clickbench-sorted_q41/datafusion:vortex-file-compressed	16083264 / 16858906 / -4.6%	81553336 / 73219907 / +11.4% 🔴	0.20 / 0.23 / -14.3%
clickbench-sorted_q42/datafusion:vortex-file-compressed	13090648 / 13229754 / -1.1%	64491038 / 60859851 / +6.0%	0.20 / 0.22 / -6.6%

datafusion / vortex-compact / ns (1.018x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-compact	251138390 / 226049686 / +11.1% 🔴	420211264 / 493700586 / -14.9% 🟢	0.60 / 0.46 / +30.5%
clickbench-sorted_q24/datafusion:vortex-compact	55468451 / 55686598 / -0.4%	111856137 / 108543481 / +3.1%	0.50 / 0.51 / -3.3%
clickbench-sorted_q26/datafusion:vortex-compact	57028555 / 56094462 / +1.7%	110262169 / 109088467 / +1.1%	0.52 / 0.51 / +0.6%
clickbench-sorted_q36/datafusion:vortex-compact	57314130 / 57098410 / +0.4%	138584423 / 130960174 / +5.8%	0.41 / 0.44 / -5.1%
clickbench-sorted_q37/datafusion:vortex-compact	48122552 / 48204548 / -0.2%	118364739 / 114055149 / +3.8%	0.41 / 0.42 / -3.8%
clickbench-sorted_q38/datafusion:vortex-compact	45166828 / 45827015 / -1.4%	121938401 / 114982078 / +6.0%	0.37 / 0.40 / -7.1%
clickbench-sorted_q39/datafusion:vortex-compact	104313598 / 103029514 / +1.2%	180745440 / 182074079 / -0.7%	0.58 / 0.57 / +2.0%
clickbench-sorted_q40/datafusion:vortex-compact	27731362 / 26351884 / +5.2%	83908090 / 80366174 / +4.4%	0.33 / 0.33 / +0.8%
clickbench-sorted_q41/datafusion:vortex-compact	23698866 / 23571983 / +0.5%	80737295 / 75262717 / +7.3%	0.29 / 0.31 / -6.3%
clickbench-sorted_q42/datafusion:vortex-compact	16205334 / 16096992 / +0.7%	72954033 / 60857577 / +19.9% 🔴	0.22 / 0.26 / -16.0%

datafusion / parquet / ns (0.835x ✅, 3↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	2484224638 / 2936560838 / -15.4% 🟢	2931762282 / 3470257411 / -15.5% 🟢	0.85 / 0.85 / +0.1%
clickbench-sorted_q24/datafusion:parquet	16243882 / 32915342 / -50.6% 🟢	114369144 / 152318402 / -24.9% 🟢	0.14 / 0.22 / -34.3%
clickbench-sorted_q26/datafusion:parquet	18813758 / 33544941 / -43.9% 🟢	117541969 / 150121543 / -21.7% 🟢	0.16 / 0.22 / -28.4%
clickbench-sorted_q36/datafusion:parquet	152559580 / 164104873 / -7.0%	266667019 / 283811837 / -6.0%	0.57 / 0.58 / -1.1%
clickbench-sorted_q37/datafusion:parquet	103099941 / 110479223 / -6.7%	199491129 / 220733259 / -9.6%	0.52 / 0.50 / +3.3%
clickbench-sorted_q38/datafusion:parquet	145398234 / 159536609 / -8.9%	255753358 / 280235822 / -8.7%	0.57 / 0.57 / -0.1%
clickbench-sorted_q39/datafusion:parquet	288687002 / 285004892 / +1.3%	397113838 / 433644924 / -8.4%	0.73 / 0.66 / +10.6%
clickbench-sorted_q40/datafusion:parquet	63245216 / 67973454 / -7.0%	170928255 / 184021991 / -7.1%	0.37 / 0.37 / +0.2%
clickbench-sorted_q41/datafusion:parquet	57718184 / 60047623 / -3.9%	174844765 / 186467801 / -6.2%	0.33 / 0.32 / +2.5%
clickbench-sorted_q42/datafusion:parquet	33396225 / 33862125 / -1.4%	133844981 / 143111325 / -6.5%	0.25 / 0.24 / +5.5%

duckdb / vortex-file-compressed / ns (1.007x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	107078524 / 90399460 / +18.5% 🔴	198243953 / 184596473 / +7.4%	0.54 / 0.49 / +10.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed	31595253 / 29624084 / +6.7%	75703857 / 68895974 / +9.9%	0.42 / 0.43 / -2.9%
clickbench-sorted_q26/duckdb:vortex-file-compressed	27411496 / 29807654 / -8.0%	86069608 / 93971569 / -8.4%	0.32 / 0.32 / +0.4%
clickbench-sorted_q36/duckdb:vortex-file-compressed	61213560 / 60632666 / +1.0%	174665705 / 172215226 / +1.4%	0.35 / 0.35 / -0.5%
clickbench-sorted_q37/duckdb:vortex-file-compressed	48712925 / 50357556 / -3.3%	159703721 / 161248158 / -1.0%	0.31 / 0.31 / -2.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed	53007676 / 56209523 / -5.7%	170953819 / 158602181 / +7.8%	0.31 / 0.35 / -12.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed	112356754 / 107890152 / +4.1%	245508840 / 255516040 / -3.9%	0.46 / 0.42 / +8.4%
clickbench-sorted_q40/duckdb:vortex-file-compressed	26110072 / 27418292 / -4.8%	110191086 / 115531676 / -4.6%	0.24 / 0.24 / -0.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed	27174627 / 26993630 / +0.7%	110795561 / 118838432 / -6.8%	0.25 / 0.23 / +8.0%
clickbench-sorted_q42/duckdb:vortex-file-compressed	22333630 / 22334968 / -0.0%	102240395 / 107945108 / -5.3%	0.22 / 0.21 / +5.6%

duckdb / vortex-compact / ns (0.985x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-compact	115292682 / 123565896 / -6.7%	215082976 / 201262103 / +6.9%	0.54 / 0.61 / -12.7%
clickbench-sorted_q24/duckdb:vortex-compact	35587078 / 32585264 / +9.2%	84782452 / 88188804 / -3.9%	0.42 / 0.37 / +13.6%
clickbench-sorted_q26/duckdb:vortex-compact	31212746 / 35282208 / -11.5% 🟢	95467439 / 89643253 / +6.5%	0.33 / 0.39 / -16.9%
clickbench-sorted_q36/duckdb:vortex-compact	73521434 / 72177016 / +1.9%	193418376 / 198385071 / -2.5%	0.38 / 0.36 / +4.5%
clickbench-sorted_q37/duckdb:vortex-compact	59816481 / 63960386 / -6.5%	175459238 / 198810803 / -11.7% 🟢	0.34 / 0.32 / +6.0%
clickbench-sorted_q38/duckdb:vortex-compact	63439560 / 68020205 / -6.7%	170244798 / 188976425 / -9.9%	0.37 / 0.36 / +3.5%
clickbench-sorted_q39/duckdb:vortex-compact	127169545 / 129126855 / -1.5%	266973821 / 241780412 / +10.4% 🔴	0.48 / 0.53 / -10.8%
clickbench-sorted_q40/duckdb:vortex-compact	35211096 / 33832700 / +4.1%	126387400 / 137651957 / -8.2%	0.28 / 0.25 / +13.3%
clickbench-sorted_q41/duckdb:vortex-compact	35409082 / 36301074 / -2.5%	121821574 / 125043982 / -2.6%	0.29 / 0.29 / +0.1%
clickbench-sorted_q42/duckdb:vortex-compact	28354209 / 26334765 / +7.7%	113828302 / 116805471 / -2.5%	0.25 / 0.23 / +10.5%

duckdb / parquet / ns (1.003x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	216953712 / 214305118 / +1.2%	265711530 / 254449730 / +4.4%	0.82 / 0.84 / -3.1%
clickbench-sorted_q24/duckdb:parquet	33496737 / 34988842 / -4.3%	58985593 / 56338212 / +4.7%	0.57 / 0.62 / -8.6%
clickbench-sorted_q26/duckdb:parquet	24981536 / 24937799 / +0.2%	46809517 / 54598311 / -14.3% 🟢	0.53 / 0.46 / +16.8%
clickbench-sorted_q36/duckdb:parquet	72016122 / 69947782 / +3.0%	102294722 / 104842660 / -2.4%	0.70 / 0.67 / +5.5%
clickbench-sorted_q37/duckdb:parquet	61050552 / 62559026 / -2.4%	92695656 / 93191933 / -0.5%	0.66 / 0.67 / -1.9%
clickbench-sorted_q38/duckdb:parquet	64627202 / 61914178 / +4.4%	95232750 / 97989013 / -2.8%	0.68 / 0.63 / +7.4%
clickbench-sorted_q39/duckdb:parquet	106168018 / 106995490 / -0.8%	160768480 / 158500435 / +1.4%	0.66 / 0.68 / -2.2%
clickbench-sorted_q40/duckdb:parquet	29415650 / 30582422 / -3.8%	71987569 / 67758170 / +6.2%	0.41 / 0.45 / -9.5%
clickbench-sorted_q41/duckdb:parquet	29303200 / 30354991 / -3.5%	63115974 / 61467317 / +2.7%	0.46 / 0.49 / -6.0%
clickbench-sorted_q42/duckdb:parquet	22728091 / 20597944 / +10.3% 🔴	43966790 / 44578994 / -1.4%	0.52 / 0.46 / +11.9%

File Size Changes (200 files changed, +0.0% overall, 105↑ 95↓)

File	Scale	Format	Base	HEAD	Change	%
hits_038.vortex	1.0	vortex-file-compressed	190.03 MB	193.82 MB	+3.79 MB	+2.0%
hits_012.vortex	1.0	vortex-file-compressed	190.86 MB	193.67 MB	+2.81 MB	+1.5%
hits_063.vortex	1.0	vortex-compact	97.84 MB	99.13 MB	+1.29 MB	+1.3%
hits_087.vortex	1.0	vortex-file-compressed	159.61 MB	161.06 MB	+1.45 MB	+0.9%
hits_030.vortex	1.0	vortex-compact	98.03 MB	98.90 MB	+891.86 KB	+0.9%
hits_061.vortex	1.0	vortex-compact	123.46 MB	124.53 MB	+1.07 MB	+0.9%
hits_086.vortex	1.0	vortex-compact	139.66 MB	140.81 MB	+1.15 MB	+0.8%
hits_097.vortex	1.0	vortex-file-compressed	192.78 MB	194.23 MB	+1.45 MB	+0.8%
hits_078.vortex	1.0	vortex-compact	97.16 MB	97.81 MB	+675.33 KB	+0.7%
hits_087.vortex	1.0	vortex-compact	124.79 MB	125.62 MB	+856.96 KB	+0.7%
hits_050.vortex	1.0	vortex-compact	125.61 MB	126.41 MB	+820.09 KB	+0.6%
hits_028.vortex	1.0	vortex-file-compressed	151.79 MB	152.73 MB	+956.93 KB	+0.6%
hits_076.vortex	1.0	vortex-compact	125.43 MB	126.17 MB	+753.64 KB	+0.6%
hits_006.vortex	1.0	vortex-compact	95.93 MB	96.43 MB	+509.69 KB	+0.5%
hits_055.vortex	1.0	vortex-file-compressed	198.60 MB	199.57 MB	+997.42 KB	+0.5%
hits_037.vortex	1.0	vortex-compact	132.26 MB	132.90 MB	+658.04 KB	+0.5%
hits_045.vortex	1.0	vortex-file-compressed	140.06 MB	140.70 MB	+661.16 KB	+0.5%
hits_019.vortex	1.0	vortex-compact	106.19 MB	106.67 MB	+494.47 KB	+0.5%
hits_010.vortex	1.0	vortex-file-compressed	169.08 MB	169.84 MB	+770.39 KB	+0.4%
hits_052.vortex	1.0	vortex-file-compressed	130.93 MB	131.50 MB	+576.10 KB	+0.4%
hits_075.vortex	1.0	vortex-compact	139.07 MB	139.65 MB	+594.99 KB	+0.4%
hits_022.vortex	1.0	vortex-file-compressed	198.06 MB	198.88 MB	+844.12 KB	+0.4%
hits_058.vortex	1.0	vortex-compact	111.06 MB	111.52 MB	+473.26 KB	+0.4%
hits_043.vortex	1.0	vortex-compact	94.32 MB	94.69 MB	+382.60 KB	+0.4%
hits_082.vortex	1.0	vortex-compact	105.74 MB	106.14 MB	+403.08 KB	+0.4%
hits_039.vortex	1.0	vortex-file-compressed	161.16 MB	161.75 MB	+599.56 KB	+0.4%
hits_071.vortex	1.0	vortex-compact	105.77 MB	106.14 MB	+383.95 KB	+0.4%
hits_005.vortex	1.0	vortex-compact	115.82 MB	116.21 MB	+400.77 KB	+0.3%
hits_008.vortex	1.0	vortex-compact	105.77 MB	106.11 MB	+352.55 KB	+0.3%
hits_063.vortex	1.0	vortex-file-compressed	131.55 MB	131.97 MB	+428.59 KB	+0.3%
hits_015.vortex	1.0	vortex-compact	97.87 MB	98.16 MB	+300.09 KB	+0.3%
hits_053.vortex	1.0	vortex-compact	138.44 MB	138.81 MB	+375.68 KB	+0.3%
hits_040.vortex	1.0	vortex-compact	110.16 MB	110.45 MB	+298.01 KB	+0.3%
hits_033.vortex	1.0	vortex-file-compressed	199.46 MB	199.98 MB	+531.56 KB	+0.3%
hits_093.vortex	1.0	vortex-compact	98.56 MB	98.81 MB	+256.88 KB	+0.3%
hits_044.vortex	1.0	vortex-compact	153.39 MB	153.76 MB	+373.92 KB	+0.2%
hits_016.vortex	1.0	vortex-file-compressed	180.47 MB	180.89 MB	+426.01 KB	+0.2%
hits_037.vortex	1.0	vortex-file-compressed	177.20 MB	177.57 MB	+373.44 KB	+0.2%
hits_052.vortex	1.0	vortex-compact	98.14 MB	98.34 MB	+204.93 KB	+0.2%
hits_077.vortex	1.0	vortex-compact	134.14 MB	134.40 MB	+263.26 KB	+0.2%
hits_026.vortex	1.0	vortex-file-compressed	131.30 MB	131.54 MB	+250.29 KB	+0.2%
hits_059.vortex	1.0	vortex-file-compressed	199.01 MB	199.37 MB	+370.16 KB	+0.2%
hits_094.vortex	1.0	vortex-file-compressed	159.06 MB	159.32 MB	+272.30 KB	+0.2%
hits_099.vortex	1.0	vortex-compact	132.99 MB	133.21 MB	+224.84 KB	+0.2%
hits_046.vortex	1.0	vortex-file-compressed	101.23 MB	101.39 MB	+164.70 KB	+0.2%
hits_068.vortex	1.0	vortex-compact	112.40 MB	112.57 MB	+182.31 KB	+0.2%
hits_036.vortex	1.0	vortex-compact	133.26 MB	133.47 MB	+209.68 KB	+0.2%
hits_081.vortex	1.0	vortex-compact	153.47 MB	153.70 MB	+232.09 KB	+0.1%
hits_035.vortex	1.0	vortex-file-compressed	102.78 MB	102.91 MB	+136.08 KB	+0.1%
hits_048.vortex	1.0	vortex-file-compressed	199.60 MB	199.85 MB	+255.76 KB	+0.1%
hits_090.vortex	1.0	vortex-compact	141.20 MB	141.35 MB	+155.12 KB	+0.1%
hits_022.vortex	1.0	vortex-compact	153.03 MB	153.19 MB	+165.03 KB	+0.1%
hits_024.vortex	1.0	vortex-file-compressed	160.45 MB	160.61 MB	+169.25 KB	+0.1%
hits_096.vortex	1.0	vortex-compact	153.07 MB	153.23 MB	+155.78 KB	+0.1%
hits_051.vortex	1.0	vortex-compact	133.84 MB	133.96 MB	+128.14 KB	+0.1%
hits_060.vortex	1.0	vortex-file-compressed	193.17 MB	193.34 MB	+175.05 KB	+0.1%
hits_072.vortex	1.0	vortex-compact	75.53 MB	75.60 MB	+68.37 KB	+0.1%
hits_076.vortex	1.0	vortex-file-compressed	160.77 MB	160.91 MB	+143.57 KB	+0.1%
hits_073.vortex	1.0	vortex-compact	134.18 MB	134.30 MB	+119.80 KB	+0.1%
hits_072.vortex	1.0	vortex-file-compressed	102.15 MB	102.23 MB	+89.47 KB	+0.1%
hits_023.vortex	1.0	vortex-file-compressed	195.32 MB	195.48 MB	+167.42 KB	+0.1%
hits_046.vortex	1.0	vortex-compact	74.84 MB	74.90 MB	+60.25 KB	+0.1%
hits_090.vortex	1.0	vortex-file-compressed	192.57 MB	192.72 MB	+152.98 KB	+0.1%
hits_021.vortex	1.0	vortex-compact	110.52 MB	110.60 MB	+85.62 KB	+0.1%
hits_042.vortex	1.0	vortex-file-compressed	201.82 MB	201.97 MB	+151.20 KB	+0.1%
hits_055.vortex	1.0	vortex-compact	153.27 MB	153.38 MB	+113.30 KB	+0.1%
hits_010.vortex	1.0	vortex-compact	123.31 MB	123.39 MB	+88.47 KB	+0.1%
hits_000.vortex	1.0	vortex-file-compressed	131.57 MB	131.66 MB	+90.17 KB	+0.1%
hits_012.vortex	1.0	vortex-compact	139.92 MB	140.01 MB	+94.66 KB	+0.1%
hits_017.vortex	1.0	vortex-compact	112.11 MB	112.19 MB	+75.59 KB	+0.1%
hits_050.vortex	1.0	vortex-file-compressed	161.01 MB	161.10 MB	+95.04 KB	+0.1%
hits_014.vortex	1.0	vortex-compact	133.80 MB	133.88 MB	+77.35 KB	+0.1%
hits_098.vortex	1.0	vortex-compact	104.03 MB	104.09 MB	+59.33 KB	+0.1%
hits_071.vortex	1.0	vortex-file-compressed	139.94 MB	140.01 MB	+79.49 KB	+0.1%
hits_043.vortex	1.0	vortex-file-compressed	126.41 MB	126.48 MB	+70.01 KB	+0.1%
hits_075.vortex	1.0	vortex-file-compressed	189.53 MB	189.63 MB	+103.57 KB	+0.1%
hits_023.vortex	1.0	vortex-compact	142.63 MB	142.70 MB	+77.42 KB	+0.1%
hits_031.vortex	1.0	vortex-compact	111.58 MB	111.64 MB	+58.29 KB	+0.1%
hits_074.vortex	1.0	vortex-compact	152.92 MB	153.00 MB	+79.38 KB	+0.1%
hits_032.vortex	1.0	vortex-compact	110.59 MB	110.64 MB	+51.23 KB	+0.0%
hits_051.vortex	1.0	vortex-file-compressed	172.30 MB	172.38 MB	+75.37 KB	+0.0%
hits_019.vortex	1.0	vortex-file-compressed	140.79 MB	140.85 MB	+61.40 KB	+0.0%
hits_020.vortex	1.0	vortex-compact	111.58 MB	111.62 MB	+46.43 KB	+0.0%
hits_080.vortex	1.0	vortex-file-compressed	126.77 MB	126.82 MB	+50.73 KB	+0.0%
hits_011.vortex	1.0	vortex-compact	152.88 MB	152.93 MB	+53.04 KB	+0.0%
hits_018.vortex	1.0	vortex-file-compressed	199.54 MB	199.60 MB	+64.73 KB	+0.0%
hits_083.vortex	1.0	vortex-compact	110.06 MB	110.09 MB	+30.54 KB	+0.0%
hits_095.vortex	1.0	vortex-file-compressed	154.33 MB	154.37 MB	+38.20 KB	+0.0%
hits_044.vortex	1.0	vortex-file-compressed	200.01 MB	200.06 MB	+48.56 KB	+0.0%
hits_082.vortex	1.0	vortex-file-compressed	139.90 MB	139.93 MB	+33.93 KB	+0.0%
hits_057.vortex	1.0	vortex-compact	111.78 MB	111.80 MB	+23.10 KB	+0.0%
hits_029.vortex	1.0	vortex-compact	153.50 MB	153.53 MB	+29.87 KB	+0.0%
hits_003.vortex	1.0	vortex-file-compressed	136.44 MB	136.46 MB	+21.00 KB	+0.0%
hits_088.vortex	1.0	vortex-file-compressed	171.96 MB	171.98 MB	+24.51 KB	+0.0%
hits_021.vortex	1.0	vortex-file-compressed	154.30 MB	154.32 MB	+20.06 KB	+0.0%
hits_081.vortex	1.0	vortex-file-compressed	199.88 MB	199.90 MB	+25.23 KB	+0.0%
hits_009.vortex	1.0	vortex-compact	75.19 MB	75.20 MB	+5.70 KB	+0.0%
hits_067.vortex	1.0	vortex-file-compressed	131.76 MB	131.77 MB	+8.48 KB	+0.0%
hits_094.vortex	1.0	vortex-compact	110.72 MB	110.73 MB	+6.80 KB	+0.0%
hits_018.vortex	1.0	vortex-compact	153.64 MB	153.65 MB	+8.73 KB	+0.0%
hits_013.vortex	1.0	vortex-file-compressed	161.28 MB	161.28 MB	+6.04 KB	+0.0%
hits_035.vortex	1.0	vortex-compact	75.90 MB	75.91 MB	+2.77 KB	+0.0%
hits_098.vortex	1.0	vortex-file-compressed	137.57 MB	137.58 MB	+4.45 KB	+0.0%
hits_062.vortex	1.0	vortex-file-compressed	170.71 MB	170.71 MB	+5.39 KB	+0.0%
hits_032.vortex	1.0	vortex-file-compressed	154.67 MB	154.67 MB	+1.31 KB	+0.0%
hits_009.vortex	1.0	vortex-file-compressed	101.20 MB	101.20 MB	1.32 KB	-0.0%
hits_004.vortex	1.0	vortex-compact	97.61 MB	97.61 MB	1.28 KB	-0.0%
hits_092.vortex	1.0	vortex-file-compressed	199.40 MB	199.40 MB	5.52 KB	-0.0%
hits_034.vortex	1.0	vortex-compact	133.38 MB	133.38 MB	4.41 KB	-0.0%
hits_028.vortex	1.0	vortex-compact	115.77 MB	115.76 MB	10.33 KB	-0.0%
hits_013.vortex	1.0	vortex-compact	124.41 MB	124.40 MB	13.64 KB	-0.0%
hits_084.vortex	1.0	vortex-compact	110.66 MB	110.64 MB	14.34 KB	-0.0%
hits_006.vortex	1.0	vortex-file-compressed	126.34 MB	126.32 MB	16.70 KB	-0.0%
hits_069.vortex	1.0	vortex-file-compressed	142.27 MB	142.24 MB	25.91 KB	-0.0%
hits_042.vortex	1.0	vortex-compact	136.29 MB	136.25 MB	37.62 KB	-0.0%
hits_024.vortex	1.0	vortex-compact	125.08 MB	125.05 MB	36.90 KB	-0.0%
hits_083.vortex	1.0	vortex-file-compressed	157.13 MB	157.08 MB	52.91 KB	-0.0%
hits_062.vortex	1.0	vortex-compact	132.60 MB	132.56 MB	48.92 KB	-0.0%
hits_092.vortex	1.0	vortex-compact	153.29 MB	153.23 MB	62.91 KB	-0.0%
hits_089.vortex	1.0	vortex-file-compressed	131.52 MB	131.47 MB	54.48 KB	-0.0%
hits_056.vortex	1.0	vortex-file-compressed	135.67 MB	135.61 MB	59.90 KB	-0.0%
hits_027.vortex	1.0	vortex-compact	139.28 MB	139.22 MB	61.60 KB	-0.0%
hits_015.vortex	1.0	vortex-file-compressed	131.12 MB	131.06 MB	58.02 KB	-0.0%
hits_056.vortex	1.0	vortex-compact	101.30 MB	101.26 MB	46.62 KB	-0.0%
hits_008.vortex	1.0	vortex-file-compressed	140.38 MB	140.32 MB	65.40 KB	-0.0%
hits_011.vortex	1.0	vortex-file-compressed	199.21 MB	199.11 MB	95.21 KB	-0.0%
hits_025.vortex	1.0	vortex-file-compressed	172.06 MB	171.97 MB	87.78 KB	-0.0%
hits_057.vortex	1.0	vortex-file-compressed	159.95 MB	159.87 MB	87.98 KB	-0.1%
hits_041.vortex	1.0	vortex-file-compressed	131.21 MB	131.14 MB	73.55 KB	-0.1%
hits_073.vortex	1.0	vortex-file-compressed	172.64 MB	172.55 MB	97.61 KB	-0.1%
hits_027.vortex	1.0	vortex-file-compressed	190.11 MB	190.00 MB	110.51 KB	-0.1%
hits_034.vortex	1.0	vortex-file-compressed	181.98 MB	181.88 MB	106.48 KB	-0.1%
hits_033.vortex	1.0	vortex-compact	153.47 MB	153.39 MB	90.71 KB	-0.1%
hits_053.vortex	1.0	vortex-file-compressed	189.89 MB	189.78 MB	116.44 KB	-0.1%
hits_047.vortex	1.0	vortex-compact	110.46 MB	110.39 MB	69.48 KB	-0.1%
hits_095.vortex	1.0	vortex-compact	110.69 MB	110.62 MB	72.64 KB	-0.1%
hits_007.vortex	1.0	vortex-file-compressed	200.34 MB	200.21 MB	132.55 KB	-0.1%
hits_064.vortex	1.0	vortex-compact	140.10 MB	140.01 MB	93.87 KB	-0.1%
hits_003.vortex	1.0	vortex-compact	104.57 MB	104.50 MB	73.70 KB	-0.1%
hits_054.vortex	1.0	vortex-file-compressed	146.95 MB	146.85 MB	107.39 KB	-0.1%
hits_007.vortex	1.0	vortex-compact	153.59 MB	153.48 MB	114.28 KB	-0.1%
hits_036.vortex	1.0	vortex-file-compressed	171.41 MB	171.28 MB	131.49 KB	-0.1%
hits_045.vortex	1.0	vortex-compact	106.13 MB	106.05 MB	82.65 KB	-0.1%
hits_059.vortex	1.0	vortex-compact	152.92 MB	152.80 MB	119.38 KB	-0.1%
hits_077.vortex	1.0	vortex-file-compressed	172.47 MB	172.33 MB	140.03 KB	-0.1%
hits_064.vortex	1.0	vortex-file-compressed	191.04 MB	190.88 MB	166.84 KB	-0.1%
hits_054.vortex	1.0	vortex-compact	112.25 MB	112.15 MB	106.73 KB	-0.1%
hits_058.vortex	1.0	vortex-file-compressed	155.24 MB	155.10 MB	149.48 KB	-0.1%
hits_074.vortex	1.0	vortex-file-compressed	199.32 MB	199.12 MB	197.07 KB	-0.1%
hits_086.vortex	1.0	vortex-file-compressed	192.21 MB	192.02 MB	196.50 KB	-0.1%
hits_002.vortex	1.0	vortex-file-compressed	161.04 MB	160.88 MB	169.24 KB	-0.1%
hits_067.vortex	1.0	vortex-compact	99.44 MB	99.34 MB	107.48 KB	-0.1%
hits_079.vortex	1.0	vortex-file-compressed	180.99 MB	180.79 MB	200.27 KB	-0.1%
hits_085.vortex	1.0	vortex-file-compressed	200.06 MB	199.83 MB	234.12 KB	-0.1%
hits_020.vortex	1.0	vortex-file-compressed	160.28 MB	160.09 MB	194.77 KB	-0.1%
hits_014.vortex	1.0	vortex-file-compressed	172.33 MB	172.10 MB	233.57 KB	-0.1%
hits_025.vortex	1.0	vortex-compact	133.60 MB	133.42 MB	181.90 KB	-0.1%
hits_093.vortex	1.0	vortex-file-compressed	131.75 MB	131.57 MB	184.52 KB	-0.1%
hits_048.vortex	1.0	vortex-compact	153.33 MB	153.11 MB	219.28 KB	-0.1%
hits_060.vortex	1.0	vortex-compact	141.32 MB	141.10 MB	217.24 KB	-0.2%
hits_004.vortex	1.0	vortex-file-compressed	131.50 MB	131.30 MB	202.37 KB	-0.2%
hits_016.vortex	1.0	vortex-compact	127.39 MB	127.19 MB	202.28 KB	-0.2%
hits_047.vortex	1.0	vortex-file-compressed	154.66 MB	154.41 MB	251.59 KB	-0.2%
hits_070.vortex	1.0	vortex-compact	153.80 MB	153.55 MB	257.95 KB	-0.2%
hits_085.vortex	1.0	vortex-compact	153.53 MB	153.28 MB	257.69 KB	-0.2%
hits_068.vortex	1.0	vortex-file-compressed	160.50 MB	160.24 MB	271.09 KB	-0.2%
hits_088.vortex	1.0	vortex-compact	134.09 MB	133.87 MB	233.61 KB	-0.2%
hits_084.vortex	1.0	vortex-file-compressed	154.60 MB	154.32 MB	285.51 KB	-0.2%
hits_030.vortex	1.0	vortex-file-compressed	132.19 MB	131.93 MB	263.15 KB	-0.2%
hits_049.vortex	1.0	vortex-file-compressed	191.75 MB	191.37 MB	391.59 KB	-0.2%
hits_079.vortex	1.0	vortex-compact	128.04 MB	127.78 MB	271.28 KB	-0.2%
hits_078.vortex	1.0	vortex-file-compressed	131.00 MB	130.72 MB	291.02 KB	-0.2%
hits_005.vortex	1.0	vortex-file-compressed	167.87 MB	167.50 MB	376.93 KB	-0.2%
hits_017.vortex	1.0	vortex-file-compressed	147.19 MB	146.85 MB	344.51 KB	-0.2%
hits_069.vortex	1.0	vortex-compact	100.05 MB	99.82 MB	236.85 KB	-0.2%
hits_029.vortex	1.0	vortex-file-compressed	200.23 MB	199.75 MB	491.98 KB	-0.2%
hits_065.vortex	1.0	vortex-compact	125.63 MB	125.24 MB	395.32 KB	-0.3%
hits_000.vortex	1.0	vortex-compact	97.87 MB	97.57 MB	311.12 KB	-0.3%
hits_031.vortex	1.0	vortex-file-compressed	160.03 MB	159.49 MB	558.04 KB	-0.3%
hits_040.vortex	1.0	vortex-file-compressed	143.73 MB	143.20 MB	543.23 KB	-0.4%
hits_099.vortex	1.0	vortex-file-compressed	171.72 MB	171.08 MB	656.02 KB	-0.4%
hits_089.vortex	1.0	vortex-compact	98.81 MB	98.43 MB	381.57 KB	-0.4%
hits_049.vortex	1.0	vortex-compact	139.94 MB	139.40 MB	552.95 KB	-0.4%
hits_061.vortex	1.0	vortex-file-compressed	161.34 MB	160.71 MB	641.79 KB	-0.4%
hits_091.vortex	1.0	vortex-file-compressed	147.41 MB	146.83 MB	602.72 KB	-0.4%
hits_039.vortex	1.0	vortex-compact	124.24 MB	123.74 MB	511.13 KB	-0.4%
hits_066.vortex	1.0	vortex-compact	118.21 MB	117.69 MB	536.17 KB	-0.4%
hits_091.vortex	1.0	vortex-compact	112.38 MB	111.70 MB	695.90 KB	-0.6%
hits_096.vortex	1.0	vortex-file-compressed	199.39 MB	198.09 MB	1.30 MB	-0.7%
hits_080.vortex	1.0	vortex-compact	97.13 MB	96.47 MB	683.75 KB	-0.7%
hits_097.vortex	1.0	vortex-compact	141.29 MB	140.28 MB	1.01 MB	-0.7%
hits_002.vortex	1.0	vortex-compact	125.24 MB	124.30 MB	956.61 KB	-0.7%
hits_065.vortex	1.0	vortex-file-compressed	161.25 MB	159.97 MB	1.28 MB	-0.8%
hits_070.vortex	1.0	vortex-file-compressed	200.36 MB	198.75 MB	1.60 MB	-0.8%
hits_001.vortex	1.0	vortex-file-compressed	190.75 MB	189.04 MB	1.71 MB	-0.9%
hits_038.vortex	1.0	vortex-compact	139.60 MB	138.23 MB	1.37 MB	-1.0%
hits_066.vortex	1.0	vortex-file-compressed	164.66 MB	163.04 MB	1.62 MB	-1.0%
hits_001.vortex	1.0	vortex-compact	138.95 MB	137.56 MB	1.39 MB	-1.0%
hits_041.vortex	1.0	vortex-compact	98.09 MB	97.11 MB	1004.20 KB	-1.0%
hits_026.vortex	1.0	vortex-compact	98.88 MB	97.87 MB	1.00 MB	-1.0%

Totals:

vortex-compact: 11.93 GB → 11.93 GB (+0.0%)
vortex-file-compressed: 15.96 GB → 15.96 GB (+0.0%)

github-actions · 2026-08-14T12:28:37Z

Benchmarks: Appian on NVME 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.9%
Engines: DataFusion No clear signal (+6.9%, environment too noisy confidence) · DuckDB No clear signal (+0.9%, low confidence)
Vortex (geomean): hot 0.980x ➖ · cold 0.987x ➖
Parquet (geomean): hot 0.944x ➖ · cold 0.962x ➖
Shifts: Parquet (control) -5.6% · Median polish -0.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-compact / ns (0.953x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:vortex-compact	96204549 / 98572893 / -2.4%	161177785 / 159127764 / +1.3%	0.60 / 0.62 / -3.6%
appian_q02/datafusion:vortex-compact	439305097 / 477256458 / -8.0%	551461410 / 573118705 / -3.8%	0.80 / 0.83 / -4.3%
appian_q03/datafusion:vortex-compact	292301505 / 272251495 / +7.4%	423167529 / 412390491 / +2.6%	0.69 / 0.66 / +4.6%
appian_q04/datafusion:vortex-compact	13591633701 / 13440420187 / +1.1%	13887409672 / 13710800414 / +1.3%	0.98 / 0.98 / -0.2%
appian_q05/datafusion:vortex-compact	205469256 / 221825985 / -7.4%	287595350 / 295236206 / -2.6%	0.71 / 0.75 / -4.9%
appian_q06/datafusion:vortex-compact	258395244 / 262206159 / -1.5%	329331320 / 330712852 / -0.4%	0.78 / 0.79 / -1.0%
appian_q07/datafusion:vortex-compact	285564003 / 347480448 / -17.8% 🟢	390428853 / 447812510 / -12.8% 🟢	0.73 / 0.78 / -5.7%
appian_q08/datafusion:vortex-compact	1265324447 / 1356911534 / -6.7%	1387695170 / 1457573459 / -4.8%	0.91 / 0.93 / -2.1%

datafusion / parquet / ns (0.892x ✅, 5↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/datafusion:parquet	108453727 / 132810481 / -18.3% 🟢	169235228 / 185798780 / -8.9%	0.64 / 0.71 / -10.3%
appian_q02/datafusion:parquet	495391559 / 579952731 / -14.6% 🟢	595032227 / 674727894 / -11.8% 🟢	0.83 / 0.86 / -3.1%
appian_q03/datafusion:parquet	306834592 / 296719939 / +3.4%	459684682 / 434837721 / +5.7%	0.67 / 0.68 / -2.2%
appian_q04/datafusion:parquet	13762833344 / 13630316414 / +1.0%	13765019607 / 13719682715 / +0.3%	1.00 / 0.99 / +0.6%
appian_q05/datafusion:parquet	245225190 / 302177910 / -18.8% 🟢	326241789 / 383486058 / -14.9% 🟢	0.75 / 0.79 / -4.6%
appian_q06/datafusion:parquet	291686862 / 296691290 / -1.7%	369664571 / 373366687 / -1.0%	0.79 / 0.79 / -0.7%
appian_q07/datafusion:parquet	321294498 / 417758386 / -23.1% 🟢	435574486 / 538768422 / -19.2% 🟢	0.74 / 0.78 / -4.9%
appian_q08/datafusion:parquet	1341140332 / 1497091501 / -10.4% 🟢	1452495323 / 1630978586 / -10.9% 🟢	0.92 / 0.92 / +0.6%

duckdb / vortex-compact / ns (1.008x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:vortex-compact	152960242 / 149745777 / +2.1%	200506689 / 197634515 / +1.5%	0.76 / 0.76 / +0.7%
appian_q02/duckdb:vortex-compact	417194906 / 409548000 / +1.9%	474731270 / 492436447 / -3.6%	0.88 / 0.83 / +5.7%
appian_q03/duckdb:vortex-compact	253161392 / 256107465 / -1.2%	305376554 / 315276714 / -3.1%	0.83 / 0.81 / +2.1%
appian_q04/duckdb:vortex-compact	1583691480 / 1554020446 / +1.9%	1658950641 / 1637339600 / +1.3%	0.95 / 0.95 / +0.6%
appian_q05/duckdb:vortex-compact	237940884 / 242648478 / -1.9%	297966244 / 279210518 / +6.7%	0.80 / 0.87 / -8.1%
appian_q06/duckdb:vortex-compact	1013920486 / 991774258 / +2.2%	1054057865 / 1060407888 / -0.6%	0.96 / 0.94 / +2.8%
appian_q07/duckdb:vortex-compact	297573166 / 298419246 / -0.3%	349223795 / 363168465 / -3.8%	0.85 / 0.82 / +3.7%
appian_q08/duckdb:vortex-compact	924363481 / 910706474 / +1.5%	969075357 / 961402261 / +0.8%	0.95 / 0.95 / +0.7%

duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
appian_q01/duckdb:parquet	156496373 / 156017537 / +0.3%	179282154 / 185594204 / -3.4%	0.87 / 0.84 / +3.8%
appian_q02/duckdb:parquet	367683039 / 357151795 / +2.9%	379180567 / 396406095 / -4.3%	0.97 / 0.90 / +7.6%
appian_q03/duckdb:parquet	221650577 / 221478405 / +0.1%	246440612 / 238934286 / +3.1%	0.90 / 0.93 / -3.0%
appian_q04/duckdb:parquet	1465796897 / 1479193620 / -0.9%	1515778065 / 1509980988 / +0.4%	0.97 / 0.98 / -1.3%
appian_q05/duckdb:parquet	245902282 / 248641691 / -1.1%	270593570 / 255810664 / +5.8%	0.91 / 0.97 / -6.5%
appian_q06/duckdb:parquet	960300176 / 993826559 / -3.4%	1043353041 / 1027224521 / +1.6%	0.92 / 0.97 / -4.9%
appian_q07/duckdb:parquet	262104644 / 264529627 / -0.9%	279717487 / 300107108 / -6.8%	0.94 / 0.88 / +6.3%
appian_q08/duckdb:parquet	788228663 / 774339513 / +1.8%	842504486 / 780788524 / +7.9%	0.94 / 0.99 / -5.7%

File Size Changes (10 files changed, -63.8% overall, 0↑ 10↓)

File	Scale	Format	Base	Change	%
addressview.vortex	1.0	vortex-file-compressed	34.61 MB	34.61 MB	-100.0%
categoryview.vortex	1.0	vortex-file-compressed	18.98 KB	18.98 KB	-100.0%
creditcardview.vortex	1.0	vortex-file-compressed	58.78 MB	58.78 MB	-100.0%
customerview.vortex	1.0	vortex-file-compressed	20.03 MB	20.03 MB	-100.0%
duckdb.db	1.0	vortex-file-compressed	268.00 KB	268.00 KB	-100.0%
orderitemnovelty_update.vortex	1.0	vortex-file-compressed	2.58 KB	2.58 KB	-100.0%
orderitemview.vortex	1.0	vortex-file-compressed	265.16 MB	265.16 MB	-100.0%
orderview.vortex	1.0	vortex-file-compressed	78.50 MB	78.50 MB	-100.0%
productview.vortex	1.0	vortex-file-compressed	18.96 KB	18.96 KB	-100.0%
taxrecordview.vortex	1.0	vortex-file-compressed	21.91 MB	21.91 MB	-100.0%

Totals:

vortex-compact: 271.86 MB → 271.86 MB (0.0%)
vortex-file-compressed: 479.28 MB → 0 B (-100.0%)

github-actions · 2026-08-14T12:28:39Z

Benchmarks: FineWeb S3 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +6.8%
Engines: DataFusion No clear signal (-7.8%, environment too noisy confidence) · DuckDB No clear signal (+23.6%, environment too noisy confidence)
Vortex (geomean): hot 0.993x ➖ · cold 1.026x ➖
Parquet (geomean): hot 0.930x ➖ · cold 1.067x ➖
Shifts: Parquet (control) -7.0% · Median polish -0.2%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.943x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	43118278 / 41869142 / +3.0%	147595630 / 149077876 / -1.0%	0.29 / 0.28 / +4.0%
fineweb_q01/datafusion:vortex-file-compressed	386540172 / 489987425 / -21.1%	708453234 / 590951710 / +19.9%	0.55 / 0.83 / -34.2%
fineweb_q02/datafusion:vortex-file-compressed	366496766 / 375567552 / -2.4%	391867396 / 395418981 / -0.9%	0.94 / 0.95 / -1.5%
fineweb_q03/datafusion:vortex-file-compressed	471087660 / 804432996 / -41.4% 🟢	625960208 / 685951146 / -8.7%	0.75 / 1.17 / -35.8%
fineweb_q04/datafusion:vortex-file-compressed	669104138 / 675068572 / -0.9%	456874096 / 618036362 / -26.1%	1.46 / 1.09 / +34.1%
fineweb_q05/datafusion:vortex-file-compressed	559259918 / 576668206 / -3.0%	512851578 / 449833415 / +14.0%	1.09 / 1.28 / -14.9%
fineweb_q06/datafusion:vortex-file-compressed	678268962 / 671116628 / +1.1%	770181976 / 877115752 / -12.2%	0.88 / 0.77 / +15.1%
fineweb_q07/datafusion:vortex-file-compressed	461606076 / 472588250 / -2.3%	444103595 / 511741200 / -13.2%	1.04 / 0.92 / +12.6%
fineweb_q08/datafusion:vortex-file-compressed	245380141 / 183287625 / +33.9% 🔴	373174033 / 208540858 / +78.9% 🔴	0.66 / 0.88 / -25.2%

datafusion / vortex-compact / ns (0.952x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-compact	49978324 / 64925957 / -23.0%	159010847 / 120589987 / +31.9% 🔴	0.31 / 0.54 / -41.6%
fineweb_q01/datafusion:vortex-compact	457061608 / 478640864 / -4.5%	711370539 / 1075727822 / -33.9% 🟢	0.64 / 0.44 / +44.4%
fineweb_q02/datafusion:vortex-compact	419154804 / 440612512 / -4.9%	453815543 / 512971311 / -11.5%	0.92 / 0.86 / +7.5%
fineweb_q03/datafusion:vortex-compact	812375164 / 760723376 / +6.8%	868151932 / 795041683 / +9.2%	0.94 / 0.96 / -2.2%
fineweb_q04/datafusion:vortex-compact	967369536 / 978231428 / -1.1%	795997109 / 826236811 / -3.7%	1.22 / 1.18 / +2.6%
fineweb_q05/datafusion:vortex-compact	870333548 / 901925272 / -3.5%	721981277 / 733918776 / -1.6%	1.21 / 1.23 / -1.9%
fineweb_q06/datafusion:vortex-compact	745063706 / 665101942 / +12.0%	757156584 / 784533691 / -3.5%	0.98 / 0.85 / +16.1%
fineweb_q07/datafusion:vortex-compact	553473800 / 567751544 / -2.5%	544406048 / 609988536 / -10.8%	1.02 / 0.93 / +9.2%
fineweb_q08/datafusion:vortex-compact	166751306 / 202475206 / -17.6%	226263719 / 201962887 / +12.0%	0.74 / 1.00 / -26.5%

datafusion / parquet / ns (1.028x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	490120976 / 486926808 / +0.7%	1055337363 / 940109530 / +12.3%	0.46 / 0.52 / -10.3%
fineweb_q01/datafusion:parquet	839056042 / 873858021 / -4.0%	879698679 / 899759358 / -2.2%	0.95 / 0.97 / -1.8%
fineweb_q02/datafusion:parquet	869310904 / 926577236 / -6.2%	888963078 / 1087544885 / -18.3%	0.98 / 0.85 / +14.8%
fineweb_q03/datafusion:parquet	832354804 / 920037554 / -9.5%	907849255 / 968401036 / -6.3%	0.92 / 0.95 / -3.5%
fineweb_q04/datafusion:parquet	1075510036 / 944307504 / +13.9%	1185895960 / 970866299 / +22.1%	0.91 / 0.97 / -6.8%
fineweb_q05/datafusion:parquet	907711116 / 895627850 / +1.3%	1012449097 / 928276843 / +9.1%	0.90 / 0.96 / -7.1%
fineweb_q06/datafusion:parquet	1080067466 / 789582874 / +36.8% 🔴	999198754 / 860337036 / +16.1%	1.08 / 0.92 / +17.8%
fineweb_q07/datafusion:parquet	934349155 / 900508938 / +3.8%	968078761 / 880119549 / +10.0%	0.97 / 1.02 / -5.7%
fineweb_q08/datafusion:parquet	889366218 / 935355402 / -4.9%	890719928 / 901172387 / -1.2%	1.00 / 1.04 / -3.8%

duckdb / vortex-file-compressed / ns (0.955x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	71716672 / 71341772 / +0.5%	143551402 / 112612280 / +27.5%	0.50 / 0.63 / -21.1%
fineweb_q01/duckdb:vortex-file-compressed	557822365 / 541224580 / +3.1%	721130316 / 674754283 / +6.9%	0.77 / 0.80 / -3.6%
fineweb_q02/duckdb:vortex-file-compressed	665695509 / 656872148 / +1.3%	678662928 / 680693395 / -0.3%	0.98 / 0.97 / +1.6%
fineweb_q03/duckdb:vortex-file-compressed	1419435176 / 1493197992 / -4.9%	1701414881 / 1939906918 / -12.3%	0.83 / 0.77 / +8.4%
fineweb_q04/duckdb:vortex-file-compressed	1652157398 / 2343336152 / -29.5%	1766044317 / 1874364996 / -5.8%	0.94 / 1.25 / -25.2%
fineweb_q05/duckdb:vortex-file-compressed	1485596071 / 1461905930 / +1.6%	1487573780 / 1404934255 / +5.9%	1.00 / 1.04 / -4.0%
fineweb_q06/duckdb:vortex-file-compressed	1585642736 / 1665411058 / -4.8%	1645920796 / 1774183978 / -7.2%	0.96 / 0.94 / +2.6%
fineweb_q07/duckdb:vortex-file-compressed	1534616160 / 1458968952 / +5.2%	1494117863 / 1569701084 / -4.8%	1.03 / 0.93 / +10.5%
fineweb_q08/duckdb:vortex-file-compressed	607165114 / 658132794 / -7.7%	667042253 / 706837200 / -5.6%	0.91 / 0.93 / -2.2%

duckdb / vortex-compact / ns (1.133x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-compact	69269374 / 72803572 / -4.9%	80017269 / 79227622 / +1.0%	0.87 / 0.92 / -5.8%
fineweb_q01/duckdb:vortex-compact	496817247 / 572686434 / -13.2%	673875403 / 670745181 / +0.5%	0.74 / 0.85 / -13.7%
fineweb_q02/duckdb:vortex-compact	835545062 / 810873172 / +3.0%	779726175 / 740400738 / +5.3%	1.07 / 1.10 / -2.2%
fineweb_q03/duckdb:vortex-compact	1924712198 / 1828471855 / +5.3%	1845907303 / 1989492406 / -7.2%	1.04 / 0.92 / +13.5%
fineweb_q04/duckdb:vortex-compact	1887261351 / 1908325550 / -1.1%	1885932780 / 1838061309 / +2.6%	1.00 / 1.04 / -3.6%
fineweb_q05/duckdb:vortex-compact	1723588666 / 1556061830 / +10.8%	1962920371 / 1836080945 / +6.9%	0.88 / 0.85 / +3.6%
fineweb_q06/duckdb:vortex-compact	12715771896 / 1559699862 / +715.3% 🔴	10910338833 / 1571417217 / +594.3% 🔴	1.17 / 0.99 / +17.4%
fineweb_q07/duckdb:vortex-compact	1558862932 / 1527488190 / +2.1%	1443106987 / 1456258957 / -0.9%	1.08 / 1.05 / +3.0%
fineweb_q08/duckdb:vortex-compact	550573131 / 1458180348 / -62.2% 🟢	595544940 / 1678741123 / -64.5% 🟢	0.92 / 0.87 / +6.4%

duckdb / parquet / ns (0.842x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	5264018410 / 5276749156 / -0.2%	773206924 / 584865965 / +32.2% 🔴	6.81 / 9.02 / -24.5%
fineweb_q01/duckdb:parquet	5290610880 / 5313765068 / -0.4%	987917999 / 651788031 / +51.6% 🔴	5.36 / 8.15 / -34.3%
fineweb_q02/duckdb:parquet	639326591 / 2951257341 / -78.3% 🟢	621624282 / 784925939 / -20.8%	1.03 / 3.76 / -72.6%
fineweb_q03/duckdb:parquet	5302530052 / 5342193500 / -0.7%	1311403401 / 1194612194 / +9.8%	4.04 / 4.47 / -9.6%
fineweb_q04/duckdb:parquet	5290473077 / 5316274022 / -0.5%	951972224 / 877716116 / +8.5%	5.56 / 6.06 / -8.2%
fineweb_q05/duckdb:parquet	5299982040 / 5310266357 / -0.2%	870673660 / 868492118 / +0.3%	6.09 / 6.11 / -0.4%
fineweb_q06/duckdb:parquet	5364322424 / 5414540010 / -0.9%	1440707417 / 1516893813 / -5.0%	3.72 / 3.57 / +4.3%
fineweb_q07/duckdb:parquet	3202657892 / 3196381662 / +0.2%	989877262 / 997540187 / -0.8%	3.24 / 3.20 / +1.0%
fineweb_q08/duckdb:parquet	5285356328 / 5256109656 / +0.6%	713395155 / 556984957 / +28.1%	7.41 / 9.44 / -21.5%

github-actions · 2026-08-14T12:28:45Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DuckDB No clear signal (-0.3%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 1.031x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.021x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.992x ➖, 2↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	14964974 / 17010972 / -12.0% 🟢	26652462 / 26013169 / +2.5%	0.56 / 0.65 / -14.1%
statpopgen_q01/duckdb:vortex-file-compressed	17233947 / 17573588 / -1.9%	30850781 / 31170965 / -1.0%	0.56 / 0.56 / -0.9%
statpopgen_q02/duckdb:vortex-file-compressed	589268491 / 563316972 / +4.6%	793382736 / 749189868 / +5.9%	0.74 / 0.75 / -1.2%
statpopgen_q03/duckdb:vortex-file-compressed	1230325250 / 1165991846 / +5.5%	1741064603 / 1211472602 / +43.7% 🔴	0.71 / 0.96 / -26.6%
statpopgen_q04/duckdb:vortex-file-compressed	1272300795 / 1200469462 / +6.0%	1334401836 / 1225243566 / +8.9%	0.95 / 0.98 / -2.7%
statpopgen_q05/duckdb:vortex-file-compressed	665200334 / 562105308 / +18.3% 🔴	632718388 / 636580744 / -0.6%	1.05 / 0.88 / +19.1%
statpopgen_q06/duckdb:vortex-file-compressed	1808458172 / 1992470306 / -9.2%	2156178600 / 2226445744 / -3.2%	0.84 / 0.89 / -6.3%
statpopgen_q07/duckdb:vortex-file-compressed	236344118 / 260005199 / -9.1%	297245802 / 417075608 / -28.7% 🟢	0.80 / 0.62 / +27.5%
statpopgen_q08/duckdb:vortex-file-compressed	293512856 / 262755126 / +11.7% 🔴	407713439 / 328988048 / +23.9% 🔴	0.72 / 0.80 / -9.9%
statpopgen_q09/duckdb:vortex-file-compressed	1110498474 / 1054706262 / +5.3%	973995748 / 978027847 / -0.4%	1.14 / 1.08 / +5.7%
statpopgen_q10/duckdb:vortex-file-compressed	2942747090 / 3715121578 / -20.8% 🟢	2902470630 / 4261044445 / -31.9% 🟢	1.01 / 0.87 / +16.3%

duckdb / vortex-compact / ns (0.997x ➖, 2↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-compact	16936192 / 15084683 / +12.3% 🔴	27955693 / 28547213 / -2.1%	0.61 / 0.53 / +14.6%
statpopgen_q01/duckdb:vortex-compact	13722157 / 13910684 / -1.4%	21573215 / 21590641 / -0.1%	0.64 / 0.64 / -1.3%
statpopgen_q02/duckdb:vortex-compact	701657531 / 662612392 / +5.9%	740240971 / 686473067 / +7.8%	0.95 / 0.97 / -1.8%
statpopgen_q03/duckdb:vortex-compact	1428777943 / 1405923890 / +1.6%	1895206298 / 1355623412 / +39.8% 🔴	0.75 / 1.04 / -27.3%
statpopgen_q04/duckdb:vortex-compact	1417018782 / 1834802184 / -22.8% 🟢	1977478791 / 1422552056 / +39.0% 🔴	0.72 / 1.29 / -44.4%
statpopgen_q05/duckdb:vortex-compact	720937223 / 781070362 / -7.7%	699273946 / 713075251 / -1.9%	1.03 / 1.10 / -5.9%
statpopgen_q06/duckdb:vortex-compact	1851845872 / 1804380462 / +2.6%	1750627514 / 1764787231 / -0.8%	1.06 / 1.02 / +3.5%
statpopgen_q07/duckdb:vortex-compact	1311004864 / 1297128029 / +1.1%	1364511385 / 1360005518 / +0.3%	0.96 / 0.95 / +0.7%
statpopgen_q08/duckdb:vortex-compact	1345126635 / 1326456273 / +1.4%	1391527656 / 1371582997 / +1.5%	0.97 / 0.97 / -0.0%
statpopgen_q09/duckdb:vortex-compact	1126246843 / 1266384514 / -11.1% 🟢	1105927010 / 1088988933 / +1.6%	1.02 / 1.16 / -12.4%
statpopgen_q10/duckdb:vortex-compact	3849701614 / 3147789448 / +22.3% 🔴	2987675066 / 3018960679 / -1.0%	1.29 / 1.04 / +23.6%

duckdb / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	375846853 / 378375662 / -0.7%	379785403 / 377619352 / +0.6%	0.99 / 1.00 / -1.2%
statpopgen_q01/duckdb:parquet	466077322 / 467249614 / -0.3%	470254615 / 474451977 / -0.9%	0.99 / 0.98 / +0.6%
statpopgen_q02/duckdb:parquet	773458003 / 777154900 / -0.5%	818791979 / 809731982 / +1.1%	0.94 / 0.96 / -1.6%
statpopgen_q03/duckdb:parquet	1054513334 / 1057795894 / -0.3%	1100876680 / 1094037371 / +0.6%	0.96 / 0.97 / -0.9%
statpopgen_q04/duckdb:parquet	1055555296 / 1059491340 / -0.4%	1089221770 / 1104146659 / -1.4%	0.97 / 0.96 / +1.0%
statpopgen_q05/duckdb:parquet	781144589 / 771493101 / +1.3%	802996205 / 813081945 / -1.2%	0.97 / 0.95 / +2.5%
statpopgen_q06/duckdb:parquet	1022386769 / 1029100589 / -0.7%	1056417502 / 1071441896 / -1.4%	0.97 / 0.96 / +0.8%
statpopgen_q07/duckdb:parquet	952463604 / 943963848 / +0.9%	1159180454 / 1129027652 / +2.7%	0.82 / 0.84 / -1.7%
statpopgen_q08/duckdb:parquet	957013554 / 972722533 / -1.6%	1329512022 / 1054881008 / +26.0% 🔴	0.72 / 0.92 / -21.9%
statpopgen_q09/duckdb:parquet	1002495044 / 1002963831 / -0.0%	1051646353 / 1055812330 / -0.4%	0.95 / 0.95 / +0.3%
statpopgen_q10/duckdb:parquet	1670966174 / 1670969826 / -0.0%	1712148862 / 1709415483 / +0.2%	0.98 / 0.98 / -0.2%

No file size changes detected.

github-actions · 2026-08-14T12:29:28Z

Benchmarks: Clickbench on NVME 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.0%
Engines: DataFusion No clear signal (+2.1%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 0.997x ➖ · cold 1.006x ➖
Parquet (geomean): hot 0.987x ➖ · cold 0.981x ➖
Shifts: Parquet (control) -1.3% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1899578 / 1878295 / +1.1%	42042199 / 37837417 / +11.1% 🔴	0.05 / 0.05 / -9.0%
clickbench_q01/datafusion:vortex-file-compressed	11262584 / 10978231 / +2.6%	59915162 / 56785901 / +5.5%	0.19 / 0.19 / -2.8%
clickbench_q02/datafusion:vortex-file-compressed	21964000 / 22443348 / -2.1%	75555792 / 70752220 / +6.8%	0.29 / 0.32 / -8.4%
clickbench_q03/datafusion:vortex-file-compressed	24930966 / 25127438 / -0.8%	99564019 / 94429675 / +5.4%	0.25 / 0.27 / -5.9%
clickbench_q04/datafusion:vortex-file-compressed	156519742 / 154350955 / +1.4%	234849481 / 231030090 / +1.7%	0.67 / 0.67 / -0.2%
clickbench_q05/datafusion:vortex-file-compressed	211760159 / 207158198 / +2.2%	294385743 / 291245431 / +1.1%	0.72 / 0.71 / +1.1%
clickbench_q06/datafusion:vortex-file-compressed	1866292 / 1977258 / -5.6%	40010709 / 37168847 / +7.6%	0.05 / 0.05 / -12.3%
clickbench_q07/datafusion:vortex-file-compressed	14923950 / 14737883 / +1.3%	68337955 / 61141987 / +11.8% 🔴	0.22 / 0.24 / -9.4%
clickbench_q08/datafusion:vortex-file-compressed	216854814 / 211375395 / +2.6%	305860645 / 298825536 / +2.4%	0.71 / 0.71 / +0.2%
clickbench_q09/datafusion:vortex-file-compressed	330878343 / 327686686 / +1.0%	409034690 / 428067747 / -4.4%	0.81 / 0.77 / +5.7%
clickbench_q10/datafusion:vortex-file-compressed	48505255 / 47537698 / +2.0%	123057397 / 121485641 / +1.3%	0.39 / 0.39 / +0.7%
clickbench_q11/datafusion:vortex-file-compressed	56708506 / 55596064 / +2.0%	131541999 / 125725631 / +4.6%	0.43 / 0.44 / -2.5%
clickbench_q12/datafusion:vortex-file-compressed	192111572 / 188924566 / +1.7%	279348768 / 285885800 / -2.3%	0.69 / 0.66 / +4.1%
clickbench_q13/datafusion:vortex-file-compressed	329111578 / 334726288 / -1.7%	441189480 / 448412911 / -1.6%	0.75 / 0.75 / -0.1%
clickbench_q14/datafusion:vortex-file-compressed	188042644 / 190633179 / -1.4%	290313886 / 291483929 / -0.4%	0.65 / 0.65 / -1.0%
clickbench_q15/datafusion:vortex-file-compressed	182513947 / 179462290 / +1.7%	265258762 / 260077531 / +2.0%	0.69 / 0.69 / -0.3%
clickbench_q16/datafusion:vortex-file-compressed	454572246 / 453910068 / +0.1%	557104526 / 568370792 / -2.0%	0.82 / 0.80 / +2.2%
clickbench_q17/datafusion:vortex-file-compressed	450815302 / 466918578 / -3.4%	565391631 / 576636786 / -2.0%	0.80 / 0.81 / -1.5%
clickbench_q18/datafusion:vortex-file-compressed	873283090 / 898063148 / -2.8%	993523125 / 997001788 / -0.3%	0.88 / 0.90 / -2.4%
clickbench_q19/datafusion:vortex-file-compressed	17090084 / 16446609 / +3.9%	84760838 / 87236295 / -2.8%	0.20 / 0.19 / +6.9%
clickbench_q20/datafusion:vortex-file-compressed	180935276 / 180702004 / +0.1%	383680672 / 377984792 / +1.5%	0.47 / 0.48 / -1.4%
clickbench_q21/datafusion:vortex-file-compressed	257883872 / 249765079 / +3.3%	466110313 / 473204416 / -1.5%	0.55 / 0.53 / +4.8%
clickbench_q22/datafusion:vortex-file-compressed	311232816 / 323975688 / -3.9%	589876760 / 611897993 / -3.6%	0.53 / 0.53 / -0.3%
clickbench_q23/datafusion:vortex-file-compressed	388699690 / 411524286 / -5.5%	702775612 / 669112730 / +5.0%	0.55 / 0.62 / -10.1%
clickbench_q24/datafusion:vortex-file-compressed	36935206 / 37097787 / -0.4%	116083372 / 115293128 / +0.7%	0.32 / 0.32 / -1.1%
clickbench_q25/datafusion:vortex-file-compressed	48232104 / 46376952 / +4.0%	117313291 / 112831242 / +4.0%	0.41 / 0.41 / +0.0%
clickbench_q26/datafusion:vortex-file-compressed	36532174 / 36922718 / -1.1%	117040712 / 109838988 / +6.6%	0.31 / 0.34 / -7.1%
clickbench_q27/datafusion:vortex-file-compressed	267512012 / 267201596 / +0.1%	458676661 / 454361936 / +0.9%	0.58 / 0.59 / -0.8%
clickbench_q28/datafusion:vortex-file-compressed	1406676420 / 1444584812 / -2.6%	1471603224 / 1547528561 / -4.9%	0.96 / 0.93 / +2.4%
clickbench_q29/datafusion:vortex-file-compressed	35752835 / 36507141 / -2.1%	90572078 / 89592143 / +1.1%	0.39 / 0.41 / -3.1%
clickbench_q30/datafusion:vortex-file-compressed	149991172 / 147486678 / +1.7%	242691760 / 232080344 / +4.6%	0.62 / 0.64 / -2.7%
clickbench_q31/datafusion:vortex-file-compressed	178846776 / 177228706 / +0.9%	318316699 / 321380874 / -1.0%	0.56 / 0.55 / +1.9%
clickbench_q32/datafusion:vortex-file-compressed	817827260 / 813995548 / +0.5%	936029751 / 933974638 / +0.2%	0.87 / 0.87 / +0.3%
clickbench_q33/datafusion:vortex-file-compressed	1016597744 / 1005846867 / +1.1%	1188523208 / 1187314479 / +0.1%	0.86 / 0.85 / +1.0%
clickbench_q34/datafusion:vortex-file-compressed	999374314 / 1008361582 / -0.9%	1184270918 / 1176826701 / +0.6%	0.84 / 0.86 / -1.5%
clickbench_q35/datafusion:vortex-file-compressed	146105008 / 150239586 / -2.8%	215554099 / 219875751 / -2.0%	0.68 / 0.68 / -0.8%
clickbench_q36/datafusion:vortex-file-compressed	57462365 / 56774988 / +1.2%	118218899 / 111504229 / +6.0%	0.49 / 0.51 / -4.5%
clickbench_q37/datafusion:vortex-file-compressed	28914236 / 28650790 / +0.9%	79963785 / 77384864 / +3.3%	0.36 / 0.37 / -2.3%
clickbench_q38/datafusion:vortex-file-compressed	14850006 / 15618468 / -4.9%	69627904 / 66069843 / +5.4%	0.21 / 0.24 / -9.8%
clickbench_q39/datafusion:vortex-file-compressed	108002260 / 113344349 / -4.7%	181949309 / 180838025 / +0.6%	0.59 / 0.63 / -5.3%
clickbench_q40/datafusion:vortex-file-compressed	13021170 / 12962429 / +0.5%	63463551 / 63299094 / +0.3%	0.21 / 0.20 / +0.2%
clickbench_q41/datafusion:vortex-file-compressed	12009383 / 12371520 / -2.9%	64670184 / 62085438 / +4.2%	0.19 / 0.20 / -6.8%
clickbench_q42/datafusion:vortex-file-compressed	12937448 / 13675023 / -5.4%	63773488 / 58314039 / +9.4%	0.20 / 0.23 / -13.5%

datafusion / vortex-compact / ns (1.004x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-compact	1895317 / 1850136 / +2.4%	38458774 / 34818713 / +10.5% 🔴	0.05 / 0.05 / -7.3%
clickbench_q01/datafusion:vortex-compact	14670495 / 14973324 / -2.0%	62274820 / 56968157 / +9.3%	0.24 / 0.26 / -10.4%
clickbench_q02/datafusion:vortex-compact	56577232 / 56063022 / +0.9%	104107312 / 99617736 / +4.5%	0.54 / 0.56 / -3.4%
clickbench_q03/datafusion:vortex-compact	34650624 / 34481994 / +0.5%	84167179 / 82049483 / +2.6%	0.41 / 0.42 / -2.0%
clickbench_q04/datafusion:vortex-compact	161417888 / 160430980 / +0.6%	226243548 / 225899593 / +0.2%	0.71 / 0.71 / +0.5%
clickbench_q05/datafusion:vortex-compact	228050438 / 230630990 / -1.1%	309220637 / 321105212 / -3.7%	0.74 / 0.72 / +2.7%
clickbench_q06/datafusion:vortex-compact	1972348 / 1894833 / +4.1%	40943088 / 37650750 / +8.7%	0.05 / 0.05 / -4.3%
clickbench_q07/datafusion:vortex-compact	25542838 / 25355660 / +0.7%	73894875 / 67119206 / +10.1% 🔴	0.35 / 0.38 / -8.5%
clickbench_q08/datafusion:vortex-compact	245040136 / 246553598 / -0.6%	309008158 / 310031182 / -0.3%	0.79 / 0.80 / -0.3%
clickbench_q09/datafusion:vortex-compact	414821760 / 396528789 / +4.6%	464275857 / 442155566 / +5.0%	0.89 / 0.90 / -0.4%
clickbench_q10/datafusion:vortex-compact	116260178 / 116268048 / -0.0%	171073181 / 167995049 / +1.8%	0.68 / 0.69 / -1.8%
clickbench_q11/datafusion:vortex-compact	159462750 / 158046298 / +0.9%	208585624 / 210798028 / -1.0%	0.76 / 0.75 / +2.0%
clickbench_q12/datafusion:vortex-compact	231086032 / 231804135 / -0.3%	301918491 / 298440639 / +1.2%	0.77 / 0.78 / -1.5%
clickbench_q13/datafusion:vortex-compact	391516384 / 386021527 / +1.4%	500643846 / 475388829 / +5.3%	0.78 / 0.81 / -3.7%
clickbench_q14/datafusion:vortex-compact	230067674 / 234224198 / -1.8%	317194703 / 320452167 / -1.0%	0.73 / 0.73 / -0.8%
clickbench_q15/datafusion:vortex-compact	188102358 / 186548572 / +0.8%	258882085 / 257579016 / +0.5%	0.73 / 0.72 / +0.3%
clickbench_q16/datafusion:vortex-compact	498908776 / 509665460 / -2.1%	576710898 / 609598912 / -5.4%	0.87 / 0.84 / +3.5%
clickbench_q17/datafusion:vortex-compact	496755598 / 505284034 / -1.7%	572598625 / 601732831 / -4.8%	0.87 / 0.84 / +3.3%
clickbench_q18/datafusion:vortex-compact	888693742 / 916409192 / -3.0%	997578395 / 994367336 / +0.3%	0.89 / 0.92 / -3.3%
clickbench_q19/datafusion:vortex-compact	24421655 / 23830306 / +2.5%	71630631 / 72752683 / -1.5%	0.34 / 0.33 / +4.1%
clickbench_q20/datafusion:vortex-compact	229440914 / 230806659 / -0.6%	357423204 / 355491487 / +0.5%	0.64 / 0.65 / -1.1%
clickbench_q21/datafusion:vortex-compact	380876702 / 340228038 / +11.9% 🔴	511927275 / 493755477 / +3.7%	0.74 / 0.69 / +8.0%
clickbench_q22/datafusion:vortex-compact	621088902 / 575819966 / +7.9%	732916618 / 706320370 / +3.8%	0.85 / 0.82 / +3.9%
clickbench_q23/datafusion:vortex-compact	1726438040 / 1688376550 / +2.3%	1783280469 / 1978710845 / -9.9%	0.97 / 0.85 / +13.5%
clickbench_q24/datafusion:vortex-compact	75488988 / 73714654 / +2.4%	129949035 / 131876020 / -1.5%	0.58 / 0.56 / +3.9%
clickbench_q25/datafusion:vortex-compact	106049307 / 107155280 / -1.0%	166422324 / 164168464 / +1.4%	0.64 / 0.65 / -2.4%
clickbench_q26/datafusion:vortex-compact	74351663 / 74065402 / +0.4%	133321646 / 125329717 / +6.4%	0.56 / 0.59 / -5.6%
clickbench_q27/datafusion:vortex-compact	317032334 / 316019417 / +0.3%	471437585 / 470689880 / +0.2%	0.67 / 0.67 / +0.2%
clickbench_q28/datafusion:vortex-compact	1546825216 / 1556891184 / -0.6%	1629894923 / 1611435850 / +1.1%	0.95 / 0.97 / -1.8%
clickbench_q29/datafusion:vortex-compact	64545818 / 65870696 / -2.0%	117092049 / 114545613 / +2.2%	0.55 / 0.58 / -4.1%
clickbench_q30/datafusion:vortex-compact	265991415 / 266976965 / -0.4%	333532885 / 332228163 / +0.4%	0.80 / 0.80 / -0.8%
clickbench_q31/datafusion:vortex-compact	286224304 / 286823860 / -0.2%	376594322 / 377108678 / -0.1%	0.76 / 0.76 / -0.1%
clickbench_q32/datafusion:vortex-compact	846924955 / 846024782 / +0.1%	944112445 / 956354598 / -1.3%	0.90 / 0.88 / +1.4%
clickbench_q33/datafusion:vortex-compact	1034835182 / 1008657101 / +2.6%	1179523967 / 1174270016 / +0.4%	0.88 / 0.86 / +2.1%
clickbench_q34/datafusion:vortex-compact	1030601992 / 1027176445 / +0.3%	1282937484 / 1192097134 / +7.6%	0.80 / 0.86 / -6.8%
clickbench_q35/datafusion:vortex-compact	160548872 / 162148764 / -1.0%	226946905 / 220815354 / +2.8%	0.71 / 0.73 / -3.7%
clickbench_q36/datafusion:vortex-compact	58729270 / 59387263 / -1.1%	117691709 / 116313097 / +1.2%	0.50 / 0.51 / -2.3%
clickbench_q37/datafusion:vortex-compact	30167964 / 30321813 / -0.5%	81396326 / 76115879 / +6.9%	0.37 / 0.40 / -7.0%
clickbench_q38/datafusion:vortex-compact	16812876 / 17606064 / -4.5%	71408866 / 68462617 / +4.3%	0.24 / 0.26 / -8.4%
clickbench_q39/datafusion:vortex-compact	114440584 / 114815368 / -0.3%	185897151 / 183677078 / +1.2%	0.62 / 0.63 / -1.5%
clickbench_q40/datafusion:vortex-compact	15996762 / 15898602 / +0.6%	64663157 / 66444262 / -2.7%	0.25 / 0.24 / +3.4%
clickbench_q41/datafusion:vortex-compact	17112610 / 17997090 / -4.9%	64981729 / 62004549 / +4.8%	0.26 / 0.29 / -9.3%
clickbench_q42/datafusion:vortex-compact	14074938 / 14126552 / -0.4%	61365987 / 57256415 / +7.2%	0.23 / 0.25 / -7.0%

datafusion / parquet / ns (0.979x ➖, 4↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1914352 / 2025688 / -5.5%	79222639 / 86489275 / -8.4%	0.02 / 0.02 / +3.2%
clickbench_q01/datafusion:parquet	16150927 / 17015640 / -5.1%	118380448 / 126131431 / -6.1%	0.14 / 0.13 / +1.1%
clickbench_q02/datafusion:parquet	32177777 / 33326429 / -3.4%	142447082 / 146278144 / -2.6%	0.23 / 0.23 / -0.8%
clickbench_q03/datafusion:parquet	26847276 / 27662066 / -2.9%	136939576 / 136549857 / +0.3%	0.20 / 0.20 / -3.2%
clickbench_q04/datafusion:parquet	173517426 / 169932304 / +2.1%	302934954 / 305848845 / -1.0%	0.57 / 0.56 / +3.1%
clickbench_q05/datafusion:parquet	239978537 / 233888038 / +2.6%	377817071 / 375997422 / +0.5%	0.64 / 0.62 / +2.1%
clickbench_q06/datafusion:parquet	1876882 / 1883067 / -0.3%	78590981 / 85697389 / -8.3%	0.02 / 0.02 / +8.7%
clickbench_q07/datafusion:parquet	18362668 / 18518230 / -0.8%	120577423 / 126712719 / -4.8%	0.15 / 0.15 / +4.2%
clickbench_q08/datafusion:parquet	226474976 / 229840046 / -1.5%	379541453 / 389926952 / -2.7%	0.60 / 0.59 / +1.2%
clickbench_q09/datafusion:parquet	366096962 / 361802874 / +1.2%	508156973 / 513682846 / -1.1%	0.72 / 0.70 / +2.3%
clickbench_q10/datafusion:parquet	73619466 / 75578746 / -2.6%	194486188 / 203559874 / -4.5%	0.38 / 0.37 / +2.0%
clickbench_q11/datafusion:parquet	89053140 / 89445501 / -0.4%	216867618 / 224275302 / -3.3%	0.41 / 0.40 / +3.0%
clickbench_q12/datafusion:parquet	237698530 / 237586886 / +0.0%	372958131 / 379107479 / -1.6%	0.64 / 0.63 / +1.7%
clickbench_q13/datafusion:parquet	383802420 / 385978936 / -0.6%	545537539 / 558787160 / -2.4%	0.70 / 0.69 / +1.9%
clickbench_q14/datafusion:parquet	248088890 / 252409026 / -1.7%	389377843 / 409912860 / -5.0%	0.64 / 0.62 / +3.5%
clickbench_q15/datafusion:parquet	196676552 / 190211228 / +3.4%	330033613 / 334117620 / -1.2%	0.60 / 0.57 / +4.7%
clickbench_q16/datafusion:parquet	474097172 / 482836482 / -1.8%	625090184 / 645713905 / -3.2%	0.76 / 0.75 / +1.4%
clickbench_q17/datafusion:parquet	474648749 / 472652275 / +0.4%	623418564 / 640070625 / -2.6%	0.76 / 0.74 / +3.1%
clickbench_q18/datafusion:parquet	901647085 / 912762279 / -1.2%	1078497236 / 1104001376 / -2.3%	0.84 / 0.83 / +1.1%
clickbench_q19/datafusion:parquet	22860308 / 22480215 / +1.7%	124394436 / 132714532 / -6.3%	0.18 / 0.17 / +8.5%
clickbench_q20/datafusion:parquet	447919345 / 450129166 / -0.5%	612263389 / 616408689 / -0.7%	0.73 / 0.73 / +0.2%
clickbench_q21/datafusion:parquet	436546316 / 488806563 / -10.7% 🟢	615136848 / 658319743 / -6.6%	0.71 / 0.74 / -4.4%
clickbench_q22/datafusion:parquet	609184746 / 640485483 / -4.9%	846787673 / 855826291 / -1.1%	0.72 / 0.75 / -3.9%
clickbench_q23/datafusion:parquet	2409419554 / 2818787069 / -14.5% 🟢	2789895939 / 3238998451 / -13.9% 🟢	0.86 / 0.87 / -0.8%
clickbench_q24/datafusion:parquet	42746961 / 49202166 / -13.1% 🟢	143412646 / 157561220 / -9.0%	0.30 / 0.31 / -4.5%
clickbench_q25/datafusion:parquet	88276076 / 93836074 / -5.9%	202331856 / 214039161 / -5.5%	0.44 / 0.44 / -0.5%
clickbench_q26/datafusion:parquet	42115007 / 49595980 / -15.1% 🟢	146738133 / 158928810 / -7.7%	0.29 / 0.31 / -8.0%
clickbench_q27/datafusion:parquet	524799840 / 527280530 / -0.5%	682582686 / 681733727 / +0.1%	0.77 / 0.77 / -0.6%
clickbench_q28/datafusion:parquet	1529049345 / 1519094218 / +0.7%	1626006691 / 1630467573 / -0.3%	0.94 / 0.93 / +0.9%
clickbench_q29/datafusion:parquet	40039406 / 40581051 / -1.3%	138063304 / 161420774 / -14.5% 🟢	0.29 / 0.25 / +15.4%
clickbench_q30/datafusion:parquet	233163262 / 229678210 / +1.5%	385280204 / 399138158 / -3.5%	0.61 / 0.58 / +5.2%
clickbench_q31/datafusion:parquet	267806530 / 270975791 / -1.2%	443784236 / 461345438 / -3.8%	0.60 / 0.59 / +2.7%
clickbench_q32/datafusion:parquet	842281163 / 847802268 / -0.7%	1020615357 / 1028222963 / -0.7%	0.83 / 0.82 / +0.1%
clickbench_q33/datafusion:parquet	1097519105 / 1101488761 / -0.4%	1260730529 / 1297605718 / -2.8%	0.87 / 0.85 / +2.6%
clickbench_q34/datafusion:parquet	1082044354 / 1085850456 / -0.4%	1275273769 / 1297367205 / -1.7%	0.85 / 0.84 / +1.4%
clickbench_q35/datafusion:parquet	162375778 / 162529516 / -0.1%	293777382 / 296876356 / -1.0%	0.55 / 0.55 / +1.0%
clickbench_q36/datafusion:parquet	106659288 / 107322740 / -0.6%	223257973 / 225795137 / -1.1%	0.48 / 0.48 / +0.5%
clickbench_q37/datafusion:parquet	48817876 / 49206862 / -0.8%	151794654 / 154197644 / -1.6%	0.32 / 0.32 / +0.8%
clickbench_q38/datafusion:parquet	65803524 / 63681271 / +3.3%	168583726 / 180797951 / -6.8%	0.39 / 0.35 / +10.8%
clickbench_q39/datafusion:parquet	208903045 / 203322842 / +2.7%	323000023 / 332406447 / -2.8%	0.65 / 0.61 / +5.7%
clickbench_q40/datafusion:parquet	27441465 / 26618794 / +3.1%	120950077 / 138076429 / -12.4% 🟢	0.23 / 0.19 / +17.7%
clickbench_q41/datafusion:parquet	25605978 / 27251246 / -6.0%	121554086 / 130994434 / -7.2%	0.21 / 0.21 / +1.3%
clickbench_q42/datafusion:parquet	25815122 / 26721524 / -3.4%	121130782 / 125819721 / -3.7%	0.21 / 0.21 / +0.3%

duckdb / vortex-file-compressed / ns (0.994x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	13956418 / 12539184 / +11.3% 🔴	85685454 / 65280685 / +31.3% 🔴	0.16 / 0.19 / -15.2%
clickbench_q01/duckdb:vortex-file-compressed	18687720 / 18431530 / +1.4%	89400805 / 108701186 / -17.8% 🟢	0.21 / 0.17 / +23.3%
clickbench_q02/duckdb:vortex-file-compressed	21678956 / 22053986 / -1.7%	101329332 / 120477667 / -15.9% 🟢	0.21 / 0.18 / +16.9%
clickbench_q03/duckdb:vortex-file-compressed	32197596 / 32704390 / -1.5%	101756241 / 105682324 / -3.7%	0.32 / 0.31 / +2.2%
clickbench_q04/duckdb:vortex-file-compressed	131674545 / 132993908 / -1.0%	207838770 / 211669520 / -1.8%	0.63 / 0.63 / +0.8%
clickbench_q05/duckdb:vortex-file-compressed	155628612 / 159682492 / -2.5%	240818239 / 241129116 / -0.1%	0.65 / 0.66 / -2.4%
clickbench_q06/duckdb:vortex-file-compressed	20911560 / 20734682 / +0.9%	95883344 / 103700352 / -7.5%	0.22 / 0.20 / +9.1%
clickbench_q07/duckdb:vortex-file-compressed	21663672 / 21543434 / +0.6%	99183044 / 96180978 / +3.1%	0.22 / 0.22 / -2.5%
clickbench_q08/duckdb:vortex-file-compressed	169111491 / 170236908 / -0.7%	282024585 / 293955293 / -4.1%	0.60 / 0.58 / +3.5%
clickbench_q09/duckdb:vortex-file-compressed	207816676 / 211033197 / -1.5%	321715279 / 324347644 / -0.8%	0.65 / 0.65 / -0.7%
clickbench_q10/duckdb:vortex-file-compressed	62567992 / 64438540 / -2.9%	158072780 / 178526959 / -11.5% 🟢	0.40 / 0.36 / +9.7%
clickbench_q11/duckdb:vortex-file-compressed	68260250 / 66584841 / +2.5%	178541590 / 181134239 / -1.4%	0.38 / 0.37 / +4.0%
clickbench_q12/duckdb:vortex-file-compressed	177826066 / 180011829 / -1.2%	308109897 / 294965124 / +4.5%	0.58 / 0.61 / -5.4%
clickbench_q13/duckdb:vortex-file-compressed	320909740 / 328631922 / -2.3%	448476228 / 451671133 / -0.7%	0.72 / 0.73 / -1.7%
clickbench_q14/duckdb:vortex-file-compressed	192918176 / 191214354 / +0.9%	299714161 / 306560045 / -2.2%	0.64 / 0.62 / +3.2%
clickbench_q15/duckdb:vortex-file-compressed	186935905 / 188355092 / -0.8%	283400948 / 292270101 / -3.0%	0.66 / 0.64 / +2.4%
clickbench_q16/duckdb:vortex-file-compressed	375503006 / 380630036 / -1.3%	491443666 / 484724442 / +1.4%	0.76 / 0.79 / -2.7%
clickbench_q17/duckdb:vortex-file-compressed	374677404 / 367687588 / +1.9%	487144083 / 488608140 / -0.3%	0.77 / 0.75 / +2.2%
clickbench_q18/duckdb:vortex-file-compressed	716879407 / 738523805 / -2.9%	885298916 / 852561341 / +3.8%	0.81 / 0.87 / -6.5%
clickbench_q19/duckdb:vortex-file-compressed	27431671 / 27200374 / +0.9%	119091999 / 109285814 / +9.0%	0.23 / 0.25 / -7.5%
clickbench_q20/duckdb:vortex-file-compressed	242342935 / 244953730 / -1.1%	448467242 / 439931544 / +1.9%	0.54 / 0.56 / -2.9%
clickbench_q21/duckdb:vortex-file-compressed	369473236 / 353200242 / +4.6%	649501361 / 648697620 / +0.1%	0.57 / 0.54 / +4.5%
clickbench_q22/duckdb:vortex-file-compressed	552779511 / 546549054 / +1.1%	929924379 / 947680173 / -1.9%	0.59 / 0.58 / +3.1%
clickbench_q23/duckdb:vortex-file-compressed	109509414 / 114897694 / -4.7%	229408638 / 227398290 / +0.9%	0.48 / 0.51 / -5.5%
clickbench_q24/duckdb:vortex-file-compressed	39636742 / 40665334 / -2.5%	95730300 / 86787993 / +10.3% 🔴	0.41 / 0.47 / -11.6%
clickbench_q25/duckdb:vortex-file-compressed	58563704 / 57839292 / +1.3%	140087529 / 140855463 / -0.5%	0.42 / 0.41 / +1.8%
clickbench_q26/duckdb:vortex-file-compressed	33537387 / 32670068 / +2.7%	90115688 / 84435947 / +6.7%	0.37 / 0.39 / -3.8%
clickbench_q27/duckdb:vortex-file-compressed	242821424 / 250391190 / -3.0%	490119239 / 523169878 / -6.3%	0.50 / 0.48 / +3.5%
clickbench_q28/duckdb:vortex-file-compressed	1260272064 / 1319592298 / -4.5%	1492397261 / 1467420393 / +1.7%	0.84 / 0.90 / -6.1%
clickbench_q29/duckdb:vortex-file-compressed	29234632 / 29938536 / -2.4%	110373253 / 112665544 / -2.0%	0.26 / 0.27 / -0.3%
clickbench_q30/duckdb:vortex-file-compressed	143181497 / 144104107 / -0.6%	261477095 / 264710627 / -1.2%	0.55 / 0.54 / +0.6%
clickbench_q31/duckdb:vortex-file-compressed	282136160 / 295333888 / -4.5%	445370928 / 499627544 / -10.9% 🟢	0.63 / 0.59 / +7.2%
clickbench_q32/duckdb:vortex-file-compressed	917626528 / 919612980 / -0.2%	1040931496 / 1040859347 / +0.0%	0.88 / 0.88 / -0.2%
clickbench_q33/duckdb:vortex-file-compressed	1050582966 / 1052149172 / -0.1%	1300494198 / 1318162454 / -1.3%	0.81 / 0.80 / +1.2%
clickbench_q34/duckdb:vortex-file-compressed	1071935213 / 1080723312 / -0.8%	1342688786 / 1144915135 / +17.3% 🔴	0.80 / 0.94 / -15.4%
clickbench_q35/duckdb:vortex-file-compressed	208652846 / 208661320 / -0.0%	300035625 / 288630526 / +4.0%	0.70 / 0.72 / -3.8%
clickbench_q36/duckdb:vortex-file-compressed	28329673 / 27920356 / +1.5%	110183617 / 103095602 / +6.9%	0.26 / 0.27 / -5.1%
clickbench_q37/duckdb:vortex-file-compressed	18235212 / 17795399 / +2.5%	84682188 / 102064868 / -17.0% 🟢	0.22 / 0.17 / +23.5%
clickbench_q38/duckdb:vortex-file-compressed	21861214 / 23433474 / -6.7%	104893782 / 105128324 / -0.2%	0.21 / 0.22 / -6.5%
clickbench_q39/duckdb:vortex-file-compressed	45600512 / 43375265 / +5.1%	130038928 / 148919150 / -12.7% 🟢	0.35 / 0.29 / +20.4%
clickbench_q40/duckdb:vortex-file-compressed	15528277 / 17451997 / -11.0% 🟢	82173168 / 88990672 / -7.7%	0.19 / 0.20 / -3.6%
clickbench_q41/duckdb:vortex-file-compressed	17619477 / 17979055 / -2.0%	92043165 / 93834483 / -1.9%	0.19 / 0.19 / -0.1%
clickbench_q42/duckdb:vortex-file-compressed	18319577 / 18236870 / +0.5%	96184132 / 94494831 / +1.8%	0.19 / 0.19 / -1.3%

duckdb / vortex-compact / ns (0.995x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-compact	12705308 / 14054300 / -9.6%	77939010 / 91108151 / -14.5% 🟢	0.16 / 0.15 / +5.7%
clickbench_q01/duckdb:vortex-compact	19959666 / 18883250 / +5.7%	110845472 / 103549856 / +7.0%	0.18 / 0.18 / -1.3%
clickbench_q02/duckdb:vortex-compact	36516219 / 35387740 / +3.2%	122341477 / 134304422 / -8.9%	0.30 / 0.26 / +13.3%
clickbench_q03/duckdb:vortex-compact	36634164 / 35714820 / +2.6%	96300056 / 96939131 / -0.7%	0.38 / 0.37 / +3.3%
clickbench_q04/duckdb:vortex-compact	138720745 / 139185504 / -0.3%	208269658 / 209100243 / -0.4%	0.67 / 0.67 / +0.1%
clickbench_q05/duckdb:vortex-compact	161492047 / 158951940 / +1.6%	255303785 / 251416418 / +1.5%	0.63 / 0.63 / +0.1%
clickbench_q06/duckdb:vortex-compact	20244229 / 18818580 / +7.6%	105411843 / 112848190 / -6.6%	0.19 / 0.17 / +15.2%
clickbench_q07/duckdb:vortex-compact	24154384 / 24872662 / -2.9%	108705677 / 110434380 / -1.6%	0.22 / 0.23 / -1.3%
clickbench_q08/duckdb:vortex-compact	187089156 / 186569491 / +0.3%	294216122 / 307276999 / -4.3%	0.64 / 0.61 / +4.7%
clickbench_q09/duckdb:vortex-compact	267378366 / 274592471 / -2.6%	375695914 / 377252206 / -0.4%	0.71 / 0.73 / -2.2%
clickbench_q10/duckdb:vortex-compact	86878573 / 88707915 / -2.1%	191629891 / 194515776 / -1.5%	0.45 / 0.46 / -0.6%
clickbench_q11/duckdb:vortex-compact	112700566 / 110666664 / +1.8%	229139910 / 218090272 / +5.1%	0.49 / 0.51 / -3.1%
clickbench_q12/duckdb:vortex-compact	193005878 / 190742952 / +1.2%	299379155 / 306771158 / -2.4%	0.64 / 0.62 / +3.7%
clickbench_q13/duckdb:vortex-compact	357587275 / 359703507 / -0.6%	470136058 / 472631942 / -0.5%	0.76 / 0.76 / -0.1%
clickbench_q14/duckdb:vortex-compact	205765036 / 203999802 / +0.9%	321634398 / 325004798 / -1.0%	0.64 / 0.63 / +1.9%
clickbench_q15/duckdb:vortex-compact	192452674 / 195746906 / -1.7%	282376429 / 302174181 / -6.6%	0.68 / 0.65 / +5.2%
clickbench_q16/duckdb:vortex-compact	400206404 / 393409186 / +1.7%	506331442 / 506750535 / -0.1%	0.79 / 0.78 / +1.8%
clickbench_q17/duckdb:vortex-compact	387045060 / 389134954 / -0.5%	502358121 / 501389152 / +0.2%	0.77 / 0.78 / -0.7%
clickbench_q18/duckdb:vortex-compact	744651422 / 745171300 / -0.1%	855758412 / 843596153 / +1.4%	0.87 / 0.88 / -1.5%
clickbench_q19/duckdb:vortex-compact	28500570 / 27942731 / +2.0%	119136125 / 95768527 / +24.4% 🔴	0.24 / 0.29 / -18.0%
clickbench_q20/duckdb:vortex-compact	216777896 / 223627726 / -3.1%	403233154 / 373936852 / +7.8%	0.54 / 0.60 / -10.1%
clickbench_q21/duckdb:vortex-compact	363660270 / 367977113 / -1.2%	662450614 / 659223384 / +0.5%	0.55 / 0.56 / -1.7%
clickbench_q22/duckdb:vortex-compact	682435378 / 681834824 / +0.1%	1071806626 / 1054355030 / +1.7%	0.64 / 0.65 / -1.5%
clickbench_q23/duckdb:vortex-compact	197809975 / 197701638 / +0.1%	285611988 / 280618631 / +1.8%	0.69 / 0.70 / -1.7%
clickbench_q24/duckdb:vortex-compact	51999206 / 48049295 / +8.2%	103090971 / 105795651 / -2.6%	0.50 / 0.45 / +11.1%
clickbench_q25/duckdb:vortex-compact	82997750 / 81525939 / +1.8%	169539212 / 159947454 / +6.0%	0.49 / 0.51 / -4.0%
clickbench_q26/duckdb:vortex-compact	39626143 / 41178546 / -3.8%	93601921 / 102482819 / -8.7%	0.42 / 0.40 / +5.4%
clickbench_q27/duckdb:vortex-compact	407460147 / 397235566 / +2.6%	671910971 / 643542241 / +4.4%	0.61 / 0.62 / -1.8%
clickbench_q28/duckdb:vortex-compact	1154429009 / 1134947985 / +1.7%	1397605860 / 1385453111 / +0.9%	0.83 / 0.82 / +0.8%
clickbench_q29/duckdb:vortex-compact	40572789 / 40657202 / -0.2%	133001120 / 123545562 / +7.7%	0.31 / 0.33 / -7.3%
clickbench_q30/duckdb:vortex-compact	207155837 / 204570261 / +1.3%	328509933 / 325210205 / +1.0%	0.63 / 0.63 / +0.2%
clickbench_q31/duckdb:vortex-compact	316216015 / 359628074 / -12.1% 🟢	541422877 / 522883466 / +3.5%	0.58 / 0.69 / -15.1%
clickbench_q32/duckdb:vortex-compact	927826530 / 936269834 / -0.9%	1068914484 / 1064172752 / +0.4%	0.87 / 0.88 / -1.3%
clickbench_q33/duckdb:vortex-compact	916730168 / 1006534023 / -8.9%	1237061812 / 1206965379 / +2.5%	0.74 / 0.83 / -11.1%
clickbench_q34/duckdb:vortex-compact	1041884092 / 1036805994 / +0.5%	1105269769 / 1311333552 / -15.7% 🟢	0.94 / 0.79 / +19.2%
clickbench_q35/duckdb:vortex-compact	217298740 / 222516228 / -2.3%	321489627 / 291097413 / +10.4% 🔴	0.68 / 0.76 / -11.6%
clickbench_q36/duckdb:vortex-compact	31046325 / 30842234 / +0.7%	113559874 / 110930049 / +2.4%	0.27 / 0.28 / -1.7%
clickbench_q37/duckdb:vortex-compact	23944317 / 23806570 / +0.6%	80039525 / 80125270 / -0.1%	0.30 / 0.30 / +0.7%
clickbench_q38/duckdb:vortex-compact	24562587 / 23605508 / +4.1%	100663192 / 117347800 / -14.2% 🟢	0.24 / 0.20 / +21.3%
clickbench_q39/duckdb:vortex-compact	49673708 / 52085246 / -4.6%	142818004 / 151164110 / -5.5%	0.35 / 0.34 / +0.9%
clickbench_q40/duckdb:vortex-compact	19931846 / 21473940 / -7.2%	94705299 / 100919217 / -6.2%	0.21 / 0.21 / -1.1%
clickbench_q41/duckdb:vortex-compact	20299530 / 20272510 / +0.1%	93241301 / 91295143 / +2.1%	0.22 / 0.22 / -2.0%
clickbench_q42/duckdb:vortex-compact	17297309 / 18236678 / -5.2%	93291739 / 89175181 / +4.6%	0.19 / 0.20 / -9.3%

duckdb / parquet / ns (0.995x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	16744589 / 15759544 / +6.3%	45423802 / 43184672 / +5.2%	0.37 / 0.36 / +1.0%
clickbench_q01/duckdb:parquet	16739951 / 17551626 / -4.6%	40271864 / 35388850 / +13.8% 🔴	0.42 / 0.50 / -16.2%
clickbench_q02/duckdb:parquet	25608014 / 25651034 / -0.2%	57728524 / 62003714 / -6.9%	0.44 / 0.41 / +7.2%
clickbench_q03/duckdb:parquet	28051636 / 31856806 / -11.9% 🟢	92447022 / 85196065 / +8.5%	0.30 / 0.37 / -18.9%
clickbench_q04/duckdb:parquet	133048007 / 138905352 / -4.2%	192394659 / 173014262 / +11.2% 🔴	0.69 / 0.80 / -13.9%
clickbench_q05/duckdb:parquet	201671512 / 196102224 / +2.8%	261956792 / 259111174 / +1.1%	0.77 / 0.76 / +1.7%
clickbench_q06/duckdb:parquet	23777446 / 24120008 / -1.4%	47484143 / 51696909 / -8.1%	0.50 / 0.47 / +7.3%
clickbench_q07/duckdb:parquet	18999240 / 19194835 / -1.0%	38579730 / 41920021 / -8.0%	0.49 / 0.46 / +7.6%
clickbench_q08/duckdb:parquet	166687286 / 163441565 / +2.0%	255346711 / 251563046 / +1.5%	0.65 / 0.65 / +0.5%
clickbench_q09/duckdb:parquet	226013033 / 230394086 / -1.9%	310474151 / 328884858 / -5.6%	0.73 / 0.70 / +3.9%
clickbench_q10/duckdb:parquet	65765040 / 66617079 / -1.3%	114742438 / 112489433 / +2.0%	0.57 / 0.59 / -3.2%
clickbench_q11/duckdb:parquet	68507114 / 71716396 / -4.5%	133502349 / 131296172 / +1.7%	0.51 / 0.55 / -6.1%
clickbench_q12/duckdb:parquet	173085606 / 175851198 / -1.6%	277783996 / 272692841 / +1.9%	0.62 / 0.64 / -3.4%
clickbench_q13/duckdb:parquet	310892924 / 318642339 / -2.4%	438317683 / 441990063 / -0.8%	0.71 / 0.72 / -1.6%
clickbench_q14/duckdb:parquet	192542484 / 191758098 / +0.4%	285518095 / 293428647 / -2.7%	0.67 / 0.65 / +3.2%
clickbench_q15/duckdb:parquet	182877868 / 183548696 / -0.4%	232293963 / 238525142 / -2.6%	0.79 / 0.77 / +2.3%
clickbench_q16/duckdb:parquet	353368605 / 352016774 / +0.4%	486564591 / 504896742 / -3.6%	0.73 / 0.70 / +4.2%
clickbench_q17/duckdb:parquet	366066980 / 365757117 / +0.1%	452548288 / 455826903 / -0.7%	0.81 / 0.80 / +0.8%
clickbench_q18/duckdb:parquet	684983852 / 694370579 / -1.4%	843269055 / 890493915 / -5.3%	0.81 / 0.78 / +4.2%
clickbench_q19/duckdb:parquet	23188685 / 22391662 / +3.6%	65447803 / 69955740 / -6.4%	0.35 / 0.32 / +10.7%
clickbench_q20/duckdb:parquet	264464272 / 267087576 / -1.0%	454642453 / 470012106 / -3.3%	0.58 / 0.57 / +2.4%
clickbench_q21/duckdb:parquet	326135302 / 328584576 / -0.7%	628149009 / 621250961 / +1.1%	0.52 / 0.53 / -1.8%
clickbench_q22/duckdb:parquet	478415150 / 481958828 / -0.7%	783671703 / 774466917 / +1.2%	0.61 / 0.62 / -1.9%
clickbench_q23/duckdb:parquet	250443366 / 252695294 / -0.9%	303645500 / 302424032 / +0.4%	0.82 / 0.84 / -1.3%
clickbench_q24/duckdb:parquet	73197158 / 79453410 / -7.9%	124478686 / 134320032 / -7.3%	0.59 / 0.59 / -0.6%
clickbench_q25/duckdb:parquet	72546541 / 75530102 / -4.0%	180663899 / 177128459 / +2.0%	0.40 / 0.43 / -5.8%
clickbench_q26/duckdb:parquet	57455002 / 60052673 / -4.3%	98594893 / 99122635 / -0.5%	0.58 / 0.61 / -3.8%
clickbench_q27/duckdb:parquet	280176504 / 273639814 / +2.4%	538850010 / 510884811 / +5.5%	0.52 / 0.54 / -2.9%
clickbench_q28/duckdb:parquet	1738960113 / 1683277650 / +3.3%	2241850805 / 2101366501 / +6.7%	0.78 / 0.80 / -3.2%
clickbench_q29/duckdb:parquet	33097072 / 31018458 / +6.7%	57932201 / 59314229 / -2.3%	0.57 / 0.52 / +9.2%
clickbench_q30/duckdb:parquet	186467638 / 180027044 / +3.6%	323055154 / 331965770 / -2.7%	0.58 / 0.54 / +6.4%
clickbench_q31/duckdb:parquet	326848998 / 291173069 / +12.3% 🔴	606442665 / 539266708 / +12.5% 🔴	0.54 / 0.54 / -0.2%
clickbench_q32/duckdb:parquet	914020872 / 903207976 / +1.2%	1009791348 / 1009606804 / +0.0%	0.91 / 0.89 / +1.2%
clickbench_q33/duckdb:parquet	790463883 / 786595816 / +0.5%	1057205852 / 966981500 / +9.3%	0.75 / 0.81 / -8.1%
clickbench_q34/duckdb:parquet	806136420 / 801939149 / +0.5%	1003438452 / 1001160024 / +0.2%	0.80 / 0.80 / +0.3%
clickbench_q35/duckdb:parquet	209258905 / 208345420 / +0.4%	240274105 / 250852410 / -4.2%	0.87 / 0.83 / +4.9%
clickbench_q36/duckdb:parquet	49900086 / 50871958 / -1.9%	72300658 / 72330926 / -0.0%	0.69 / 0.70 / -1.9%
clickbench_q37/duckdb:parquet	37539529 / 36677413 / +2.4%	60185732 / 59313677 / +1.5%	0.62 / 0.62 / +0.9%
clickbench_q38/duckdb:parquet	38730480 / 39851452 / -2.8%	58378728 / 59009102 / -1.1%	0.66 / 0.68 / -1.8%
clickbench_q39/duckdb:parquet	86005249 / 89134510 / -3.5%	113698177 / 114157716 / -0.4%	0.76 / 0.78 / -3.1%
clickbench_q40/duckdb:parquet	21707650 / 20005004 / +8.5%	44287300 / 41087708 / +7.8%	0.49 / 0.49 / +0.7%
clickbench_q41/duckdb:parquet	21347454 / 20673250 / +3.3%	45323435 / 44294817 / +2.3%	0.47 / 0.47 / +0.9%
clickbench_q42/duckdb:parquet	23150412 / 26244192 / -11.8% 🟢	45608627 / 44924593 / +1.5%	0.51 / 0.58 / -13.1%

No file size changes detected.

github-actions · 2026-08-14T12:48:08Z

Benchmarks: Random Access 📖

Commits: PR 0a464a16 vs base 17bd9e27
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -63.3%
Engines: random-access No clear signal (-63.3%, environment too noisy confidence)
Vortex (geomean): hot 0.928x ➖
Parquet (geomean): hot 2.531x ❌
Shifts: Parquet (control) +153.1% · Median polish +1.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

random-access / vortex-file-compressed / ns (0.928x ➖, 1↑ 0↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/vortex-tokio-local-disk	330913 / 1505340 / -78.0% 🟢
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer	600075 / 604367 / -0.7%
random-access/feature-vectors/uniform/vortex-tokio-local-disk	2616426 / 2647858 / -1.2%
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer	`3076748` / 3057460 / +0.6%
random-access/nested-lists/correlated/vortex-tokio-local-disk	292460 / 284515 / +2.8%
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer	361109 / 349278 / +3.4%
random-access/nested-lists/uniform/vortex-tokio-local-disk	1518414 / 1484567 / +2.3%
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer	1608436 / 1572248 / +2.3%
random-access/nested-structs/correlated/vortex-tokio-local-disk	339989 / 318332 / +6.8%
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer	463448 / 467959 / -1.0%
random-access/nested-structs/uniform/vortex-tokio-local-disk	1011907 / 1100929 / -8.1%
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer	1225254 / 1185040 / +3.4%
random-access/taxi/correlated/vortex-tokio-local-disk	894090 / 868729 / +2.9%
random-access/taxi/correlated/vortex-tokio-local-disk-footer	1369965 / 1355361 / +1.1%
random-access/taxi/uniform/vortex-tokio-local-disk	3988930 / 3989245 / -0.0%
random-access/taxi/uniform/vortex-tokio-local-disk-footer	4750217 / 4755986 / -0.1%
random-access/vortex-tokio-local-disk	535002 / 528296 / +1.3%
random-access/vortex-tokio-local-disk-footer	926474 / 912050 / +1.6%

random-access / parquet / ns (2.531x ❌, 0↑ 8↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/parquet-tokio-local-disk	345404957161 / 8923651827 / +3770.7% 🔴
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer	352563745339 / 8971992359 / +3829.6% 🔴
random-access/feature-vectors/uniform/parquet-tokio-local-disk	356374112804 / 8976632125 / +3870.0% 🔴
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer	350083389202 / 9103417426 / +3745.6% 🔴
random-access/nested-lists/correlated/parquet-tokio-local-disk	238353495 / 139466673 / +70.9% 🔴
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer	242911239 / 136099625 / +78.5% 🔴
random-access/nested-lists/uniform/parquet-tokio-local-disk	237917173 / 134384123 / +77.0% 🔴
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer	238645404 / 134907734 / +76.9% 🔴
random-access/nested-structs/correlated/parquet-tokio-local-disk	19726160 / 20568297 / -4.1%
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer	19334653 / 19246510 / +0.5%
random-access/nested-structs/uniform/parquet-tokio-local-disk	18989301 / 19314853 / -1.7%
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer	19092926 / 19372814 / -1.4%
random-access/parquet-tokio-local-disk	178038893 / 182334299 / -2.4%
random-access/parquet-tokio-local-disk-footer	178494590 / 181094924 / -1.4%
random-access/taxi/correlated/parquet-tokio-local-disk	267150591 / 273898703 / -2.5%
random-access/taxi/correlated/parquet-tokio-local-disk-footer	267687616 / 272605796 / -1.8%
random-access/taxi/uniform/parquet-tokio-local-disk	278520867 / 286283024 / -2.7%
random-access/taxi/uniform/parquet-tokio-local-disk-footer	280987945 / 287889257 / -2.4%

random-access / lance / ns (1.249x ❌, 0↑ 1↓)

name	ns (PR / base / %diff)
random-access/feature-vectors/correlated/lance-tokio-local-disk	20020873 / 350409 / +5613.6% 🔴
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer	1071439 / 1103736 / -2.9%
random-access/feature-vectors/uniform/lance-tokio-local-disk	1113533 / 1080226 / +3.1%
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer	1893240 / 1836184 / +3.1%
random-access/lance-tokio-local-disk	622218 / 638675 / -2.6%
random-access/lance-tokio-local-disk-footer	1336420 / 1371020 / -2.5%
random-access/nested-lists/correlated/lance-tokio-local-disk	185553 / 188462 / -1.5%
random-access/nested-lists/correlated/lance-tokio-local-disk-footer	577693 / 580829 / -0.5%
random-access/nested-lists/uniform/lance-tokio-local-disk	906093 / 896340 / +1.1%
random-access/nested-lists/uniform/lance-tokio-local-disk-footer	1317951 / 1328139 / -0.8%
random-access/nested-structs/correlated/lance-tokio-local-disk	310131 / 309992 / +0.0%
random-access/nested-structs/correlated/lance-tokio-local-disk-footer	461980 / 463704 / -0.4%
random-access/nested-structs/uniform/lance-tokio-local-disk	2485290 / 2427372 / +2.4%
random-access/nested-structs/uniform/lance-tokio-local-disk-footer	2569263 / 2536151 / +1.3%
random-access/taxi/correlated/lance-tokio-local-disk	944407 / 962628 / -1.9%
random-access/taxi/correlated/lance-tokio-local-disk-footer	1864070 / 1873975 / -0.5%
random-access/taxi/uniform/lance-tokio-local-disk	9925619 / 10037511 / -1.1%
random-access/taxi/uniform/lance-tokio-local-disk-footer	10600146 / 10560842 / +0.4%

github-actions · 2026-08-14T13:01:24Z

Benchmarks: Compression 📖

Commits: PR 0a464a16 vs base 17bd9e27

vortex / vortex-file-compressed / ns (0.966x ➖, 2↑ 0↓)

name	ns (PR / base / %diff)
compress time/Arade	1180892791 / 1237107185 / -4.5%
compress time/Bimbo	4691001620 / 4790192929 / -2.1%
compress time/CMSprovider	3910602262 / 3987726512 / -1.9%
compress time/Euro2016	435563033 / 453636409 / -4.0%
compress time/Food	423842397 / 432315790 / -2.0%
compress time/HashTags	904463204 / 870662800 / +3.9%
compress time/TPC-H l_comment canonical	1118799257 / 1156661446 / -3.3%
compress time/TPC-H l_comment chunked	1124942498 / 1137185865 / -1.1%
compress time/taxi	553417368 / 579131466 / -4.4%
compress time/wide table cols=100 chunks=1 rows=1000	8083026 / 7985751 / +1.2%
compress time/wide table cols=100 chunks=50 rows=1000	8551147 / 8389426 / +1.9%
compress time/wide table cols=1000 chunks=1 rows=1000	85705501 / 88197762 / -2.8%
compress time/wide table cols=1000 chunks=50 rows=1000	85727828 / 88263398 / -2.9%
compress time/wide table cols=10000 chunks=1 rows=1000	992126633 / 994736763 / -0.3%
compress time/wide table cols=10000 chunks=50 rows=1000	993881739 / 1013261562 / -1.9%
decompress time/Arade	23351730 / 25049623 / -6.8%
decompress time/Bimbo	81627388 / 80971689 / +0.8%
decompress time/CMSprovider	75284525 / 77026594 / -2.3%
decompress time/Euro2016	14000363 / 14963211 / -6.4%
decompress time/Food	6483174 / 6964714 / -6.9%
decompress time/HashTags	87419216 / 92169903 / -5.2%
decompress time/TPC-H l_comment canonical	31306550 / 35104474 / -10.8% 🟢
decompress time/TPC-H l_comment chunked	31459558 / 34339568 / -8.4%
decompress time/taxi	14505115 / 14726443 / -1.5%
decompress time/wide table cols=100 chunks=1 rows=1000	2284633 / 2344669 / -2.6%
decompress time/wide table cols=100 chunks=50 rows=1000	2321015 / 2397272 / -3.2%
decompress time/wide table cols=1000 chunks=1 rows=1000	22534391 / 23278111 / -3.2%
decompress time/wide table cols=1000 chunks=50 rows=1000	22668140 / 23493193 / -3.5%
decompress time/wide table cols=10000 chunks=1 rows=1000	282439522 / 271443549 / +4.1%
decompress time/wide table cols=10000 chunks=50 rows=1000	261295505 / 325881238 / -19.8% 🟢

vortex / vortex-file-compressed / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
vortex-file-compressed size/Arade	145313924 / 145313924 / +0.0%
vortex-file-compressed size/Bimbo	466894596 / 466894596 / +0.0%
vortex-file-compressed size/CMSprovider	417691700 / 417691700 / +0.0%
vortex-file-compressed size/Euro2016	162328492 / 162328492 / +0.0%
vortex-file-compressed size/Food	41963280 / 41963280 / +0.0%
vortex-file-compressed size/HashTags	186618268 / 186618260 / +0.0%
vortex-file-compressed size/TPC-H l_comment canonical	172613296 / 172613296 / +0.0%
vortex-file-compressed size/TPC-H l_comment chunked	172613296 / 172613296 / +0.0%
vortex-file-compressed size/taxi	52250516 / 52250516 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000	932656 / 932656 / +0.0%
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000	932656 / 932656 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000	9309856 / 9309856 / +0.0%
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000	9309856 / 9309856 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000	93117856 / 93117856 / +0.0%
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000	93117856 / 93117856 / +0.0%

vortex / vortex-file-compressed / ratio (1.008x ➖, 1↑ 6↓)

name	ratio (PR / base / %diff)
vortex:parquet-zstd ratio compress time/Arade	0.412291817 / 0.421490425 / -2.2%
vortex:parquet-zstd ratio compress time/Bimbo	0.337940049 / 0.335620622 / +0.7%
vortex:parquet-zstd ratio compress time/CMSprovider	0.510693498 / 0.5136354 / -0.6%
vortex:parquet-zstd ratio compress time/Euro2016	0.285890386 / 0.302084193 / -5.4%
vortex:parquet-zstd ratio compress time/Food	0.464704598 / 0.478053321 / -2.8%
vortex:parquet-zstd ratio compress time/HashTags	0.374010339 / 0.358111697 / +4.4%
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical	0.304296356 / 0.317715618 / -4.2%
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked	0.307151254 / 0.310727014 / -1.2%
vortex:parquet-zstd ratio compress time/taxi	0.410131049 / 0.425270535 / -3.6%
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000	1.54537988 / 1.2468556 / +23.9% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000	1.63785834 / 1.35411824 / +21.0% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000	1.35490702 / 1.14722304 / +18.1% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000	1.36077192 / 1.1494405 / +18.4% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000	1.43353266 / 1.25278113 / +14.4% 🔴
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000	1.43214784 / 1.26232562 / +13.5% 🔴
vortex:parquet-zstd ratio decompress time/Arade	0.0332722982 / 0.0351902811 / -5.5%
vortex:parquet-zstd ratio decompress time/Bimbo	0.0428173436 / 0.0419489486 / +2.1%
vortex:parquet-zstd ratio decompress time/CMSprovider	0.0393836093 / 0.0394748822 / -0.2%
vortex:parquet-zstd ratio decompress time/Euro2016	0.0336728547 / 0.0345785626 / -2.6%
vortex:parquet-zstd ratio decompress time/Food	0.0294499903 / 0.0312342403 / -5.7%
vortex:parquet-zstd ratio decompress time/HashTags	0.129012201 / 0.131560823 / -1.9%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical	0.0473854082 / 0.0522015726 / -9.2%
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked	0.0478022911 / 0.0509270671 / -6.1%
vortex:parquet-zstd ratio decompress time/taxi	0.052304953 / 0.0519340681 / +0.7%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000	0.945950433 / 0.956213122 / -1.1%
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000	0.963947116 / 1.0215938 / -5.6%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000	0.833921004 / 0.841886066 / -0.9%
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000	0.847332126 / 0.813540495 / +4.2%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000	0.956579116 / 0.905703211 / +5.6%
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000	0.875728361 / 1.08255667 / -19.1% 🟢
vortex:parquet-zstd size/Arade	0.563201087 / 0.563201087 / -0.0%
vortex:parquet-zstd size/Bimbo	1.21423563 / 1.21423563 / -0.0%
vortex:parquet-zstd size/CMSprovider	1.10826505 / 1.10827201 / -0.0%
vortex:parquet-zstd size/Euro2016	1.31996867 / 1.32000678 / -0.0%
vortex:parquet-zstd size/Food	1.17545848 / 1.17545848 / -0.0%
vortex:parquet-zstd size/HashTags	1.39791488 / 1.39777501 / +0.0%
vortex:parquet-zstd size/TPC-H l_comment canonical	1.09001779 / 1.09001779 / -0.0%
vortex:parquet-zstd size/TPC-H l_comment chunked	1.09001779 / 1.09001779 / -0.0%
vortex:parquet-zstd size/taxi	0.945135319 / 0.945135319 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000	1.00027027 / 1.00027027 / -0.0%
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000	1.00027027 / 1.00027027 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000	0.998482626 / 0.998482626 / -0.0%
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000	0.998482626 / 0.998482626 / -0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000	0.998689961 / 0.998689961 / +0.0%
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000	0.998689961 / 0.998689961 / +0.0%

vortex / parquet / ns (0.954x ➖, 6↑ 0↓)

name	ns (PR / base / %diff)
parquet_rs-zstd compress time/Arade	2864215929 / 2935077787 / -2.4%
parquet_rs-zstd compress time/Bimbo	13881165101 / 14272641825 / -2.7%
parquet_rs-zstd compress time/CMSprovider	7657434995 / 7763729898 / -1.4%
parquet_rs-zstd compress time/Euro2016	1523531585 / 1501688667 / +1.5%
parquet_rs-zstd compress time/Food	912068439 / 904325462 / +0.9%
parquet_rs-zstd compress time/HashTags	2418283961 / 2431260433 / -0.5%
parquet_rs-zstd compress time/TPC-H l_comment canonical	3676676485 / 3640555836 / +1.0%
parquet_rs-zstd compress time/TPC-H l_comment chunked	3662503354 / 3659758608 / +0.1%
parquet_rs-zstd compress time/taxi	1349367159 / 1361795417 / -0.9%
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000	5230446 / 6404712 / -18.3% 🟢
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000	5220932 / 6195490 / -15.7% 🟢
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000	63255633 / 76879350 / -17.7% 🟢
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000	62999410 / 76788140 / -18.0% 🟢
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000	692085128 / 794022787 / -12.8% 🟢
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000	693979847 / 802694283 / -13.5% 🟢
parquet_rs-zstd decompress time/Arade	701837001 / 711833557 / -1.4%
parquet_rs-zstd decompress time/Bimbo	1906409441 / 1930243585 / -1.2%
parquet_rs-zstd decompress time/CMSprovider	1911569973 / 1951281162 / -2.0%
parquet_rs-zstd decompress time/Euro2016	415775945 / 432730856 / -3.9%
parquet_rs-zstd decompress time/Food	220141804 / 222983301 / -1.3%
parquet_rs-zstd decompress time/HashTags	677604251 / 700587765 / -3.3%
parquet_rs-zstd decompress time/TPC-H l_comment canonical	660679124 / 672479243 / -1.8%
parquet_rs-zstd decompress time/TPC-H l_comment chunked	658118205 / 674289135 / -2.4%
parquet_rs-zstd decompress time/taxi	277318192 / 283560359 / -2.2%
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000	2415172 / 2452036 / -1.5%
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000	2407824 / 2346600 / +2.6%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000	27022213 / 27649954 / -2.3%
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000	26752367 / 28877718 / -7.4%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000	295259971 / 299704744 / -1.5%
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000	298375063 / 301029264 / -0.9%

vortex / parquet / bytes (1.000x ➖, 0↑ 0↓)

name	bytes (PR / base / %diff)
parquet size/Arade	258014282 / 258014282 / +0.0%
parquet size/Bimbo	384517292 / 384517292 / +0.0%
parquet size/CMSprovider	376887911 / 376885545 / +0.0%
parquet size/Euro2016	122979049 / 122975499 / +0.0%
parquet size/Food	35699500 / 35699500 / +0.0%
parquet size/HashTags	133497590 / 133510943 / -0.0%
parquet size/TPC-H l_comment canonical	158358238 / 158358238 / +0.0%
parquet size/TPC-H l_comment chunked	158358238 / 158358238 / +0.0%
parquet size/taxi	55283635 / 55283635 / +0.0%
parquet size/wide table cols=100 chunks=1 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=100 chunks=50 rows=1000	932404 / 932404 / +0.0%
parquet size/wide table cols=1000 chunks=1 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=1000 chunks=50 rows=1000	9324004 / 9324004 / +0.0%
parquet size/wide table cols=10000 chunks=1 rows=1000	93240004 / 93240004 / +0.0%
parquet size/wide table cols=10000 chunks=50 rows=1000	93240004 / 93240004 / +0.0%

github-actions · 2026-08-26T11:12:06Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR a65d7444 vs base 5f6b29f6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +3.0%
Engines: DuckDB No clear signal (+3.0%, low confidence)
Vortex (geomean): hot 1.023x ➖ · cold 1.010x ➖
Parquet (geomean): hot 0.993x ➖ · cold 0.997x ➖
Shifts: Parquet (control) -0.7% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.023x ➖, 1↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	15306214 / 14675175 / +4.3%	28849042 / 29374039 / -1.8%	0.53 / 0.50 / +6.2%
statpopgen_q01/duckdb:vortex-file-compressed	14519029 / 14652170 / -0.9%	22218170 / 21082077 / +5.4%	0.65 / 0.70 / -6.0%
statpopgen_q02/duckdb:vortex-file-compressed	604524226 / 634998328 / -4.8%	718441006 / 718146008 / +0.0%	0.84 / 0.88 / -4.8%
statpopgen_q03/duckdb:vortex-file-compressed	1630996376 / 1379249426 / +18.3% 🔴	1404507329 / 1357381675 / +3.5%	1.16 / 1.02 / +14.3%
statpopgen_q04/duckdb:vortex-file-compressed	1914149520 / 1342503454 / +42.6% 🔴	1302316811 / 1307695117 / -0.4%	1.47 / 1.03 / +43.2%
statpopgen_q05/duckdb:vortex-file-compressed	664828736 / 708400320 / -6.2%	662680869 / 691666319 / -4.2%	1.00 / 1.02 / -2.0%
statpopgen_q06/duckdb:vortex-file-compressed	2031948760 / 1824791522 / +11.4% 🔴	1777227466 / 1778768608 / -0.1%	1.14 / 1.03 / +11.4%
statpopgen_q07/duckdb:vortex-file-compressed	348779070 / 363906931 / -4.2%	401009019 / 468925522 / -14.5% 🟢	0.87 / 0.78 / +12.1%
statpopgen_q08/duckdb:vortex-file-compressed	388638840 / 388959764 / -0.1%	474439201 / 477183976 / -0.6%	0.82 / 0.82 / +0.5%
statpopgen_q09/duckdb:vortex-file-compressed	1074328378 / 1061239696 / +1.2%	1382058149 / 1065970311 / +29.7% 🔴	0.78 / 1.00 / -21.9%
statpopgen_q10/duckdb:vortex-file-compressed	2923017342 / 3832149686 / -23.7% 🟢	2944967038 / 2970949150 / -0.9%	0.99 / 1.29 / -23.1%

duckdb / parquet / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	377932290 / 376926946 / +0.3%	378623652 / 376793771 / +0.5%	1.00 / 1.00 / -0.2%
statpopgen_q01/duckdb:parquet	467096768 / 468603128 / -0.3%	471884080 / 473070894 / -0.3%	0.99 / 0.99 / -0.1%
statpopgen_q02/duckdb:parquet	771282370 / 777207956 / -0.8%	804555010 / 812633969 / -1.0%	0.96 / 0.96 / +0.2%
statpopgen_q03/duckdb:parquet	1046136533 / 1062171612 / -1.5%	1093869009 / 1128452142 / -3.1%	0.96 / 0.94 / +1.6%
statpopgen_q04/duckdb:parquet	1048314097 / 1058893384 / -1.0%	1087286401 / 1092173972 / -0.4%	0.96 / 0.97 / -0.6%
statpopgen_q05/duckdb:parquet	772340819 / 774901727 / -0.3%	818139498 / 806380871 / +1.5%	0.94 / 0.96 / -1.8%
statpopgen_q06/duckdb:parquet	1017772512 / 1020556482 / -0.3%	1056182718 / 1052882472 / +0.3%	0.96 / 0.97 / -0.6%
statpopgen_q07/duckdb:parquet	950386084 / 957014934 / -0.7%	1154561875 / 1141172684 / +1.2%	0.82 / 0.84 / -1.8%
statpopgen_q08/duckdb:parquet	972328893 / 965166624 / +0.7%	1111278716 / 1112125322 / -0.1%	0.87 / 0.87 / +0.8%
statpopgen_q09/duckdb:parquet	990193012 / 1001054778 / -1.1%	1034220798 / 1043007690 / -0.8%	0.96 / 0.96 / -0.2%
statpopgen_q10/duckdb:parquet	1640169845 / 1679666949 / -2.4%	1677400457 / 1699335714 / -1.3%	0.98 / 0.99 / -1.1%

No file size changes detected.

github-actions · 2026-08-26T11:12:14Z

Benchmarks: FineWeb S3 📖

Commits: PR a65d7444 vs base 5f6b29f6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.7%
Engines: DataFusion No clear signal (+18.5%, environment too noisy confidence) · DuckDB No clear signal (-12.7%, environment too noisy confidence)
Vortex (geomean): hot 0.938x ➖ · cold 0.846x ➖
Parquet (geomean): hot 0.922x ➖ · cold 0.947x ➖
Shifts: Parquet (control) -7.8% · Median polish -1.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.061x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	51359185 / 48853904 / +5.1%	133858194 / 200545684 / -33.3% 🟢	0.38 / 0.24 / +57.5%
fineweb_q01/datafusion:vortex-file-compressed	381377054 / 405580780 / -6.0%	697649351 / 836519242 / -16.6%	0.55 / 0.48 / +12.7%
fineweb_q02/datafusion:vortex-file-compressed	392881581 / 369384260 / +6.4%	414505837 / 548464166 / -24.4%	0.95 / 0.67 / +40.7%
fineweb_q03/datafusion:vortex-file-compressed	533203834 / 440545232 / +21.0%	664454318 / 827378296 / -19.7%	0.80 / 0.53 / +50.7%
fineweb_q04/datafusion:vortex-file-compressed	690412077 / 565400493 / +22.1%	447799597 / 517228424 / -13.4%	1.54 / 1.09 / +41.0%
fineweb_q05/datafusion:vortex-file-compressed	550420372 / 590390468 / -6.8%	445718874 / 480067093 / -7.2%	1.23 / 1.23 / +0.4%
fineweb_q06/datafusion:vortex-file-compressed	670826280 / 641836836 / +4.5%	687788808 / 680620018 / +1.1%	0.98 / 0.94 / +3.4%
fineweb_q07/datafusion:vortex-file-compressed	468486994 / 458509050 / +2.2%	467822419 / 462280206 / +1.2%	1.00 / 0.99 / +1.0%
fineweb_q08/datafusion:vortex-file-compressed	199012816 / 180028786 / +10.5%	191467614 / 199545507 / -4.0%	1.04 / 0.90 / +15.2%

datafusion / parquet / ns (0.896x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	470680943 / 674082755 / -30.2% 🟢	937042433 / 1117566106 / -16.2%	0.50 / 0.60 / -16.7%
fineweb_q01/datafusion:parquet	853517767 / 1066061271 / -19.9%	904559198 / 1337086594 / -32.3% 🟢	0.94 / 0.80 / +18.3%
fineweb_q02/datafusion:parquet	1011078694 / 1224534781 / -17.4%	1024680152 / 1051746910 / -2.6%	0.99 / 1.16 / -15.3%
fineweb_q03/datafusion:parquet	1069246869 / 840166759 / +27.3%	1262837475 / 882806998 / +43.0% 🔴	0.85 / 0.95 / -11.0%
fineweb_q04/datafusion:parquet	856119332 / 825409172 / +3.7%	878756043 / 863593178 / +1.8%	0.97 / 0.96 / +1.9%
fineweb_q05/datafusion:parquet	944653840 / 992841594 / -4.9%	888416095 / 969405505 / -8.4%	1.06 / 1.02 / +3.8%
fineweb_q06/datafusion:parquet	844985223 / 1033290395 / -18.2%	896262349 / 1149781532 / -22.0%	0.94 / 0.90 / +4.9%
fineweb_q07/datafusion:parquet	972496695 / 1056059156 / -7.9%	868858350 / 1314096962 / -33.9% 🟢	1.12 / 0.80 / +39.3%
fineweb_q08/datafusion:parquet	822123254 / 966573042 / -14.9%	876368232 / 1018288502 / -13.9%	0.94 / 0.95 / -1.2%

duckdb / vortex-file-compressed / ns (0.828x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	73457248 / 75548553 / -2.8%	73630369 / 81675793 / -9.9%	1.00 / 0.92 / +7.9%
fineweb_q01/duckdb:vortex-file-compressed	553067406 / 570662400 / -3.1%	742546105 / 712434352 / +4.2%	0.74 / 0.80 / -7.0%
fineweb_q02/duckdb:vortex-file-compressed	716170645 / 695802021 / +2.9%	715760564 / 769037398 / -6.9%	1.00 / 0.90 / +10.6%
fineweb_q03/duckdb:vortex-file-compressed	2075085148 / 1552041542 / +33.7% 🔴	1780262876 / 1795716529 / -0.9%	1.17 / 0.86 / +34.9%
fineweb_q04/duckdb:vortex-file-compressed	1577127082 / 1590784360 / -0.9%	1600527885 / 1631933445 / -1.9%	0.99 / 0.97 / +1.1%
fineweb_q05/duckdb:vortex-file-compressed	1515649164 / 1534226173 / -1.2%	1566045497 / 1537636037 / +1.8%	0.97 / 1.00 / -3.0%
fineweb_q06/duckdb:vortex-file-compressed	1579733980 / 1665477376 / -5.1%	1640792725 / 1691518902 / -3.0%	0.96 / 0.98 / -2.2%
fineweb_q07/duckdb:vortex-file-compressed	1509156464 / 9856106096 / -84.7% 🟢	1583057128 / 7179610938 / -78.0% 🟢	0.95 / 1.37 / -30.6%
fineweb_q08/duckdb:vortex-file-compressed	627548842 / 631573166 / -0.6%	715411529 / 715688864 / -0.0%	0.88 / 0.88 / -0.6%

duckdb / parquet / ns (0.948x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	5254035729 / 5266965322 / -0.2%	546678711 / 541293189 / +1.0%	9.61 / 9.73 / -1.2%
fineweb_q01/duckdb:parquet	5330953977 / 5311757255 / +0.4%	623686252 / 606268103 / +2.9%	8.55 / 8.76 / -2.4%
fineweb_q02/duckdb:parquet	5315547574 / 5293534963 / +0.4%	820391807 / 612113281 / +34.0% 🔴	6.48 / 8.65 / -25.1%
fineweb_q03/duckdb:parquet	3327848644 / 5339841184 / -37.7% 🟢	1252511439 / 1321665299 / -5.2%	2.66 / 4.04 / -34.2%
fineweb_q04/duckdb:parquet	5249598038 / 3015932324 / +74.1% 🔴	836696469 / 833149267 / +0.4%	6.27 / 3.62 / +73.3%
fineweb_q05/duckdb:parquet	3110989481 / 5320879263 / -41.5% 🟢	1106467071 / 986643998 / +12.1%	2.81 / 5.39 / -47.9%
fineweb_q06/duckdb:parquet	5445060588 / 5416841078 / +0.5%	1412050192 / 1453822536 / -2.9%	3.86 / 3.73 / +3.5%
fineweb_q07/duckdb:parquet	3104458442 / 3185270532 / -2.5%	999995350 / 1034775438 / -3.4%	3.10 / 3.08 / +0.9%
fineweb_q08/duckdb:parquet	5227677094 / 5260540266 / -0.6%	567058793 / 686883114 / -17.4%	9.22 / 7.66 / +20.4%

github-actions · 2026-08-26T11:12:35Z

Benchmarks: Clickbench on NVME 📖

Commits: PR a65d7444 vs base 5f6b29f6
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.5%
Engines: DataFusion No clear signal (+1.2%, low confidence) · DuckDB No clear signal (-0.2%, environment too noisy confidence)
Vortex (geomean): hot 1.003x ➖ · cold 1.000x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.980x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1882228 / 1869666 / +0.7%	40749373 / 37760759 / +7.9%	0.05 / 0.05 / -6.7%
clickbench_q01/datafusion:vortex-file-compressed	12646294 / 12754574 / -0.8%	60240088 / 62571074 / -3.7%	0.21 / 0.20 / +3.0%
clickbench_q02/datafusion:vortex-file-compressed	26555932 / 26449271 / +0.4%	79507926 / 75712591 / +5.0%	0.33 / 0.35 / -4.4%
clickbench_q03/datafusion:vortex-file-compressed	25954609 / 26852724 / -3.3%	98155407 / 95545631 / +2.7%	0.26 / 0.28 / -5.9%
clickbench_q04/datafusion:vortex-file-compressed	162106660 / 162013464 / +0.1%	238278835 / 242098633 / -1.6%	0.68 / 0.67 / +1.7%
clickbench_q05/datafusion:vortex-file-compressed	214223940 / 224144906 / -4.4%	302066303 / 284653602 / +6.1%	0.71 / 0.79 / -9.9%
clickbench_q06/datafusion:vortex-file-compressed	1908124 / 1887938 / +1.1%	40000681 / 39476057 / +1.3%	0.05 / 0.05 / -0.3%
clickbench_q07/datafusion:vortex-file-compressed	18958637 / 18992062 / -0.2%	67760571 / 65049441 / +4.2%	0.28 / 0.29 / -4.2%
clickbench_q08/datafusion:vortex-file-compressed	221014462 / 216202162 / +2.2%	307164772 / 303466726 / +1.2%	0.72 / 0.71 / +1.0%
clickbench_q09/datafusion:vortex-file-compressed	344251584 / 347422604 / -0.9%	422376004 / 432494901 / -2.3%	0.82 / 0.80 / +1.5%
clickbench_q10/datafusion:vortex-file-compressed	67822786 / 67853885 / -0.0%	133209867 / 135277024 / -1.5%	0.51 / 0.50 / +1.5%
clickbench_q11/datafusion:vortex-file-compressed	88150333 / 88327262 / -0.2%	151310208 / 152686672 / -0.9%	0.58 / 0.58 / +0.7%
clickbench_q12/datafusion:vortex-file-compressed	195305784 / 199554874 / -2.1%	283641815 / 282506295 / +0.4%	0.69 / 0.71 / -2.5%
clickbench_q13/datafusion:vortex-file-compressed	339771470 / 342152658 / -0.7%	450541418 / 460300261 / -2.1%	0.75 / 0.74 / +1.5%
clickbench_q14/datafusion:vortex-file-compressed	206417560 / 205200123 / +0.6%	290578720 / 290990181 / -0.1%	0.71 / 0.71 / +0.7%
clickbench_q15/datafusion:vortex-file-compressed	186161290 / 185113206 / +0.6%	263297890 / 263442488 / -0.1%	0.71 / 0.70 / +0.6%
clickbench_q16/datafusion:vortex-file-compressed	477010108 / 475420858 / +0.3%	613551655 / 587236382 / +4.5%	0.78 / 0.81 / -4.0%
clickbench_q17/datafusion:vortex-file-compressed	474972236 / 473474921 / +0.3%	580713955 / 574612764 / +1.1%	0.82 / 0.82 / -0.7%
clickbench_q18/datafusion:vortex-file-compressed	878060011 / 906558702 / -3.1%	988052743 / 990561253 / -0.3%	0.89 / 0.92 / -2.9%
clickbench_q19/datafusion:vortex-file-compressed	17130869 / 16885223 / +1.5%	84241990 / 86720346 / -2.9%	0.20 / 0.19 / +4.4%
clickbench_q20/datafusion:vortex-file-compressed	182781144 / 184320037 / -0.8%	379647588 / 387154957 / -1.9%	0.48 / 0.48 / +1.1%
clickbench_q21/datafusion:vortex-file-compressed	268549568 / 258385123 / +3.9%	476683101 / 475194816 / +0.3%	0.56 / 0.54 / +3.6%
clickbench_q22/datafusion:vortex-file-compressed	327909024 / 335260728 / -2.2%	615022979 / 614534168 / +0.1%	0.53 / 0.55 / -2.3%
clickbench_q23/datafusion:vortex-file-compressed	646668388 / 643684225 / +0.5%	900178847 / 871911880 / +3.2%	0.72 / 0.74 / -2.7%
clickbench_q24/datafusion:vortex-file-compressed	43074696 / 42243106 / +2.0%	118470856 / 119274725 / -0.7%	0.36 / 0.35 / +2.7%
clickbench_q25/datafusion:vortex-file-compressed	55606708 / 55085538 / +0.9%	124195135 / 122644805 / +1.3%	0.45 / 0.45 / -0.3%
clickbench_q26/datafusion:vortex-file-compressed	43668144 / 42722930 / +2.2%	118069716 / 119163589 / -0.9%	0.37 / 0.36 / +3.2%
clickbench_q27/datafusion:vortex-file-compressed	272774502 / 272060532 / +0.3%	448224010 / 451508507 / -0.7%	0.61 / 0.60 / +1.0%
clickbench_q28/datafusion:vortex-file-compressed	1451644992 / 1432249958 / +1.4%	1536233132 / 1587192159 / -3.2%	0.94 / 0.90 / +4.7%
clickbench_q29/datafusion:vortex-file-compressed	40096475 / 39542956 / +1.4%	92884754 / 91259220 / +1.8%	0.43 / 0.43 / -0.4%
clickbench_q30/datafusion:vortex-file-compressed	174804856 / 176662728 / -1.1%	253021054 / 256824844 / -1.5%	0.69 / 0.69 / +0.4%
clickbench_q31/datafusion:vortex-file-compressed	196008791 / 197729640 / -0.9%	324758074 / 329435271 / -1.4%	0.60 / 0.60 / +0.6%
clickbench_q32/datafusion:vortex-file-compressed	831427488 / 825863564 / +0.7%	940645953 / 939387168 / +0.1%	0.88 / 0.88 / +0.5%
clickbench_q33/datafusion:vortex-file-compressed	1019909060 / 1021153226 / -0.1%	1226000395 / 1174036284 / +4.4%	0.83 / 0.87 / -4.4%
clickbench_q34/datafusion:vortex-file-compressed	1008973494 / 1024937162 / -1.6%	1185613864 / 1177176820 / +0.7%	0.85 / 0.87 / -2.3%
clickbench_q35/datafusion:vortex-file-compressed	154482988 / 150786804 / +2.5%	223688838 / 221745121 / +0.9%	0.69 / 0.68 / +1.6%
clickbench_q36/datafusion:vortex-file-compressed	56855778 / 57712134 / -1.5%	121020833 / 115012874 / +5.2%	0.47 / 0.50 / -6.4%
clickbench_q37/datafusion:vortex-file-compressed	28579450 / 29457298 / -3.0%	81735575 / 78696342 / +3.9%	0.35 / 0.37 / -6.6%
clickbench_q38/datafusion:vortex-file-compressed	15510876 / 15648466 / -0.9%	69184864 / 67458846 / +2.6%	0.22 / 0.23 / -3.4%
clickbench_q39/datafusion:vortex-file-compressed	112554956 / 112428451 / +0.1%	186412630 / 183060308 / +1.8%	0.60 / 0.61 / -1.7%
clickbench_q40/datafusion:vortex-file-compressed	13117307 / 13189452 / -0.5%	66884993 / 60556360 / +10.5% 🔴	0.20 / 0.22 / -10.0%
clickbench_q41/datafusion:vortex-file-compressed	12788768 / 12779567 / +0.1%	63998786 / 62799043 / +1.9%	0.20 / 0.20 / -1.8%
clickbench_q42/datafusion:vortex-file-compressed	13155766 / 13443885 / -2.1%	65768881 / 60809833 / +8.2%	0.20 / 0.22 / -9.5%

datafusion / parquet / ns (0.986x ➖, 2↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1914374 / 1893563 / +1.1%	77371161 / 88097754 / -12.2% 🟢	0.02 / 0.02 / +15.1%
clickbench_q01/datafusion:parquet	17325364 / 17943573 / -3.4%	115004123 / 126021760 / -8.7%	0.15 / 0.14 / +5.8%
clickbench_q02/datafusion:parquet	33574578 / 30410856 / +10.4% 🔴	136764926 / 154945694 / -11.7% 🟢	0.25 / 0.20 / +25.1%
clickbench_q03/datafusion:parquet	28135904 / 26452792 / +6.4%	137845737 / 141817009 / -2.8%	0.20 / 0.19 / +9.4%
clickbench_q04/datafusion:parquet	174809694 / 174728380 / +0.0%	303196568 / 309301627 / -2.0%	0.58 / 0.56 / +2.1%
clickbench_q05/datafusion:parquet	235696960 / 235813403 / -0.0%	372234309 / 379537461 / -1.9%	0.63 / 0.62 / +1.9%
clickbench_q06/datafusion:parquet	1908934 / 1915211 / -0.3%	78556225 / 87028517 / -9.7%	0.02 / 0.02 / +10.4%
clickbench_q07/datafusion:parquet	17976687 / 18394328 / -2.3%	117974928 / 124690376 / -5.4%	0.15 / 0.15 / +3.3%
clickbench_q08/datafusion:parquet	232119258 / 226860766 / +2.3%	377373996 / 386435324 / -2.3%	0.62 / 0.59 / +4.8%
clickbench_q09/datafusion:parquet	364820793 / 366383054 / -0.4%	510126731 / 513413270 / -0.6%	0.72 / 0.71 / +0.2%
clickbench_q10/datafusion:parquet	71557371 / 75232918 / -4.9%	195221238 / 200856814 / -2.8%	0.37 / 0.37 / -2.1%
clickbench_q11/datafusion:parquet	89922427 / 90558634 / -0.7%	211256129 / 223044178 / -5.3%	0.43 / 0.41 / +4.8%
clickbench_q12/datafusion:parquet	238170582 / 236238636 / +0.8%	371656638 / 389444897 / -4.6%	0.64 / 0.61 / +5.6%
clickbench_q13/datafusion:parquet	385675687 / 393268959 / -1.9%	537488555 / 559983386 / -4.0%	0.72 / 0.70 / +2.2%
clickbench_q14/datafusion:parquet	248912688 / 254862906 / -2.3%	388669407 / 402511515 / -3.4%	0.64 / 0.63 / +1.1%
clickbench_q15/datafusion:parquet	192793938 / 196476704 / -1.9%	332616242 / 335954646 / -1.0%	0.58 / 0.58 / -0.9%
clickbench_q16/datafusion:parquet	480016820 / 474735339 / +1.1%	631288119 / 648526995 / -2.7%	0.76 / 0.73 / +3.9%
clickbench_q17/datafusion:parquet	474803428 / 479476957 / -1.0%	628877114 / 647823333 / -2.9%	0.76 / 0.74 / +2.0%
clickbench_q18/datafusion:parquet	890227833 / 916849590 / -2.9%	1072676026 / 1102098043 / -2.7%	0.83 / 0.83 / -0.2%
clickbench_q19/datafusion:parquet	23129042 / 25095602 / -7.8%	123462015 / 137513141 / -10.2% 🟢	0.19 / 0.18 / +2.7%
clickbench_q20/datafusion:parquet	461402480 / 450392973 / +2.4%	607617266 / 628297652 / -3.3%	0.76 / 0.72 / +5.9%
clickbench_q21/datafusion:parquet	437085478 / 481700710 / -9.3%	618231410 / 667464265 / -7.4%	0.71 / 0.72 / -2.0%
clickbench_q22/datafusion:parquet	624246811 / 638201154 / -2.2%	843113976 / 866997948 / -2.8%	0.74 / 0.74 / +0.6%
clickbench_q23/datafusion:parquet	2455406764 / 2780318718 / -11.7% 🟢	2892295433 / 3181661316 / -9.1%	0.85 / 0.87 / -2.9%
clickbench_q24/datafusion:parquet	41683654 / 49236420 / -15.3% 🟢	143453357 / 160488149 / -10.6% 🟢	0.29 / 0.31 / -5.3%
clickbench_q25/datafusion:parquet	88820734 / 87455880 / +1.6%	200883470 / 209571852 / -4.1%	0.44 / 0.42 / +6.0%
clickbench_q26/datafusion:parquet	46090162 / 48667378 / -5.3%	142337407 / 158320477 / -10.1% 🟢	0.32 / 0.31 / +5.3%
clickbench_q27/datafusion:parquet	530853990 / 524600145 / +1.2%	682286618 / 706385962 / -3.4%	0.78 / 0.74 / +4.8%
clickbench_q28/datafusion:parquet	1517056534 / 1526807438 / -0.6%	1650534907 / 1637218614 / +0.8%	0.92 / 0.93 / -1.4%
clickbench_q29/datafusion:parquet	40143404 / 40363524 / -0.5%	149266939 / 161086001 / -7.3%	0.27 / 0.25 / +7.3%
clickbench_q30/datafusion:parquet	235185406 / 232625718 / +1.1%	384583860 / 394812314 / -2.6%	0.61 / 0.59 / +3.8%
clickbench_q31/datafusion:parquet	265643834 / 270636816 / -1.8%	441791193 / 452154128 / -2.3%	0.60 / 0.60 / +0.5%
clickbench_q32/datafusion:parquet	853458767 / 844272192 / +1.1%	1029881109 / 1039157830 / -0.9%	0.83 / 0.81 / +2.0%
clickbench_q33/datafusion:parquet	1078534228 / 1081958358 / -0.3%	1281560273 / 1307262260 / -2.0%	0.84 / 0.83 / +1.7%
clickbench_q34/datafusion:parquet	1089847438 / 1088577825 / +0.1%	1272957504 / 1285617213 / -1.0%	0.86 / 0.85 / +1.1%
clickbench_q35/datafusion:parquet	160695445 / 160745641 / -0.0%	288721268 / 296699530 / -2.7%	0.56 / 0.54 / +2.7%
clickbench_q36/datafusion:parquet	107879696 / 107513233 / +0.3%	217156412 / 228950612 / -5.2%	0.50 / 0.47 / +5.8%
clickbench_q37/datafusion:parquet	48714267 / 49941704 / -2.5%	145431173 / 153763962 / -5.4%	0.33 / 0.32 / +3.1%
clickbench_q38/datafusion:parquet	65890534 / 65128260 / +1.2%	165514251 / 177836485 / -6.9%	0.40 / 0.37 / +8.7%
clickbench_q39/datafusion:parquet	200765832 / 206408133 / -2.7%	323187308 / 336928579 / -4.1%	0.62 / 0.61 / +1.4%
clickbench_q40/datafusion:parquet	26482518 / 26949454 / -1.7%	123969821 / 134875343 / -8.1%	0.21 / 0.20 / +6.9%
clickbench_q41/datafusion:parquet	26179364 / 26023876 / +0.6%	117322359 / 132268290 / -11.3% 🟢	0.22 / 0.20 / +13.4%
clickbench_q42/datafusion:parquet	25830135 / 26867074 / -3.9%	117449907 / 128542142 / -8.6%	0.22 / 0.21 / +5.2%

duckdb / vortex-file-compressed / ns (1.008x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	12767898 / 14606923 / -12.6% 🟢	66298648 / 70383489 / -5.8%	0.19 / 0.21 / -7.2%
clickbench_q01/duckdb:vortex-file-compressed	19353440 / 18459006 / +4.8%	91768018 / 108392499 / -15.3% 🟢	0.21 / 0.17 / +23.8%
clickbench_q02/duckdb:vortex-file-compressed	23092234 / 23007281 / +0.4%	101008773 / 119616629 / -15.6% 🟢	0.23 / 0.19 / +18.9%
clickbench_q03/duckdb:vortex-file-compressed	33074100 / 32822514 / +0.8%	113685455 / 106462183 / +6.8%	0.29 / 0.31 / -5.6%
clickbench_q04/duckdb:vortex-file-compressed	133012386 / 133122606 / -0.1%	213653164 / 220923968 / -3.3%	0.62 / 0.60 / +3.3%
clickbench_q05/duckdb:vortex-file-compressed	154478672 / 153388026 / +0.7%	247462544 / 240687976 / +2.8%	0.62 / 0.64 / -2.0%
clickbench_q06/duckdb:vortex-file-compressed	22088904 / 22113015 / -0.1%	102277588 / 98080297 / +4.3%	0.22 / 0.23 / -4.2%
clickbench_q07/duckdb:vortex-file-compressed	23172908 / 21934206 / +5.6%	102996661 / 106810540 / -3.6%	0.22 / 0.21 / +9.6%
clickbench_q08/duckdb:vortex-file-compressed	172700192 / 173191938 / -0.3%	280745245 / 294395014 / -4.6%	0.62 / 0.59 / +4.6%
clickbench_q09/duckdb:vortex-file-compressed	215981556 / 211872030 / +1.9%	338594514 / 338658107 / -0.0%	0.64 / 0.63 / +2.0%
clickbench_q10/duckdb:vortex-file-compressed	76671202 / 75149937 / +2.0%	184678669 / 187675498 / -1.6%	0.42 / 0.40 / +3.7%
clickbench_q11/duckdb:vortex-file-compressed	100375357 / 95910244 / +4.7%	195714711 / 197258850 / -0.8%	0.51 / 0.49 / +5.5%
clickbench_q12/duckdb:vortex-file-compressed	178536366 / 180106300 / -0.9%	292844302 / 294199762 / -0.5%	0.61 / 0.61 / -0.4%
clickbench_q13/duckdb:vortex-file-compressed	324853386 / 323618180 / +0.4%	449718537 / 458532310 / -1.9%	0.72 / 0.71 / +2.3%
clickbench_q14/duckdb:vortex-file-compressed	193110298 / 194989282 / -1.0%	306592432 / 312930435 / -2.0%	0.63 / 0.62 / +1.1%
clickbench_q15/duckdb:vortex-file-compressed	187412952 / 188949356 / -0.8%	288794848 / 295752041 / -2.4%	0.65 / 0.64 / +1.6%
clickbench_q16/duckdb:vortex-file-compressed	372062516 / 377653867 / -1.5%	495498081 / 504036172 / -1.7%	0.75 / 0.75 / +0.2%
clickbench_q17/duckdb:vortex-file-compressed	371178100 / 375258026 / -1.1%	462851521 / 503740518 / -8.1%	0.80 / 0.74 / +7.7%
clickbench_q18/duckdb:vortex-file-compressed	721475514 / 741424136 / -2.7%	873266088 / 893422043 / -2.3%	0.83 / 0.83 / -0.4%
clickbench_q19/duckdb:vortex-file-compressed	28053696 / 27477238 / +2.1%	110471181 / 115304993 / -4.2%	0.25 / 0.24 / +6.6%
clickbench_q20/duckdb:vortex-file-compressed	247833710 / 245966798 / +0.8%	447845218 / 449222887 / -0.3%	0.55 / 0.55 / +1.1%
clickbench_q21/duckdb:vortex-file-compressed	372297064 / 369667346 / +0.7%	640140902 / 658091334 / -2.7%	0.58 / 0.56 / +3.5%
clickbench_q22/duckdb:vortex-file-compressed	553937077 / 563989540 / -1.8%	946628781 / 974945407 / -2.9%	0.59 / 0.58 / +1.2%
clickbench_q23/duckdb:vortex-file-compressed	124295413 / 124107512 / +0.2%	233946351 / 240874517 / -2.9%	0.53 / 0.52 / +3.1%
clickbench_q24/duckdb:vortex-file-compressed	40398040 / 38257639 / +5.6%	93987595 / 93694153 / +0.3%	0.43 / 0.41 / +5.3%
clickbench_q25/duckdb:vortex-file-compressed	63029722 / 63256734 / -0.4%	149764819 / 153212247 / -2.3%	0.42 / 0.41 / +1.9%
clickbench_q26/duckdb:vortex-file-compressed	36511424 / 36607518 / -0.3%	95270394 / 90915077 / +4.8%	0.38 / 0.40 / -4.8%
clickbench_q27/duckdb:vortex-file-compressed	246950350 / 240835416 / +2.5%	519139420 / 512045649 / +1.4%	0.48 / 0.47 / +1.1%
clickbench_q28/duckdb:vortex-file-compressed	1289826284 / 1267977778 / +1.7%	1430732101 / 1520290674 / -5.9%	0.90 / 0.83 / +8.1%
clickbench_q29/duckdb:vortex-file-compressed	31577780 / 30914333 / +2.1%	111046041 / 110161013 / +0.8%	0.28 / 0.28 / +1.3%
clickbench_q30/duckdb:vortex-file-compressed	169435810 / 170252890 / -0.5%	282205065 / 285253084 / -1.1%	0.60 / 0.60 / +0.6%
clickbench_q31/duckdb:vortex-file-compressed	327021592 / 286676578 / +14.1% 🔴	505223563 / 492154586 / +2.7%	0.65 / 0.58 / +11.1%
clickbench_q32/duckdb:vortex-file-compressed	931559120 / 923926822 / +0.8%	1063465720 / 1055225727 / +0.8%	0.88 / 0.88 / +0.0%
clickbench_q33/duckdb:vortex-file-compressed	1076531756 / 1060735598 / +1.5%	1108192213 / 1276598388 / -13.2% 🟢	0.97 / 0.83 / +16.9%
clickbench_q34/duckdb:vortex-file-compressed	1085746602 / 1084609277 / +0.1%	1348912715 / 1331942181 / +1.3%	0.80 / 0.81 / -1.2%
clickbench_q35/duckdb:vortex-file-compressed	208680236 / 208714316 / -0.0%	294619804 / 299949055 / -1.8%	0.71 / 0.70 / +1.8%
clickbench_q36/duckdb:vortex-file-compressed	28966817 / 29160840 / -0.7%	110424274 / 93062148 / +18.7% 🔴	0.26 / 0.31 / -16.3%
clickbench_q37/duckdb:vortex-file-compressed	19496252 / 19941420 / -2.2%	82718340 / 100324560 / -17.5% 🟢	0.24 / 0.20 / +18.6%
clickbench_q38/duckdb:vortex-file-compressed	24077580 / 23475485 / +2.6%	95198279 / 99661579 / -4.5%	0.25 / 0.24 / +7.4%
clickbench_q39/duckdb:vortex-file-compressed	46808118 / 46897825 / -0.2%	128111194 / 125891565 / +1.8%	0.37 / 0.37 / -1.9%
clickbench_q40/duckdb:vortex-file-compressed	18342779 / 16773709 / +9.4%	79767758 / 87833308 / -9.2%	0.23 / 0.19 / +20.4%
clickbench_q41/duckdb:vortex-file-compressed	19148798 / 18115919 / +5.7%	96699232 / 69738199 / +38.7% 🔴	0.20 / 0.26 / -23.8%
clickbench_q42/duckdb:vortex-file-compressed	19523564 / 20853838 / -6.4%	101188703 / 84547700 / +19.7% 🔴	0.19 / 0.25 / -21.8%

duckdb / parquet / ns (1.010x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	15646766 / 14240842 / +9.9%	43545079 / 40122544 / +8.5%	0.36 / 0.35 / +1.2%
clickbench_q01/duckdb:parquet	17637217 / 16106234 / +9.5%	37167287 / 39459667 / -5.8%	0.47 / 0.41 / +16.3%
clickbench_q02/duckdb:parquet	25112630 / 25177477 / -0.3%	58695549 / 57106014 / +2.8%	0.43 / 0.44 / -3.0%
clickbench_q03/duckdb:parquet	27319581 / 30870139 / -11.5% 🟢	89452456 / 86330263 / +3.6%	0.31 / 0.36 / -14.6%
clickbench_q04/duckdb:parquet	133513792 / 128934770 / +3.6%	182927533 / 178261371 / +2.6%	0.73 / 0.72 / +0.9%
clickbench_q05/duckdb:parquet	202994267 / 198679331 / +2.2%	264115687 / 243800934 / +8.3%	0.77 / 0.81 / -5.7%
clickbench_q06/duckdb:parquet	27357262 / 24108592 / +13.5% 🔴	47162070 / 47091144 / +0.2%	0.58 / 0.51 / +13.3%
clickbench_q07/duckdb:parquet	21010940 / 20792285 / +1.1%	44800850 / 38147067 / +17.4% 🔴	0.47 / 0.55 / -14.0%
clickbench_q08/duckdb:parquet	166235698 / 162711680 / +2.2%	255873152 / 258489487 / -1.0%	0.65 / 0.63 / +3.2%
clickbench_q09/duckdb:parquet	230507283 / 227446219 / +1.3%	309111347 / 316319885 / -2.3%	0.75 / 0.72 / +3.7%
clickbench_q10/duckdb:parquet	68853905 / 62642829 / +9.9%	118348183 / 116076764 / +2.0%	0.58 / 0.54 / +7.8%
clickbench_q11/duckdb:parquet	75141278 / 69951550 / +7.4%	131994455 / 130431655 / +1.2%	0.57 / 0.54 / +6.1%
clickbench_q12/duckdb:parquet	177630124 / 175742983 / +1.1%	272356040 / 276109163 / -1.4%	0.65 / 0.64 / +2.5%
clickbench_q13/duckdb:parquet	307395975 / 310619779 / -1.0%	431939854 / 424407667 / +1.8%	0.71 / 0.73 / -2.8%
clickbench_q14/duckdb:parquet	193343289 / 188085624 / +2.8%	301691102 / 276831757 / +9.0%	0.64 / 0.68 / -5.7%
clickbench_q15/duckdb:parquet	195402698 / 187325633 / +4.3%	234449912 / 239200017 / -2.0%	0.83 / 0.78 / +6.4%
clickbench_q16/duckdb:parquet	355178623 / 349444148 / +1.6%	472011362 / 486057482 / -2.9%	0.75 / 0.72 / +4.7%
clickbench_q17/duckdb:parquet	358186770 / 356538390 / +0.5%	472067060 / 456843427 / +3.3%	0.76 / 0.78 / -2.8%
clickbench_q18/duckdb:parquet	686228638 / 686831528 / -0.1%	875147640 / 900791343 / -2.8%	0.78 / 0.76 / +2.8%
clickbench_q19/duckdb:parquet	24771859 / 22931883 / +8.0%	66914540 / 70415193 / -5.0%	0.37 / 0.33 / +13.7%
clickbench_q20/duckdb:parquet	265527385 / 263667138 / +0.7%	462154798 / 467712327 / -1.2%	0.57 / 0.56 / +1.9%
clickbench_q21/duckdb:parquet	332258442 / 328411866 / +1.2%	611711658 / 600394931 / +1.9%	0.54 / 0.55 / -0.7%
clickbench_q22/duckdb:parquet	476427146 / 492441092 / -3.3%	772483218 / 782583494 / -1.3%	0.62 / 0.63 / -2.0%
clickbench_q23/duckdb:parquet	241453794 / 267704112 / -9.8%	306614238 / 306093563 / +0.2%	0.79 / 0.87 / -10.0%
clickbench_q24/duckdb:parquet	76894894 / 75264738 / +2.2%	118503031 / 123597583 / -4.1%	0.65 / 0.61 / +6.6%
clickbench_q25/duckdb:parquet	73146339 / 76322192 / -4.2%	178411079 / 182002999 / -2.0%	0.41 / 0.42 / -2.2%
clickbench_q26/duckdb:parquet	62477566 / 59924506 / +4.3%	102309292 / 94349921 / +8.4%	0.61 / 0.64 / -3.9%
clickbench_q27/duckdb:parquet	289850126 / 278335319 / +4.1%	511465253 / 505954726 / +1.1%	0.57 / 0.55 / +3.0%
clickbench_q28/duckdb:parquet	1696540348 / 1733042222 / -2.1%	2109567135 / 2149365185 / -1.9%	0.80 / 0.81 / -0.3%
clickbench_q29/duckdb:parquet	27089847 / 28643484 / -5.4%	60405300 / 62743188 / -3.7%	0.45 / 0.46 / -1.8%
clickbench_q30/duckdb:parquet	181816849 / 183495287 / -0.9%	334118750 / 336891496 / -0.8%	0.54 / 0.54 / -0.1%
clickbench_q31/duckdb:parquet	313813575 / 313591234 / +0.1%	612407888 / 543628333 / +12.7% 🔴	0.51 / 0.58 / -11.2%
clickbench_q32/duckdb:parquet	897359376 / 911585154 / -1.6%	1033771780 / 1030202414 / +0.3%	0.87 / 0.88 / -1.9%
clickbench_q33/duckdb:parquet	805183167 / 783237836 / +2.8%	951038444 / 983787152 / -3.3%	0.85 / 0.80 / +6.3%
clickbench_q34/duckdb:parquet	815176532 / 803215974 / +1.5%	1098558399 / 986745412 / +11.3% 🔴	0.74 / 0.81 / -8.8%
clickbench_q35/duckdb:parquet	207985478 / 209618784 / -0.8%	246737415 / 239220703 / +3.1%	0.84 / 0.88 / -3.8%
clickbench_q36/duckdb:parquet	49834224 / 48614359 / +2.5%	68766394 / 69959584 / -1.7%	0.72 / 0.69 / +4.3%
clickbench_q37/duckdb:parquet	37420402 / 36840140 / +1.6%	58459310 / 58647239 / -0.3%	0.64 / 0.63 / +1.9%
clickbench_q38/duckdb:parquet	38378124 / 38688356 / -0.8%	59185854 / 64618543 / -8.4%	0.65 / 0.60 / +8.3%
clickbench_q39/duckdb:parquet	86674430 / 93838312 / -7.6%	110975998 / 106227384 / +4.5%	0.78 / 0.88 / -11.6%
clickbench_q40/duckdb:parquet	21244790 / 20452382 / +3.9%	42052346 / 43414622 / -3.1%	0.51 / 0.47 / +7.2%
clickbench_q41/duckdb:parquet	20821188 / 22664810 / -8.1%	45620682 / 41719566 / +9.4%	0.46 / 0.54 / -16.0%
clickbench_q42/duckdb:parquet	24222307 / 24054759 / +0.7%	47903472 / 47252095 / +1.4%	0.51 / 0.51 / -0.7%

No file size changes detected.

github-actions · 2026-08-26T11:13:46Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR a65d7444 vs base 5f6b29f6
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (+7.0%, environment too noisy confidence) · DuckDB No clear signal (-5.8%, low confidence)
Vortex (geomean): hot 0.948x ➖ · cold 0.968x ➖
Parquet (geomean): hot 0.944x ➖ · cold 0.942x ➖
Shifts: Parquet (control) -5.6% · Median polish -2.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.955x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	242776821 / 231192382 / +5.0%	688275271 / 850728962 / -19.1%	0.35 / 0.27 / +29.8%
tpch_q02/datafusion:vortex-file-compressed	334360622 / 417702006 / -20.0%	791888456 / 815561890 / -2.9%	0.42 / 0.51 / -17.6%
tpch_q03/datafusion:vortex-file-compressed	390532609 / 365808323 / +6.8%	1222261726 / 1249420429 / -2.2%	0.32 / 0.29 / +9.1%
tpch_q04/datafusion:vortex-file-compressed	166199083 / 172868098 / -3.9%	375582234 / 354398040 / +6.0%	0.44 / 0.49 / -9.3%
tpch_q05/datafusion:vortex-file-compressed	370310394 / 325383291 / +13.8%	603371221 / 648590956 / -7.0%	0.61 / 0.50 / +22.3%
tpch_q06/datafusion:vortex-file-compressed	269715067 / 252352803 / +6.9%	469951867 / 411907988 / +14.1%	0.57 / 0.61 / -6.3%
tpch_q07/datafusion:vortex-file-compressed	420738529 / 378657474 / +11.1%	750462366 / 539757380 / +39.0% 🔴	0.56 / 0.70 / -20.1%
tpch_q08/datafusion:vortex-file-compressed	386982218 / 508740687 / -23.9%	566979865 / 643133320 / -11.8%	0.68 / 0.79 / -13.7%
tpch_q09/datafusion:vortex-file-compressed	256938502 / 354137599 / -27.4%	529904399 / 584121636 / -9.3%	0.48 / 0.61 / -20.0%
tpch_q10/datafusion:vortex-file-compressed	299413832 / 395220479 / -24.2%	503828177 / 613676901 / -17.9%	0.59 / 0.64 / -7.7%
tpch_q11/datafusion:vortex-file-compressed	251167167 / 276778860 / -9.3%	494804667 / 417601352 / +18.5%	0.51 / 0.66 / -23.4%
tpch_q12/datafusion:vortex-file-compressed	319445644 / 371532729 / -14.0%	543442242 / 620882696 / -12.5%	0.59 / 0.60 / -1.8%
tpch_q13/datafusion:vortex-file-compressed	108528771 / 110887919 / -2.1%	530364269 / 375743346 / +41.2% 🔴	0.20 / 0.30 / -30.7%
tpch_q14/datafusion:vortex-file-compressed	159646592 / 161838986 / -1.4%	304388830 / 360193780 / -15.5%	0.52 / 0.45 / +16.7%
tpch_q15/datafusion:vortex-file-compressed	288881718 / 321231064 / -10.1%	578048399 / 597851165 / -3.3%	0.50 / 0.54 / -7.0%
tpch_q16/datafusion:vortex-file-compressed	156510181 / 228473172 / -31.5% 🟢	306105479 / 348962826 / -12.3%	0.51 / 0.65 / -21.9%
tpch_q17/datafusion:vortex-file-compressed	278339852 / 290399582 / -4.2%	452949394 / 476519396 / -4.9%	0.61 / 0.61 / +0.8%
tpch_q18/datafusion:vortex-file-compressed	263020463 / 223857570 / +17.5%	454550033 / 495023763 / -8.2%	0.58 / 0.45 / +28.0%
tpch_q19/datafusion:vortex-file-compressed	427348544 / 337901889 / +26.5%	511756699 / 526559060 / -2.8%	0.84 / 0.64 / +30.1%
tpch_q20/datafusion:vortex-file-compressed	324118105 / 367878570 / -11.9%	513004359 / 562847482 / -8.9%	0.63 / 0.65 / -3.3%
tpch_q21/datafusion:vortex-file-compressed	508012382 / 450294706 / +12.8%	596451237 / 633004148 / -5.8%	0.85 / 0.71 / +19.7%
tpch_q22/datafusion:vortex-file-compressed	187459311 / 164952028 / +13.6%	364548965 / 418259214 / -12.8%	0.51 / 0.39 / +30.4%

datafusion / parquet / ns (0.892x ➖, 2↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	217991401 / 202981426 / +7.4%	586080776 / 562224265 / +4.2%	0.37 / 0.36 / +3.0%
tpch_q02/datafusion:parquet	309341385 / 277655707 / +11.4%	517760882 / 553243412 / -6.4%	0.60 / 0.50 / +19.0%
tpch_q03/datafusion:parquet	336720483 / 301516937 / +11.7%	938591588 / 929289911 / +1.0%	0.36 / 0.32 / +10.6%
tpch_q04/datafusion:parquet	155665656 / 157003697 / -0.9%	431383092 / 388961831 / +10.9%	0.36 / 0.40 / -10.6%
tpch_q05/datafusion:parquet	351373949 / 370402518 / -5.1%	536780423 / 503311345 / +6.6%	0.65 / 0.74 / -11.1%
tpch_q06/datafusion:parquet	150873069 / 133674774 / +12.9%	276148551 / 259562466 / +6.4%	0.55 / 0.52 / +6.1%
tpch_q07/datafusion:parquet	392939353 / 398136308 / -1.3%	519906234 / 542074345 / -4.1%	0.76 / 0.73 / +2.9%
tpch_q08/datafusion:parquet	438151027 / 436012962 / +0.5%	548317778 / 602767649 / -9.0%	0.80 / 0.72 / +10.5%
tpch_q09/datafusion:parquet	450558294 / 472504110 / -4.6%	643915137 / 680402702 / -5.4%	0.70 / 0.69 / +0.8%
tpch_q10/datafusion:parquet	408881100 / 413109447 / -1.0%	540529285 / 661152927 / -18.2%	0.76 / 0.62 / +21.1%
tpch_q11/datafusion:parquet	273955204 / 280582647 / -2.4%	443531797 / 483908438 / -8.3%	0.62 / 0.58 / +6.5%
tpch_q12/datafusion:parquet	195680409 / 216965174 / -9.8%	459860356 / 448991365 / +2.4%	0.43 / 0.48 / -11.9%
tpch_q13/datafusion:parquet	444545879 / 445995513 / -0.3%	638892709 / 664565059 / -3.9%	0.70 / 0.67 / +3.7%
tpch_q14/datafusion:parquet	255022287 / 196252099 / +29.9%	346982175 / 311508873 / +11.4%	0.73 / 0.63 / +16.7%
tpch_q15/datafusion:parquet	263659461 / 275792110 / -4.4%	477073478 / 458036477 / +4.2%	0.55 / 0.60 / -8.2%
tpch_q16/datafusion:parquet	152028536 / 124100745 / +22.5%	464079656 / 356988077 / +30.0%	0.33 / 0.35 / -5.8%
tpch_q17/datafusion:parquet	331322412 / 323361205 / +2.5%	454727139 / 511678476 / -11.1%	0.73 / 0.63 / +15.3%
tpch_q18/datafusion:parquet	424359097 / 471381368 / -10.0%	591892177 / 699749509 / -15.4%	0.72 / 0.67 / +6.4%
tpch_q19/datafusion:parquet	195366750 / 197555592 / -1.1%	351953420 / 376988197 / -6.6%	0.56 / 0.52 / +5.9%
tpch_q20/datafusion:parquet	256654255 / 2965974014 / -91.3% 🟢	408309363 / 1535756570 / -73.4% 🟢	0.63 / 1.93 / -67.5%
tpch_q21/datafusion:parquet	312526311 / 561717218 / -44.4% 🟢	460952291 / 727869753 / -36.7% 🟢	0.68 / 0.77 / -12.1%
tpch_q22/datafusion:parquet	175468937 / 167694729 / +4.6%	372928803 / 357009466 / +4.5%	0.47 / 0.47 / +0.2%

duckdb / vortex-file-compressed / ns (0.941x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	208712926 / 218905260 / -4.7%	272474112 / 310982727 / -12.4%	0.77 / 0.70 / +8.8%
tpch_q02/duckdb:vortex-file-compressed	388585724 / 400041371 / -2.9%	441359276 / 432422886 / +2.1%	0.88 / 0.93 / -4.8%
tpch_q03/duckdb:vortex-file-compressed	428042553 / 602206823 / -28.9%	412254400 / 448192939 / -8.0%	1.04 / 1.34 / -22.7%
tpch_q04/duckdb:vortex-file-compressed	310387093 / 258295518 / +20.2%	316780194 / 284726824 / +11.3%	0.98 / 0.91 / +8.0%
tpch_q05/duckdb:vortex-file-compressed	377640978 / 427971330 / -11.8%	464557133 / 476183668 / -2.4%	0.81 / 0.90 / -9.6%
tpch_q06/duckdb:vortex-file-compressed	253083962 / 413605487 / -38.8% 🟢	275464474 / 262711545 / +4.9%	0.92 / 1.57 / -41.6%
tpch_q07/duckdb:vortex-file-compressed	418104782 / 445572594 / -6.2%	459715267 / 530758999 / -13.4%	0.91 / 0.84 / +8.3%
tpch_q08/duckdb:vortex-file-compressed	597129967 / 595889861 / +0.2%	1196168029 / 680522490 / +75.8% 🔴	0.50 / 0.88 / -43.0%
tpch_q09/duckdb:vortex-file-compressed	462284916 / 476149813 / -2.9%	513550595 / 529798749 / -3.1%	0.90 / 0.90 / +0.2%
tpch_q10/duckdb:vortex-file-compressed	444474766 / 440849568 / +0.8%	449311700 / 466295632 / -3.6%	0.99 / 0.95 / +4.6%
tpch_q11/duckdb:vortex-file-compressed	145316238 / 143187532 / +1.5%	166483655 / 185849876 / -10.4%	0.87 / 0.77 / +13.3%
tpch_q12/duckdb:vortex-file-compressed	496563191 / 573395051 / -13.4%	577774745 / 898684336 / -35.7% 🟢	0.86 / 0.64 / +34.7%
tpch_q13/duckdb:vortex-file-compressed	292093310 / 311811573 / -6.3%	411900439 / 297710137 / +38.4% 🔴	0.71 / 1.05 / -32.3%
tpch_q14/duckdb:vortex-file-compressed	222193175 / 247609816 / -10.3%	343311606 / 303864374 / +13.0%	0.65 / 0.81 / -20.6%
tpch_q15/duckdb:vortex-file-compressed	150601204 / 149798824 / +0.5%	189835802 / 243775662 / -22.1%	0.79 / 0.61 / +29.1%
tpch_q16/duckdb:vortex-file-compressed	194476716 / 194005397 / +0.2%	248353345 / 238778111 / +4.0%	0.78 / 0.81 / -3.6%
tpch_q17/duckdb:vortex-file-compressed	375533027 / 383720913 / -2.1%	431678459 / 480184478 / -10.1%	0.87 / 0.80 / +8.9%
tpch_q18/duckdb:vortex-file-compressed	354301662 / 299741095 / +18.2%	411546685 / 394143310 / +4.4%	0.86 / 0.76 / +13.2%
tpch_q19/duckdb:vortex-file-compressed	317368251 / 373775491 / -15.1%	362084857 / 441497756 / -18.0%	0.88 / 0.85 / +3.5%
tpch_q20/duckdb:vortex-file-compressed	386294411 / 410767873 / -6.0%	456184802 / 516133051 / -11.6%	0.85 / 0.80 / +6.4%
tpch_q21/duckdb:vortex-file-compressed	597375892 / 669075895 / -10.7%	660829786 / 1005813189 / -34.3% 🟢	0.90 / 0.67 / +35.9%
tpch_q22/duckdb:vortex-file-compressed	131345807 / 121568237 / +8.0%	164281871 / 159057299 / +3.3%	0.80 / 0.76 / +4.6%

duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	311937663 / 312313989 / -0.1%	321493789 / 323321425 / -0.6%	0.97 / 0.97 / +0.4%
tpch_q02/duckdb:parquet	689458688 / 689537707 / -0.0%	722121596 / 748953140 / -3.6%	0.95 / 0.92 / +3.7%
tpch_q03/duckdb:parquet	771757079 / 782614722 / -1.4%	838464556 / 838461189 / +0.0%	0.92 / 0.93 / -1.4%
tpch_q04/duckdb:parquet	467071902 / 493260658 / -5.3%	547555342 / 647943335 / -15.5%	0.85 / 0.76 / +12.1%
tpch_q05/duckdb:parquet	1014121573 / 1008035934 / +0.6%	942525466 / 1119745499 / -15.8%	1.08 / 0.90 / +19.5%
tpch_q06/duckdb:parquet	326984635 / 307726989 / +6.3%	297151132 / 282744726 / +5.1%	1.10 / 1.09 / +1.1%
tpch_q07/duckdb:parquet	907228530 / 877006048 / +3.4%	912562938 / 910388364 / +0.2%	0.99 / 0.96 / +3.2%
tpch_q08/duckdb:parquet	1165898419 / 1174570322 / -0.7%	1153949949 / 1155579276 / -0.1%	1.01 / 1.02 / -0.6%
tpch_q09/duckdb:parquet	1037622006 / 1104960846 / -6.1%	1158560791 / 1107826461 / +4.6%	0.90 / 1.00 / -10.2%
tpch_q10/duckdb:parquet	1013347121 / 1048788841 / -3.4%	996455299 / 1263164668 / -21.1%	1.02 / 0.83 / +22.5%
tpch_q11/duckdb:parquet	476404222 / 502094680 / -5.1%	437170604 / 446210462 / -2.0%	1.09 / 1.13 / -3.2%
tpch_q12/duckdb:parquet	558655209 / 553936486 / +0.9%	762512463 / 662725051 / +15.1%	0.73 / 0.84 / -12.3%
tpch_q13/duckdb:parquet	842007261 / 844861242 / -0.3%	855847191 / 942462181 / -9.2%	0.98 / 0.90 / +9.7%
tpch_q14/duckdb:parquet	557257324 / 534041150 / +4.3%	705577039 / 476403871 / +48.1% 🔴	0.79 / 1.12 / -29.5%
tpch_q15/duckdb:parquet	398224599 / 415942417 / -4.3%	364041620 / 357354258 / +1.9%	1.09 / 1.16 / -6.0%
tpch_q16/duckdb:parquet	520846657 / 563981813 / -7.6%	499050105 / 552501456 / -9.7%	1.04 / 1.02 / +2.2%
tpch_q17/duckdb:parquet	570043361 / 504151878 / +13.1%	500553968 / 716315260 / -30.1% 🟢	1.14 / 0.70 / +61.8%
tpch_q18/duckdb:parquet	677574896 / 655965093 / +3.3%	645523210 / 708361286 / -8.9%	1.05 / 0.93 / +13.3%
tpch_q19/duckdb:parquet	591009817 / 590993235 / +0.0%	633802359 / 671774109 / -5.7%	0.93 / 0.88 / +6.0%
tpch_q20/duckdb:parquet	873585369 / 866146273 / +0.9%	826895001 / 920390520 / -10.2%	1.06 / 0.94 / +12.3%
tpch_q21/duckdb:parquet	787028011 / 806039045 / -2.4%	938290556 / 778533813 / +20.5%	0.84 / 1.04 / -19.0%
tpch_q22/duckdb:parquet	439631501 / 422369430 / +4.1%	440470252 / 455426517 / -3.3%	1.00 / 0.93 / +7.6%

robert3005 · 2026-08-26T11:16:24Z

@AdamGS you tried so hard

Execution error: Arithmetic Overflow in AvgAccumulator

in tpc-ds

AdamGS · 2026-08-26T11:33:12Z

I know :( I have another PR to DF to address this - apache/datafusion#24371

robert3005 · 2026-08-26T11:41:03Z

Indeed apache/datafusion#24371 is the missing part to make it usable

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

Signed-off-by: Robert Kruszewski <github@robertk.io>

DataFusion 55 tightens the lower bounds of three crates that the workspace also declares directly: datafusion-common needs chrono 0.4.45, datafusion-functions needs memchr 2.8.1, and datafusion-macros needs syn 3.0.2. Our lower bounds stayed one patch behind, so `cargo minimal-versions check --direct` could not resolve a version that satisfied both sides and CI failed before it compiled anything. Cargo.lock already selects versions above the new floors, so this changes no resolved dependency for a normal build. Signed-off-by: Robert Kruszewski <robert@spiraldb.com>

Signed-off-by: Robert Kruszewski <github@robertk.io>

Resolves the Cargo.toml conflict on the tpchgen pins. develop moved `tpchgen`/`tpchgen-arrow` from a git-pinned 2.0.2 to the released 3.0.0 as part of "Bump Datafusion to 55" (#9334); this branch still carried the pin and DataFusion 54. The pin and the release go together, so take develop's side: the merge brings DataFusion 55, which is the version 3.0.0 pairs with. The conflict region also duplicated the `vortex-array-macros` workspace dependency, which develop already lists in its sorted position among the crates published by this project. Dropped the stray copy; `cargo metadata` rejected the manifest until it was gone. Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>

AdamGS added changelog/chore A trivial change ext/datafusion Relates to the DataFusion integration labels Aug 10, 2026

AdamGS mentioned this pull request Aug 10, 2026

Release DataFusion 55.0.0 (Jul / Aug 2026) apache/datafusion#22393

Closed

50 tasks

AdamGS added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 10, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 10, 2026

AdamGS force-pushed the adamg/df-55 branch 2 times, most recently from c8b775d to 9dd15ac Compare August 14, 2026 11:48

AdamGS added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 14, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 14, 2026

AdamGS added the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 14, 2026

github-actions Bot removed the action/bench-all Runs all CPU benchmarks. Do not combine with other benchmark labels; GPU is the only exception. label Aug 14, 2026

robert3005 mentioned this pull request Aug 25, 2026

chore(deps): update datafusion monorepo to v55 - autoclosed #9562

Closed

1 task

robert3005 force-pushed the adamg/df-55 branch from 7152f4c to 27251c4 Compare August 25, 2026 11:09

robert3005 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 26, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 26, 2026

AdamGS and others added 15 commits August 26, 2026 16:51

DF stuff

834a4a2

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

geo 1.95

9df820f

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

touch ups

80e653f

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

update

99ec2ef

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

clippy

1b7eadf

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

tpch schema

8ac242a

Signed-off-by: Adam Gutglick <adam@spiraldb.com>

fixes

a18be4c

Signed-off-by: Robert Kruszewski <github@robertk.io>

mindeps

bc39659

Signed-off-by: Robert Kruszewski <github@robertk.io>

more

d14ae06

Signed-off-by: Robert Kruszewski <github@robertk.io>

min

b9ff1cc

Signed-off-by: Robert Kruszewski <github@robertk.io>

min dep

452d915

Signed-off-by: Robert Kruszewski <github@robertk.io>

don't pushdown decimal casts

e5f3024

Signed-off-by: Robert Kruszewski <github@robertk.io>

less

8d25d53

Signed-off-by: Robert Kruszewski <github@robertk.io>

lock

325bfa3

Signed-off-by: Robert Kruszewski <github@robertk.io>

robert3005 force-pushed the adamg/df-55 branch from a65d744 to 325bfa3 Compare August 26, 2026 15:54

robert3005 enabled auto-merge (squash) August 26, 2026 16:58

robert3005 approved these changes Aug 26, 2026

View reviewed changes

robert3005 merged commit beb7c15 into develop Aug 26, 2026
83 checks passed

robert3005 deleted the adamg/df-55 branch August 26, 2026 16:59

Uh oh!

Conversation

AdamGS commented Aug 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Rationale for this change

What changes are included in this PR?

What APIs are changed? Are there any user-facing changes?

Uh oh!

codspeed-hq Bot commented Aug 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will improve performance by 49.81%

Performance Changes

Footnotes

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: String Encoding 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🚨🚨🚨❌❌❌ SQL BENCHMARK FAILED ❌❌❌🚨🚨🚨

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Appian on NVME 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Random Access 📖

Uh oh!

github-actions Bot commented Aug 14, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Compression 📖

Uh oh!

github-actions Bot commented Aug 26, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

AdamGS commented Aug 10, 2026 •

edited

Loading

codspeed-hq Bot commented Aug 10, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 14, 2026 •

edited

Loading

github-actions Bot commented Aug 26, 2026 •

edited

Loading

github-actions Bot commented Aug 26, 2026 •

edited

Loading

github-actions Bot commented Aug 26, 2026 •

edited

Loading

github-actions Bot commented Aug 26, 2026 •

edited

Loading

robert3005 commented Aug 26, 2026 •

edited

Loading