Skip to content

Benchmark window function with multiple partitioning columns - #17402

Merged
findepi merged 1 commit into
apache:mainfrom
findepi:findepi/benchmark-window-function-with-multiple-partitioning-columns-ba2906
Sep 4, 2025
Merged

Benchmark window function with multiple partitioning columns#17402
findepi merged 1 commit into
apache:mainfrom
findepi:findepi/benchmark-window-function-with-multiple-partitioning-columns-ba2906

Conversation

@findepi

@findepifindepi commented Sep 4, 2025

Copy link
Copy Markdown
Member

Add benchmark exposing

The benchmark can be run with

cargo bench --bench sql_planner -- physical_window_function_partition

@github-actionsgithub-actionsBot added the core Core DataFusion crate label Sep 4, 2025
@findepi
findepiforce-pushed the findepi/benchmark-window-function-with-multiple-partitioning-columns-ba2906 branch from b6693c2 to 58c2fafCompareSeptember 4, 2025 08:35
@findepi

Copy link
Copy Markdown
MemberAuthor

Results on current main on my busy laptop

physical_window_function_partition_by_4_on_values
time: [485.47 µs 487.78 µs 490.77 µs]
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
physical_window_function_partition_by_7_on_values
time: [22.820 ms 22.891 ms 22.967 ms]
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
Benchmarking physical_window_function_partition_by_8_on_values: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 9.4s, or reduce sample count to 50.
physical_window_function_partition_by_8_on_values
time: [98.300 ms 100.62 ms 103.25 ms]
Found 14 outliers among 100 measurements (14.00%)
5 (5.00%) high mild
9 (9.00%) high severe

(On DF 45, all times are in microseconds.)

@findepi
findepi merged commit ad0beb4 into apache:mainSep 4, 2025
28 checks passed
@findepi
findepi deleted the findepi/benchmark-window-function-with-multiple-partitioning-columns-ba2906 branch September 4, 2025 17:06
destrex271 pushed a commit to destrex271/datafusion that referenced this pull request Sep 5, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

coreCore DataFusion crate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@findepi@timsaucer