Skip to content

Push dynamic pushdown through cooperative and projection execs - #17238

Merged
adriangb merged 4 commits into
apache:mainfrom
restatedev:dynamic-pushdown-project
Aug 19, 2025
Merged

Push dynamic pushdown through cooperative and projection execs#17238
adriangb merged 4 commits into
apache:mainfrom
restatedev:dynamic-pushdown-project

Conversation

@jackkleeman

Copy link
Copy Markdown
Contributor

These execs should be safe to pass dynamic pushdown through

@github-actionsgithub-actionsBot added the physical-plan Changes to the physical-plan crate label Aug 19, 2025
@jackkleeman
jackkleemanforce-pushed the dynamic-pushdown-project branch from 4a36aaf to 19251c5CompareAugust 19, 2025 16:18
@adriangb

Copy link
Copy Markdown
Contributor

Looks like we just need to update the plan snapshots 😄

@jackkleeman
jackkleemanforce-pushed the dynamic-pushdown-project branch from 19251c5 to 0c9aea4CompareAugust 19, 2025 16:54
@jackkleeman
jackkleemanforce-pushed the dynamic-pushdown-project branch from 0c9aea4 to 854f255CompareAugust 19, 2025 16:55
@github-actionsgithub-actionsBot added the sqllogictest SQL Logic Tests (.slt) label Aug 19, 2025
Comment threaddatafusion/physical-plan/src/projection.rs
@jackkleeman
jackkleemanforce-pushed the dynamic-pushdown-project branch from 2f741ff to 2de57eeCompareAugust 19, 2025 21:04
@adriangb
adriangb merged commit 4bc0696 into apache:mainAug 19, 2025
27 checks passed
LiaCastaneda pushed a commit to DataDog/datafusion that referenced this pull request Sep 2, 2025
LiaCastaneda added a commit to DataDog/datafusion that referenced this pull request Sep 9, 2025
* Enable physical filter pushdown for hash joins (apache#16954)
(cherry picked from commit b10f453)
* Add ExecutionPlan::reset_state (apache#17028)
* Add ExecutionPlan::reset_state
Co-authored-by: Robert Ream <robert@stably.io>
* Update datafusion/sqllogictest/test_files/cte.slt
* Add reference
* fmt
* add to upgrade guide
* add explain plan, implement in more plans
* fmt
* only explain
---------
Co-authored-by: Robert Ream <robert@stably.io>
* Add dynamic filter (bounds) pushdown to HashJoinExec (apache#16445)
(cherry picked from commit ff77b70)
* Push dynamic pushdown through CooperativeExec and ProjectionExec (apache#17238)
(cherry picked from commit 4bc0696)
* Fix dynamic filter pushdown in HashJoinExec (apache#17201)
(cherry picked from commit 1d4d74b)
* Fix HashJoinExec sideways information passing for partitioned queries (apache#17197)
(cherry picked from commit 64bc58d)
* disallow pushdown of volatile functions (apache#16861)
* dissallow pushdown of volatile PhysicalExprs
* fix
* add FilteredVec helper to handle filter / remap pattern (#34)
* checkpoint: Address PR feedback in https://github.com/apach...
* add FilteredVec to consolidate handling of filter / remap pattern
* lint
* Add slt test for pushing volatile predicates down (#35)
---------
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
(cherry picked from commit 94e8548)
* fix bounds accumulator reset in HashJoinExec dynamic filter pushdown (apache#17371)
---------
Co-authored-by: Adrian Garcia Badaracco <1755071+adriangb@users.noreply.github.com>
Co-authored-by: Robert Ream <robert@stably.io>
Co-authored-by: Jack Kleeman <jackkleeman@gmail.com>
Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

physical-planChanges to the physical-plan cratesqllogictestSQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@jackkleeman@adriangb