Skip to content

[SPARK-55647][SQL] Improve ConstantPropagation for collated AttributeReferences - #54515

Closed
ilicmarkodb wants to merge 1 commit into
apache:masterfrom
ilicmarkodb:improve_ConstantPropagation
Closed

[SPARK-55647][SQL] Improve ConstantPropagation for collated AttributeReferences#54515
ilicmarkodb wants to merge 1 commit into
apache:masterfrom
ilicmarkodb:improve_ConstantPropagation

Conversation

@ilicmarkodb

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

The previous change (#54435) completely blocked ConstantPropagation for non-binary-stable types, leading to potential performance implications. In this PR, I propose improving the rule to replace collated AttributeReferences when it is safe.

Why are the changes needed?

Perf improvement.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

New tests.

Was this patch authored or co-authored using generative AI tooling?

No.

@ilicmarkodb
ilicmarkodbforce-pushed the improve_ConstantPropagation branch from ef34a58 to 474f351CompareFebruary 26, 2026 13:11
@cloud-fan

Copy link
Copy Markdown
Contributor

thanks, merging to master!

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@ilicmarkodb@cloud-fan