Add Distribution::HashPartitioned to Distribution::KeyPartitioned API bridge

[gene-bordegaray]

Which issue does this PR close?

• ClosesReplace / rename HashPartitioned distribution as KeyPartitioned #23236.

Rationale for this change

HashPartitioned is historical naming for a key-partitioning requirement. This keeps the old variant as a deprecated compatibility bridge while moving DataFusion internals to KeyPartitioned.

What changes are included in this PR?

Adds KeyPartitioned, deprecates HashPartitioned, and treats both equivalently during the transition to avoid breaking changes for downstream consumers. A blast radius report on this was done here #23241

Are these changes tested?

Yes.

Are there any user-facing changes?

Yes, Distribution::HashPartitioned is deprecated and trainsitioned to Distribution::KeyPartitioned.

[github-actions]

Thank you for opening this pull request!

Reviewer note: cargo-semver-checks reported the current version number is not SemVer-compatible with the changes in this pull request (compared against the base branch).

Details

 Cloning apache/main
Building datafusion v54.0.0 (current)
Built [ 101.728s] (current)
Parsing datafusion v54.0.0 (current)
Parsed [ 0.034s] (current)
Building datafusion v54.0.0 (baseline)
Built [ 100.916s] (baseline)
Parsing datafusion v54.0.0 (baseline)
Parsed [ 0.036s] (baseline)
Checking datafusion v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.586s] 223 checks: 223 pass, 30 skip
Summary no semver update required
Finished [ 205.055s] datafusion
Building datafusion-physical-expr v54.0.0 (current)
Built [ 28.393s] (current)
Parsing datafusion-physical-expr v54.0.0 (current)
Parsed [ 0.045s] (current)
Building datafusion-physical-expr v54.0.0 (baseline)
Built [ 28.732s] (baseline)
Parsing datafusion-physical-expr v54.0.0 (baseline)
Parsed [ 0.049s] (baseline)
Checking datafusion-physical-expr v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.384s] 223 checks: 221 pass, 2 fail, 0 warn, 30 skip
--- failure enum_variant_added: enum variant added on exhaustive enum ---
Description:
A publicly-visible enum without #[non_exhaustive] has a new variant.
ref: https://doc.rust-lang.org/cargo/reference/semver.html#enum-variant-new
impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.48.0/src/lints/enum_variant_added.ron
Failed in:
variant Distribution:KeyPartitioned in /home/runner/work/datafusion/datafusion/datafusion/physical-expr/src/partitioning.rs:609
--- failure enum_variant_marked_deprecated: enum variant #[deprecated] added ---
Description:
An enum variant is now #[deprecated]. Downstream crates will get a compiler warning when using this variant.
ref: https://doc.rust-lang.org/reference/attributes/diagnostics.html#the-deprecated-attribute
impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.48.0/src/lints/enum_variant_marked_deprecated.ron
Failed in:
variant datafusion_physical_expr::Distribution::HashPartitioned in /home/runner/work/datafusion/datafusion/datafusion/physical-expr/src/partitioning.rs:606
Summary semver requires new major version: 1 major and 1 minor checks failed
Finished [ 59.090s] datafusion-physical-expr
Building datafusion-physical-optimizer v54.0.0 (current)
Built [ 38.748s] (current)
Parsing datafusion-physical-optimizer v54.0.0 (current)
Parsed [ 0.022s] (current)
Building datafusion-physical-optimizer v54.0.0 (baseline)
Built [ 38.718s] (baseline)
Parsing datafusion-physical-optimizer v54.0.0 (baseline)
Parsed [ 0.022s] (baseline)
Checking datafusion-physical-optimizer v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.128s] 223 checks: 223 pass, 30 skip
Summary no semver update required
Finished [ 78.848s] datafusion-physical-optimizer
Building datafusion-physical-plan v54.0.0 (current)
Built [ 36.607s] (current)
Parsing datafusion-physical-plan v54.0.0 (current)
Parsed [ 0.132s] (current)
Building datafusion-physical-plan v54.0.0 (baseline)
Built [ 36.406s] (baseline)
Parsing datafusion-physical-plan v54.0.0 (baseline)
Parsed [ 0.131s] (baseline)
Checking datafusion-physical-plan v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.574s] 223 checks: 223 pass, 30 skip
Summary no semver update required
Finished [ 75.144s] datafusion-physical-plan

[gabotechs]

👍 Nice!

[alamb]

Thanks @gabotechs and @gene-bordegaray

[gene-bordegaray]

adresse comments thanks 👍

[gabotechs]

Nice, thanks @gene-bordegaray and @alamb!