[draft] Rename Distribution::HashPartitioned to Distribution::KeyPartitioned

[gabotechs]

Warning

Just trying out what would be the actual impact of the rename, not meant to be merged

Which issue does this PR close?

• ClosesReplace / rename HashPartitioned distribution as KeyPartitioned #23236.

Rationale for this change

Distribution::HashPartitioned is an unfortunate naming that does not really reflect the real distribution requirement: inputs do not need to be partitioned by a hashing algorithm, they can be partitioned however as long as the same key always falls in the same partition.

What changes are included in this PR?

Just a plain rename Distribution::HashPartitioned -> Distribution::KeyPartitioned

Are these changes tested?

By the compiler mainly, as this is just a rename.

Are there any user-facing changes?

Yes, people consuming Distribution::HashPartitioned need to rename their code to Distribution::KeyPartitioned

Blast radius of the public API change

Findings from GitHub code search: this rename does affect real downstream consumers that construct or pattern-match Distribution::HashPartitioned. Notable examples:

• InfluxDB uses it in custom physical plans: GapFillExec::required_input_distribution and SeriesLimitExec::required_input_distribution.
• Ballista constructs left/right hash distribution requirements in dynamic join selection: dynamic_join.rs.
• GreptimeDB both pattern-matches and constructs the variant in optimizer and distributed-scan code: pass_distribution.rs, merge_scan.rs, and normalize.rs.
• delta-rs uses it in merge execution helpers: barrier.rs and validation.rs.
• Sail uses it in merge/Delta physical plans: merge_cardinality_check.rs, writer_exec.rs, and dv_writer_exec.rs.

There are additional smaller downstream hits, for example Optiprism, datafusion-bio-functions, and jammi-ai.

[github-actions]

Thank you for opening this pull request!

Reviewer note: cargo-semver-checks reported the current version number is not SemVer-compatible with the changes in this pull request (compared against the base branch).

Details

 Cloning apache/main
Building datafusion v54.0.0 (current)
Built [ 104.708s] (current)
Parsing datafusion v54.0.0 (current)
Parsed [ 0.037s] (current)
Building datafusion v54.0.0 (baseline)
Built [ 102.148s] (baseline)
Parsing datafusion v54.0.0 (baseline)
Parsed [ 0.037s] (baseline)
Checking datafusion v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.870s] 223 checks: 223 pass, 30 skip
Summary no semver update required
Finished [ 209.274s] datafusion
Building datafusion-physical-expr v54.0.0 (current)
Built [ 27.265s] (current)
Parsing datafusion-physical-expr v54.0.0 (current)
Parsed [ 0.051s] (current)
Building datafusion-physical-expr v54.0.0 (baseline)
Built [ 27.249s] (baseline)
Parsing datafusion-physical-expr v54.0.0 (baseline)
Parsed [ 0.053s] (baseline)
Checking datafusion-physical-expr v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.527s] 223 checks: 221 pass, 2 fail, 0 warn, 30 skip
--- failure enum_variant_added: enum variant added on exhaustive enum ---
Description:
A publicly-visible enum without #[non_exhaustive] has a new variant.
ref: https://doc.rust-lang.org/cargo/reference/semver.html#enum-variant-new
impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.48.0/src/lints/enum_variant_added.ron
Failed in:
variant Distribution:KeyPartitioned in /home/runner/work/datafusion/datafusion/datafusion/physical-expr/src/partitioning.rs:598
--- failure enum_variant_missing: pub enum variant removed or renamed ---
Description:
A publicly-visible enum has at least one variant that is no longer available under its prior name. It may have been renamed or removed entirely.
ref: https://doc.rust-lang.org/cargo/reference/semver.html#item-remove
impl: https://github.com/obi1kenobi/cargo-semver-checks/tree/v0.48.0/src/lints/enum_variant_missing.ron
Failed in:
variant Distribution::HashPartitioned, previously in file /home/runner/work/datafusion/datafusion/target/semver-checks/git-apache_main/155ab25c6512b68ad06c9ddde2dd95303f1e254d/datafusion/physical-expr/src/partitioning.rs:598
Summary semver requires new major version: 2 major and 0 minor checks failed
Finished [ 55.971s] datafusion-physical-expr
Building datafusion-physical-optimizer v54.0.0 (current)
Built [ 36.391s] (current)
Parsing datafusion-physical-optimizer v54.0.0 (current)
Parsed [ 0.022s] (current)
Building datafusion-physical-optimizer v54.0.0 (baseline)
Built [ 36.510s] (baseline)
Parsing datafusion-physical-optimizer v54.0.0 (baseline)
Parsed [ 0.024s] (baseline)
Checking datafusion-physical-optimizer v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.167s] 223 checks: 223 pass, 30 skip
Summary no semver update required
Finished [ 74.267s] datafusion-physical-optimizer
Building datafusion-physical-plan v54.0.0 (current)
Built [ 34.639s] (current)
Parsing datafusion-physical-plan v54.0.0 (current)
Parsed [ 0.137s] (current)
Building datafusion-physical-plan v54.0.0 (baseline)
Built [ 34.658s] (baseline)
Parsing datafusion-physical-plan v54.0.0 (baseline)
Parsed [ 0.140s] (baseline)
Checking datafusion-physical-plan v54.0.0 -> v54.0.0 (no change; assume patch)
Checked [ 0.906s] 223 checks: 223 pass, 30 skip
Summary no semver update required
Finished [ 71.598s] datafusion-physical-plan

[gabotechs]

Closing in favor of #23259