Skip to content

hash float arrays using primitive usigned integer type - #556

Merged
Dandandan merged 1 commit into
apache:masterfrom
houqp:qp_hash
Jun 14, 2021
Merged

hash float arrays using primitive usigned integer type#556
Dandandan merged 1 commit into
apache:masterfrom
houqp:qp_hash

Conversation

@houqp

Copy link
Copy Markdown
Member

Which issue does this PR close?

Closes#512.

Rationale for this change

Generate hash using u8 slices will be less efficient and breaks
sepcialization in ahash.

See tkaitchuck/aHash#93 for more details.

What changes are included in this PR?

Convert u8 slices back to u32 or u64 when calculating hashes for f32 and f64.

Are there any user-facing changes?

no

Generate hash using u8 slices will be less efficient and breaks
sepcialization in ahash.
See tkaitchuck/aHash#93 for more details.

@DandandanDandandan left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@codecov-commenter

Copy link
Copy Markdown

Codecov Report

Merging #556 (0104e51) into master (d382854) will increase coverage by 0.01%.
The diff coverage is 100.00%.

Impacted file tree graph

@@ Coverage Diff @@## master #556 +/- ##
==========================================
+ Coverage 76.09% 76.10% +0.01% 
==========================================
Files 156 156 Lines 27047 27057 +10 ==========================================
+ Hits 20581 20593 +12 + Misses 6466 6464 -2 
Impacted FilesCoverage Δ
datafusion/src/physical_plan/hash_join.rs85.40% <100.00%> (+0.50%)⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d382854...0104e51. Read the comment docs.

@Dandandan
Dandandan merged commit e46920a into apache:masterJun 14, 2021
@Dandandan

Copy link
Copy Markdown
Contributor

Thanks @houqp

@houqphouqp added bug Something isn't working datafusion labels Jul 30, 2021
unkloud pushed a commit to unkloud/datafusion that referenced this pull request Mar 23, 2025
* Source release process proposal
* small refinement
* add more detail
* fix
* more detail
* title
* prettier
* ASF header
* address feedback
HairstonE pushed a commit to HairstonE/datafusion that referenced this pull request Oct 7, 2025
Bumps [async-trait](https://github.com/dtolnay/async-trait) from 0.1.74 to 0.1.77.
- [Release notes](https://github.com/dtolnay/async-trait/releases)
- [Commits](https://github.com/dtolnay/async-trait/commits)
---
updated-dependencies:
- dependency-name: async-trait
dependency-type: direct:production
update-type: version-update:semver-patch
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugSomething isn't working

Projects

None yet

Development

Successfully merging this pull request may close these issues.

hash_join.rs's create_hashes function panics with float columns with nightly rustc

3 participants

@houqp@codecov-commenter@Dandandan