GH-17211: [C++] Add `hash32` and `hash64` scalar compute functions - #45001

Open

kszucs wants to merge 82 commits into

apache:mainfrom

kszucs:scalar-hash

Commits on Sep 3, 2026

GH-17211: refresh history for scalar_hash kernel
drin
authored and
kszucs
committed
80d840e
GH-17211: refresh history for updates to key_hash
drin
authored and
kszucs
committed
9260849
GH-17211: refresh history for new compute fn infra
drin
authored and
kszucs
committed
e7252d0
GH-17211: refresh history of scalar hash benchmark
drin
authored and
kszucs
committed
5c3db19
added KeyColumnArray alias
drin
authored and
kszucs
committed
49718f5
task: revert style and other minor changes
drin
authored and
kszucs
committed
37b19dd
task: reducing support to some nested types
drin
authored and
kszucs
committed
8f444b0
minor: added type check for ListArray
drin
authored and
kszucs
committed
5cba979
Update the implementation to use column oriented hash-combine.
kszucs
committed
312a3a5
add hypothesis test case and fix list hashing
kszucs
committed
949ffed
ensure to keep newly allocated arrays alive until hash gets computed
kszucs
committed
d5a1ba8
minor cleanup
kszucs
committed
79765d9
wrong include
kszucs
committed
d710fca
add hash32 function
kszucs
committed
3b56994
add hash32 function and address review comments
kszucs
committed
618ec4a
update testing suite
kszucs
committed
50e33ac
generated struct tests
kszucs
committed
1f907c2
prepare adding hash32 tests
kszucs
committed
bf0b7a0
add tests for hash32, dictionary encoded type, extension type
kszucs
committed
866e4b0
ensure that NULL and 0 hashes to different numbers
kszucs
committed
d9f0088
fix the benchmarks
kszucs
committed
691ccd3
update docs to highlight 0 return for NULL values
kszucs
committed
2eb2ba4
use resize instead of reserve
kszucs
committed
2d5f93f
fix R compute function filtering test
kszucs
committed
5f9614a
address review comments
kszucs
committed
9271efa
update boolean test case
kszucs
committed
fe2e206
update exec checks
kszucs
committed
661d82f
use Hasher::kHashBatchTempStackUsage
kszucs
committed
40a710b
ensure that slices properly work
kszucs
committed
3bb84a5
add tests for fixed_size_binary()
kszucs
committed
aeacc80
add rudimentary quality tests
kszucs
committed
0e14971
test temporal types too
kszucs
committed
c145283
test temporal and decimal types
kszucs
committed
28a9dca
add type matcher to explicitly raise NotImplemented for unsupported types
kszucs
committed
cae89ef
update error message
kszucs
committed
1293b40
update docs
kszucs
committed
24a7dc6
set a tolerance for the randomly generated numbers
kszucs
committed
303d2ac
make msvc happy
kszucs
committed
ab78188
Rename DCHECK macros to ARROW_DCHECK
kszucs
committed
b0d0b0a
Missing blank lines
kszucs
committed
46dc7b8
chore: move key_hash benchmarks to key_hash_benchmark.cc under compute
kszucs
committed
f07c665
Apply suggestions from code review
kszucs
and
kou
committed
b457ec1
use type singleton
kszucs
committed
6528c69
run clang format on scalar_hash_benchmark.cc
kszucs
committed
59a06ec
run cmake format
kszucs
committed
53a62f9
Address review comments and fix missing-declarations build failure
kszucs
committed
4ba82af
Fix unreachable slicing check and remove unused hashing_rng in benchmarks
kszucs
committed
39eecbe
Fix nested-type null and hash-corruption bugs in hash32/hash64
kszucs
committed
6489383
Remove dead list-like branches from ToColumnArray
kszucs
committed
40711e8
Fix independently-null nested fields hashing as non-zero garbage
kszucs
committed
25f0a0b
Size key_hash_benchmark's TempVectorStack from kHashBatchTempStackUsage
kszucs
committed
12fdde4
Hoist KeyColumnArray construction out of key_hash_benchmark's timed loop
kszucs
committed
d3ff917
Fix GCC -Werror=range-loop-construct in scalar_hash_test.cc
kszucs
committed
c4e6a15
Guard against a null values buffer in ToColumnArray's binary path
kszucs
committed
121d38d
Add R test asserting hash32/hash64 are discoverable via list_compute_functions
kszucs
committed
80cb5ac
Avoid hashing unreferenced child data for sliced list/map arrays, fix struct offset and empty-struct bugs in hash32/hash64
kszucs
committed
39497f0
Add hypothesis tests asserting hash32/hash64 respect Array.slice()
kszucs
committed
c2b4915
Revert kAddend change to the shared HashIntImp; scope the null/0 fix to hash32/hash64 instead
kszucs
committed
f1d03bb
Unwrap extension types in HashableMatcher so unsupported storage types reject cleanly
kszucs
committed
b7a9791
Add test coverage for zero/null collision across byte widths and FIXED_SIZE_LIST slicing
kszucs
committed
ac63803
Fix HashChild reusing a nested field's unshifted validity buffer
kszucs
committed
3c95c9d
Avoid the bitmap copy in HashChild by omitting the validity buffer entirely
kszucs
committed
f9a65da
Fix double blank lines around the new Hash Functions doc section
kszucs
committed
8d39471
Avoid hashing unreferenced struct nested-field data, avoid gtest macros in hot benchmark loops
kszucs
committed
85968a8
Hoist the per-column vector out of KeyHashIntegers benchmark loops
kszucs
committed
c1f30bb
Fix Hash32/Hash64 API docstrings
kszucs
committed
eb9744d
Fix values-child offset cancellation bug in list/map hashing
kszucs
committed
8a736f3
Fix valid struct rows coincidentally colliding with the null hash sentinel
kszucs
committed
0f19f16
Loosen RandomPrimitive's hash-quality tolerance for cross-platform RNG variance
kszucs
committed
5beac3f
Fix independently-null fields of multi-field structs not hashing to 0
kszucs
committed
c14e1ef
Dedupe Hash64Struct{Small,Medium,Large}Strings benchmarks
kszucs
committed
1b550bd
Make hash32/hash64 null-aware instead of reserving 0 for nulls
kszucs
committed
7a0e1b7
Fix zero-width fixed_size_binary hashing, and simplify
kszucs
committed
f309ce6
Fix NullType struct fields not invalidating their row's hash
kszucs
committed
e35894e
Add DoNotOptimize/ClobberMemory to key hash benchmarks
kszucs
committed
59ca351
Bulk-copy hash output validity, and fix doc nits
kszucs
committed
5eedc72
Reject unsupported nested child types during hash dispatch
kszucs
committed
1c09c5d
Drop unused builder_primitive.h include from hashing_benchmark
kszucs
committed
abd254e
Route zero-width fixed_size_binary struct fields through HashArray
kszucs
committed
bd7b7ee
Add the new scalar-hash sources to the Meson build
kszucs
committed
33cdf3d
Distinguish a null child element from one hashing to zero
kszucs
committed
08ec6f2
Hash map keys even when the item is null
kszucs
committed
6c018be