Draft: upgrading to datafusion 37.1.0 - #662

Closed

Michael-J-Ward wants to merge 21 commits into

apache:mainfrom

Michael-J-Ward:upgrade-datafusion

Commits on May 1, 2024

deps: upgrade datafusion to 37.1.0
Michael-J-Ward
committed
79f01e7
remove deprecated function SessionContext::tables
Michael-J-Ward
committed
ccb2f99
feat: upgrade dataframe write_parquet and write_json
Michael-J-Ward
committed
f9895a9
update Catalog::table
Michael-J-Ward
committed
6fc2ad1
TODO: implement new trait methods for ExcutionPlan and ExecutionPlanProperties
Michael-J-Ward
committed
8cd4fd4
add null_treatment option to WindowFunction and AggregateFunction
Michael-J-Ward
committed
04cd5f9
wip: migrate functions.rs, compiles but not all tests pass
Michael-J-Ward
committed
83249fe

Commits on May 2, 2024

Commits on May 7, 2024

feat: implement SessionContext::tables workaround
Michael-J-Ward
committed
5e58323
feat: impl ExecutionPlan and ExecutionPlanProperties for DatasetExec
Michael-J-Ward
committed
037aa90
fix pyo3 signature for expr_fn_vec macro
Michael-J-Ward
committed
a524608
fix signature of array_position and aliases
Michael-J-Ward
committed
b7b833c
fix inner expr_fn call for array_posititions and list_positions
Michael-J-Ward
committed
77f8228
fix array_slice signature
Michael-J-Ward
committed
a6923c9
fix signatures for array_append, array_prepend, and aliases
Michael-J-Ward
committed
79f4459
commented out last failing test
Michael-J-Ward
committed
ecff357
remove .unwrap() from re-implemented PySessionContext::tables
Michael-J-Ward
committed
ecf6d48
lint: allow(deprecated) for make_scalar_function
Michael-J-Ward
committed
d691014
lint: fix clippy lint for utils::wait_for_future
Michael-J-Ward
committed
cd8f0e0