Add PyCapsule support for Arrow import and export - #825

Merged

andygrove merged 19 commits into

apache:mainfrom

timsaucer:feature/arrow-pycapsule

Aug 30, 2024

Commits on Aug 28, 2024

Support Arrow PyCapsule for reading arrow tables and for exporting dataframes
timsaucer
committed
4a93356
Improve flow control on receiving record batches from arrow pycapsule
timsaucer
committed
d61621c
Update code comment
timsaucer
committed
a813dc9
Add function to project record batch into desired schema
timsaucer
committed
533c915
Validate the pycapsule and get the pointer when successful
timsaucer
committed
d94885c
Add unit test for export via pycapsule
timsaucer
committed
932c8c2
Readability
timsaucer
committed
a404a68
Remove nanoarrow so we don't add another dependency that isn't gaining much over pyarrow
timsaucer
committed
1ed4632
Remove unused import
timsaucer
committed
d1fe4df
Add unit test to check for reading from record batch streams
timsaucer
committed
61473df
Update unit test to try a variety of arrow data sources on import
timsaucer
committed
0bbb293
Simplify dataframe creation in unit test
timsaucer
committed
2586b3f
Update user documenation to include usage of import and exporting arrow objects
timsaucer
committed
43a869b
Rename from_arrow_table to from_arrow since we now support multiple types of input
timsaucer
committed
06e16fb
Add admonition box to warn user
timsaucer
committed
afe6420
Mark from_arrow_table as deprecated
timsaucer
committed
a5b4e39
Clean up error handling
timsaucer
committed
7cc807d
Marking was not required
timsaucer
and
Michael-J-Ward
committed
babeb77
Apply linting after rebase
timsaucer
committed
955d7d5