Skip to content

refactor: remove remaining uses of arrow_array and use reexport in arrow instead - #14528

Merged
alamb merged 8 commits into
apache:mainfrom
Chen-Yuan-Lai:use_reexport_in_arrow_instead_of_arrow_array
Feb 8, 2025
Merged

refactor: remove remaining uses of arrow_array and use reexport in arrow instead#14528
alamb merged 8 commits into
apache:mainfrom
Chen-Yuan-Lai:use_reexport_in_arrow_instead_of_arrow_array

Conversation

@Chen-Yuan-Lai

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

As #14503 (review) says, arrow_array should be removed and be replaced with reexport in arrow as much as possible.

What changes are included in this PR?

Are these changes tested?

Are there any user-facing changes?

@github-actionsgithub-actionsBot added sql SQL Planner physical-expr Changes to the physical-expr crates core Core DataFusion crate common Related to common crate functions Changes to functions implementation labels Feb 6, 2025
@Chen-Yuan-Lai
Chen-Yuan-Laiforce-pushed the use_reexport_in_arrow_instead_of_arrow_array branch from 78f7847 to 4bd8dacCompareFebruary 7, 2025 01:49
@Chen-Yuan-Lai
Chen-Yuan-Laiforce-pushed the use_reexport_in_arrow_instead_of_arrow_array branch from 4bd8dac to 327bc78CompareFebruary 7, 2025 01:57

@alambalamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A very nice simplification @Chen-Yuan-Lai -- thank you 🙏

Screenshot 2025-02-07 at 1 54 46 PM

arrow = { workspace = true }
arrow-array = { workspace = true }
arrow-ipc = { workspace = true }
arrow-schema = { workspace = true }

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm, looks like there is one PR left -- arrow-schema 🤔

Any chance you want another fun cleanup PR @Chen-Yuan-Lai :)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@alamb Sure 💪

@alamb
alamb merged commit faa8c1b into apache:mainFeb 8, 2025
@alamb

alamb commented Feb 8, 2025

Copy link
Copy Markdown
Contributor

Thanks again @Chen-Yuan-Lai

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

commonRelated to common cratecoreCore DataFusion cratefunctionsChanges to functions implementationphysical-exprChanges to the physical-expr cratessqlSQL Planner

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use NullBufferBuilder instead of BooleanBufferBuilder for creating Null masks

2 participants

@Chen-Yuan-Lai@alamb