Skip to content

refactor: remove uses of arrow_schema and use reexport in arrow instead - #14597

Merged
alamb merged 4 commits into
apache:mainfrom
Chen-Yuan-Lai:use_reexport_in_arrow_instead_of_arrow_schema
Feb 11, 2025
Merged

refactor: remove uses of arrow_schema and use reexport in arrow instead#14597
alamb merged 4 commits into
apache:mainfrom
Chen-Yuan-Lai:use_reexport_in_arrow_instead_of_arrow_schema

Conversation

@Chen-Yuan-Lai

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Rationale for this change

What changes are included in this PR?

As #14528 (comment) says, arrow_schema should be removed and be replaced with reexport in arrow as much as possible.

Are these changes tested?

Are there any user-facing changes?

@github-actionsgithub-actionsBot added sql SQL Planner physical-expr Changes to the physical-expr crates optimizer Optimizer rules core Core DataFusion crate common Related to common crate proto Related to proto crate functions Changes to functions implementation labels Feb 11, 2025
@Chen-Yuan-Lai
Chen-Yuan-Laiforce-pushed the use_reexport_in_arrow_instead_of_arrow_schema branch from be33471 to c7248faCompareFebruary 11, 2025 05:24
@github-actionsgithub-actionsBot removed the proto Related to proto crate label Feb 11, 2025
@Chen-Yuan-Lai

Copy link
Copy Markdown
ContributorAuthor

Due to some uses of record_batch! macro, I kept arrow-schema dependency in physical-plan and datafusion-examples

@alambalamb left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @Chen-Yuan-Lai -- this is a great PR ❤️

@alamb
alamb merged commit 5cfc653 into apache:mainFeb 11, 2025
This was referenced Mar 10, 2025
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

commonRelated to common cratecoreCore DataFusion cratefunctionsChanges to functions implementationoptimizerOptimizer rulesphysical-exprChanges to the physical-expr cratessqlSQL Planner

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Use NullBufferBuilder instead of BooleanBufferBuilder for creating Null masks

2 participants

@Chen-Yuan-Lai@alamb