Skip to content

Backport update to arrow 53.1.0 on branch-42 - #12977

Merged
alamb merged 4 commits into
apache:branch-42from
alamb:alamb/port_53.1.0
Oct 16, 2024
Merged

Backport update to arrow 53.1.0 on branch-42#12977
alamb merged 4 commits into
apache:branch-42from
alamb:alamb/port_53.1.0

Conversation

@alamb

@alambalamb commented Oct 16, 2024

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Part of #12813

Rationale for this change

Clippy is failing on branch-42 after the arrow 53.1.0 upgrade. This was fixed in #12724 on main, but that also includes several other fixes

What changes are included in this PR?

  1. Update to arrow 53.1.0
  2. port just enough of Upgrade arrow/parquet to 53.1.0 / fix clippy #12724 to get CI passing
  3. port Fix clippy error on wasmtest #12844 from @jonahgao to fix another clippy error

Are these changes tested?

Are there any user-facing changes?

@alambalamb changed the title Update to arrow 53.1.0 on branch-42Backport update to arrow 53.1.0 on branch-42Oct 16, 2024
@github-actionsgithub-actionsBot added physical-expr Changes to the physical-expr crates core Core DataFusion crate functions Changes to functions implementation labels Oct 16, 2024
"c8: Int64",
"c9: Int64",
"c10: Int64",
"c10: Utf8",

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

use parquet::arrow::{
arrow_to_parquet_schema, parquet_to_arrow_schema, AsyncArrowWriter,
};
#[allow(deprecated)]

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

main has been updated to use the new APIs, but for the maintenance release let's just use the existing code

wasm_bindgen_test::wasm_bindgen_test_configure!(run_in_browser);

#[wasm_bindgen_test]
#[cfg_attr(target_arch = "wasm32", wasm_bindgen_test)]

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

these changes are from #12844, see rationale here

@github-actionsgithub-actionsBot added the sqllogictest SQL Logic Tests (.slt) label Oct 16, 2024
@alamb

Copy link
Copy Markdown
ContributorAuthor

Merging this in to get clean CI runs for other backports and all the code has previously been approved / merged

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

coreCore DataFusion cratefunctionsChanges to functions implementationphysical-exprChanges to the physical-expr cratessqllogictestSQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@alamb@jonahgao