Skip to content

ARROW-16715: [R] Bump default parquet version - #13555

Merged
nealrichardson merged 4 commits into
apache:masterfrom
nealrichardson:r-upgrade-parquet
Jul 11, 2022
Merged

ARROW-16715: [R] Bump default parquet version#13555
nealrichardson merged 4 commits into
apache:masterfrom
nealrichardson:r-upgrade-parquet

Conversation

@nealrichardson

Copy link
Copy Markdown
Member

Also removes deprecated args to write_parquet()

@github-actions

Copy link
Copy Markdown

@github-actions

Copy link
Copy Markdown

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@nealrichardson

Copy link
Copy Markdown
MemberAuthor

@github-actions crossbow submit test-r-arrow-backwards-compatibility

@github-actions

Copy link
Copy Markdown

Revision: f375949

Submitted crossbow builds: ursacomputing/crossbow @ actions-49cb752519

TaskStatus
test-r-arrow-backwards-compatibilityGithub Actions

@paleolimbotpaleolimbot left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

A few lintr errors (I think I found them all + suggested the fix) but this looks good to me (The first CI failure appears to be the Array-subset-on-boolean error).

Comment threadr/tests/testthat/test-parquet.R Outdated
Comment threadr/tests/testthat/test-parquet.R Outdated
Comment threadr/tests/testthat/test-parquet.R Outdated
Co-authored-by: Dewey Dunnington <dewey@fishandwhistle.net>
@nealrichardson

Copy link
Copy Markdown
MemberAuthor

@jonkeane do you want to take a look at this? I seem to recall you set up the backwards compat testing.

@jonkeanejonkeane left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me. I'm a little bit surprised that the backwards compatibility all the way back still is fine, but we must not test any types that have differed since the 2.0 version.

expect_equal(make_valid_version(2.0), ParquetVersionType$PARQUET_2_0)
test_that("make_valid_parquet_version() input validation", {
expect_error(
make_valid_parquet_version("0.3.14"),

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🥧

@nealrichardson

Copy link
Copy Markdown
MemberAuthor

This looks good to me. I'm a little bit surprised that the backwards compatibility all the way back still is fine, but we must not test any types that have differed since the 2.0 version.

It may also be that the library can read whatever version file it receives (at least as far back as we test)

@nealrichardson
nealrichardson merged commit f0ff8d0 into apache:masterJul 11, 2022
@nealrichardson
nealrichardson deleted the r-upgrade-parquet branch July 11, 2022 15:26
kou pushed a commit that referenced this pull request Feb 20, 2023
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@nealrichardson@jonkeane@paleolimbot