Skip to content

Add test for reading back file created with COPY ... OPTIONS (FORMAT..) options - #9753

Merged
alamb merged 3 commits into
apache:mainfrom
alamb:alamb/copy_follow_on
Apr 1, 2024
Merged

Add test for reading back file created with COPY ... OPTIONS (FORMAT..) options#9753
alamb merged 3 commits into
apache:mainfrom
alamb:alamb/copy_follow_on

Conversation

@alamb

Copy link
Copy Markdown
Contributor

Which issue does this PR close?

Follow on to #9744

Rationale for this change

The tests in #9744 show the syntax works, but doesn't verify that the format is actually used (rather than say, being ignored)

What changes are included in this PR?

Add a test to write to a file with a non standard extension and then read it back

Are these changes tested?

Are there any user-facing changes?

no, tests only

@github-actionsgithub-actionsBot added the sqllogictest SQL Logic Tests (.slt) label Mar 23, 2024
@alambalamb changed the title Add test for reading back file created with FORMAT optionsAdd test for reading back file created with COPY ... OPTIONS (FORMAT..) optionsMar 23, 2024
@alamb

Copy link
Copy Markdown
ContributorAuthor

@metesynnada here is another small PR with tests that I wonder if you have time to review?

@metesynnadametesynnada left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we phase out this usage at some point, or continue to support both options going forward?

@alamb

alamb commented Apr 1, 2024

Copy link
Copy Markdown
ContributorAuthor

Should we phase out this usage at some point, or continue to support both options going forward?

That is a good question. I filed #9905 to discuss. I don't have a strong opinion

@alamb
alamb merged commit b50f3aa into apache:mainApr 1, 2024
tinfoil-knight added a commit to tinfoil-knight/arrow-datafusion that referenced this pull request Apr 7, 2024
alamb pushed a commit that referenced this pull request Apr 8, 2024
* Revert "Add test for reading back file created with FORMAT options (#9753)"
This reverts commit b50f3aa.
* Revert "support format in options of COPY command (#9744)"
This reverts commit 40fb1b8.
* update docs and example to remove old syntax
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

sqllogictestSQL Logic Tests (.slt)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@alamb@metesynnada