Skip to content

[SPARK-37496][SQL][FOLLOWUP] DataFrameWriter.saveAsTable should take write options in CTAS and RTAS - #34997

Closed
huaxingao wants to merge 1 commit into
apache:masterfrom
huaxingao:write_option
Closed

[SPARK-37496][SQL][FOLLOWUP] DataFrameWriter.saveAsTable should take write options in CTAS and RTAS#34997
huaxingao wants to merge 1 commit into
apache:masterfrom
huaxingao:write_option

Conversation

@huaxingao

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

DataFrameWriter.saveAsTable should pass extraOptions.toMap as the write options in CTAS and RTAS

Why are the changes needed?

bug fixing
please see #34754 (comment)#34667 (comment)

Does this PR introduce any user-facing change?

no

How was this patch tested?

new test

@SparkQA

Copy link
Copy Markdown

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50987/

@SparkQA

Copy link
Copy Markdown

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50987/

@SparkQA

Copy link
Copy Markdown

Test build #146511 has finished for PR 34997 at commit ab9ffd1.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@huaxingao

Copy link
Copy Markdown
ContributorAuthor

cc @cloud-fan

@cloud-fan

Copy link
Copy Markdown
Contributor

The GA failure is unrelated, merging to master, thanks!

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@huaxingao@SparkQA@cloud-fan