Skip to content

[SPARK-19112][CORE][FOLLOW-UP] Add missing shortCompressionCodecNames to configuration. - #21431

Closed
wangyum wants to merge 1 commit into
apache:masterfrom
wangyum:SPARK-19112
Closed

[SPARK-19112][CORE][FOLLOW-UP] Add missing shortCompressionCodecNames to configuration.#21431
wangyum wants to merge 1 commit into
apache:masterfrom
wangyum:SPARK-19112

Conversation

@wangyum

@wangyumwangyum commented May 25, 2018

Copy link
Copy Markdown
Member

What changes were proposed in this pull request?

Spark provides four codecs: lz4, lzf, snappy, and zstd. This pr add missing shortCompressionCodecNames to configuration.

How was this patch tested?

manually tested

@SparkQA

Copy link
Copy Markdown

Test build #91157 has finished for PR 21431 at commit 877d270.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@wangyum

Copy link
Copy Markdown
MemberAuthor

Yes. I have tested with —conf spark.io.compression.codec=zstd.

asfgit pushed a commit that referenced this pull request May 26, 2018
… to configuration.
## What changes were proposed in this pull request?
Spark provides four codecs: `lz4`, `lzf`, `snappy`, and `zstd`. This pr add missing shortCompressionCodecNames to configuration.
## How was this patch tested?
manually tested
Author: Yuming Wang <yumwang@ebay.com>
Closes#21431 from wangyum/SPARK-19112.
(cherry picked from commit ed1a654)
Signed-off-by: hyukjinkwon <gurwls223@apache.org>
@HyukjinKwon

Copy link
Copy Markdown
Member

Merged to master and branch-2.3.

@wangyum
wangyum deleted the SPARK-19112 branch May 26, 2018 12:51
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@wangyum@SparkQA@HyukjinKwon