Skip to content

PARQUET-1630: add empty compression union for Bloom filter - #149

Merged
rdblue merged 1 commit into
apache:masterfrom
jbapple:bloom-compress
Aug 13, 2019
Merged

PARQUET-1630: add empty compression union for Bloom filter#149
rdblue merged 1 commit into
apache:masterfrom
jbapple:bloom-compress

Conversation

@jbapple

@jbapple jbapple commented Aug 10, 2019

Copy link
Copy Markdown
Contributor

Right now no compression methods are supported. For more on Bloom
filter compression, see Michael Mitzenmacher's "Compressed Bloom
Filters",
https://www.eecs.harvard.edu/~michaelm/NEWWORK/postscripts/cbf2.pdf

@jbapple

jbapple commented Aug 10, 2019

Copy link
Copy Markdown
Contributor Author

@rdblue review requested

Comment thread src/main/thrift/parquet.thrift Outdated
/**
* The compression used in the Bloom filter.
**/
union BloomFilterCompression {}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think there should be a BloomFilterCompression for Uncompressed so that implementations can check for it and ignore bloom filters if the compression doesn't match.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed; done.

Right now no compression methods are supported. For more on Bloom
filter compression, see Michael Mitzenmacher's "Compressed Bloom
Filters",
https://www.eecs.harvard.edu/~michaelm/NEWWORK/postscripts/cbf2.pdf
@rdblue
rdblue merged commit 556ebee into apache:master Aug 13, 2019
@rdblue

rdblue commented Aug 13, 2019

Copy link
Copy Markdown
Contributor

Thanks @jbapple! I'll merge this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants