Skip to content

branch-4.0: [optimize](parquet-reader) Optimize performance by parquet bloom filter. - #59727

Merged
morningman merged 1 commit into
apache:branch-4.0from
kaka11chen:cherry-pick-57959-4.0
Jan 12, 2026
Merged

branch-4.0: [optimize](parquet-reader) Optimize performance by parquet bloom filter.#59727
morningman merged 1 commit into
apache:branch-4.0from
kaka11chen:cherry-pick-57959-4.0

Conversation

@kaka11chen

@kaka11chenkaka11chen commented Jan 9, 2026•
edited by morningman
Loading

Copy link
Copy Markdown
Contributor

Cherry-pick #57959

@hello-stephen

hello-stephen commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@kaka11chen

kaka11chen commented Jan 9, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@kaka11chenkaka11chen changed the title [optimize](parquet-reader) Optimize performace by parquet bloom filter.[optimize](parquet-reader) Optimize performance by parquet bloom filter.Jan 9, 2026
@hello-stephen

hello-stephen commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

FE UT Coverage Report

Increment line coverage 66.67% (2/3) 🎉
Increment coverage report
Complete coverage report

@doris-robot

doris-robot commented Jan 9, 2026

Copy link
Copy Markdown

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage79.53% (1756/2208)
Line Coverage65.50% (30815/47047)
Region Coverage65.92% (15307/23221)
Branch Coverage56.57% (8132/14374)

@hello-stephen

hello-stephen commented Jan 9, 2026

Copy link
Copy Markdown
Contributor

BE UT Coverage Report

Increment line coverage 49.35% (189/383) 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage53.29% (18698/35087)
Line Coverage39.04% (172896/442897)
Region Coverage33.75% (133685/396162)
Branch Coverage34.71% (57821/166560)

@morningmanmorningman changed the title [optimize](parquet-reader) Optimize performance by parquet bloom filter.branch-4.0: [optimize](parquet-reader) Optimize performance by parquet bloom filter.Jan 10, 2026
@kaka11chen
[optimize](parquet-reader) Optimize performace by parquet bloom filte…
cd00116
…r. (apache#57959)
### What problem does this PR solve?
Problem Summary:
### Release note
Optimize performance by reading parquet bloom filter. parquet bloom filter:
https://parquet.apache.org/docs/file-format/bloomfilter/
### Query Performance Test Results
SQL Query | Optimized Version (time(s)) | Original Version (time(s))
-- | -- | --
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
= 'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d4'; | 0.02 | 0.23
SELECT * FROM cqtest.bloom_filter_perf_parquet_duckdb WHERE uuid_string
IN ('cfcd2084-cfcd-cfcd-cfcd-cfcd208495d6',
'cfcd2084-cfcd-cfcd-cfcd-cfcd208495d7'); | 0.04 | 0.24
@kaka11chen

kaka11chen commented Jan 12, 2026

Copy link
Copy Markdown
ContributorAuthor

run buildall

@doris-robot

doris-robot commented Jan 12, 2026

Copy link
Copy Markdown

Cloud UT Coverage Report

Increment line coverage 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage79.53% (1756/2208)
Line Coverage65.52% (30824/47047)
Region Coverage65.93% (15310/23221)
Branch Coverage56.62% (8139/14374)

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Jan 12, 2026
@github-actions

github-actionsBot commented Jan 12, 2026

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actionsBot commented Jan 12, 2026

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@doris-robot

doris-robot commented Jan 12, 2026

Copy link
Copy Markdown

BE UT Coverage Report

Increment line coverage 49.35% (189/383) 🎉

Increment coverage report
Complete coverage report

CategoryCoverage
Function Coverage53.34% (18717/35092)
Line Coverage39.10% (173161/442922)
Region Coverage33.80% (133914/396179)
Branch Coverage34.77% (57912/166566)

@morningman
morningman merged commit 00503bc into apache:branch-4.0Jan 12, 2026
24 of 27 checks passed
ybtsdst pushed a commit to ybtsdst/doris that referenced this pull request Feb 27, 2026
@kaka11chenbingtao.yin
branch-4.0: [optimize](parquet-reader) Optimize performance by parque…
76f6b92
…t bloom filter. (apache#59727)
Cherry-pick apache#57959
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@yiguoleiyiguoleiyiguolei approved these changes

Assignees

No one assigned

Labels

approvedIndicates a PR has been approved by one committer.reviewed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@kaka11chen@hello-stephen@doris-robot@yiguolei@morningman