Skip to content

[Bug](runtime-filter) avoid wrong partitial ignore minmax filter - #43078

Merged
BiteTheDDDDt merged 1 commit into
apache:masterfrom
BiteTheDDDDt:fix_1101
Nov 4, 2024
Merged

[Bug](runtime-filter) avoid wrong partitial ignore minmax filter#43078
BiteTheDDDDt merged 1 commit into
apache:masterfrom
BiteTheDDDDt:fix_1101

Conversation

@BiteTheDDDDt

@BiteTheDDDDtBiteTheDDDDt commented Nov 1, 2024

Copy link
Copy Markdown
Contributor

In ##41667 we support ignore filter partitial, however, when sync_filter_size is turned off, the final filter may only contain part of the data because some filters are judged to be 'in'.
For example:
there are rf001(2 instances, in_or_bloom),rf000(2 instances, min_max),
instance_1 has 1e8 row and rf001 change to bloom, the rf000 will not ignored
instance_2 has 1 row and rf001 change to in, the rf000 will ignored
finally, rf000 applied and make wrong result

@BiteTheDDDDt

Copy link
Copy Markdown
ContributorAuthor

run buildall

@github-actions

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actionsgithub-actionsBot added approved Indicates a PR has been approved by one committer. reviewed labels Nov 4, 2024
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@BiteTheDDDDt
BiteTheDDDDt merged commit 65a8166 into apache:masterNov 4, 2024
github-actionsBot pushed a commit that referenced this pull request Nov 4, 2024
)
In ##41667 we support ignore filter
partitial, however, when sync_filter_size is turned off, the final
filter may only contain part of the data because some filters are judged
to be 'in'.
For example:
there are rf001(2 instances, in_or_bloom),rf000(2 instances, min_max),
instance_1 has 1e8 row and rf001 change to bloom, the rf000 will not
ignored
instance_2 has 1 row and rf001 change to in, the rf000 will ignored
finally, rf000 applied and make wrong result
dataroaring pushed a commit that referenced this pull request Nov 6, 2024
… filter (#43195)
Cherry-picked from #43078
Co-authored-by: Pxl <pxl290@qq.com>
BiteTheDDDDt added a commit that referenced this pull request Nov 27, 2024
)
In ##41667 we support ignore filter
partitial, however, when sync_filter_size is turned off, the final
filter may only contain part of the data because some filters are judged
to be 'in'.
For example:
there are rf001(2 instances, in_or_bloom),rf000(2 instances, min_max),
instance_1 has 1e8 row and rf001 change to bloom, the rf000 will not
ignored
instance_2 has 1 row and rf001 change to in, the rf000 will ignored
finally, rf000 applied and make wrong result
@wm1581066wm1581066 added the usercase Important user case type label label Jan 4, 2025
HappenLee pushed a commit to HappenLee/incubator-doris that referenced this pull request Apr 24, 2026
…che#43078)
In #apache#41667 we support ignore filter
partitial, however, when sync_filter_size is turned off, the final
filter may only contain part of the data because some filters are judged
to be 'in'.
For example:
there are rf001(2 instances, in_or_bloom),rf000(2 instances, min_max),
instance_1 has 1e8 row and rf001 change to bloom, the rf000 will not
ignored
instance_2 has 1 row and rf001 change to in, the rf000 will ignored
finally, rf000 applied and make wrong result
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approvedIndicates a PR has been approved by one committer.dev/2.1.8-mergeddev/3.0.3-mergedreviewedusercaseImportant user case type label

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@BiteTheDDDDt@Gabriel39@zhangstar333@wm1581066@dataroaring