Skip to content

[Fix](orc-reader) Fix some bugs of orc lazy materialization. - #20410

Merged
morningman merged 1 commit into
apache:masterfrom
kaka11chen:fix_orc_lazy_materialization_bugs
Jun 9, 2023
Merged

[Fix](orc-reader) Fix some bugs of orc lazy materialization.#20410
morningman merged 1 commit into
apache:masterfrom
kaka11chen:fix_orc_lazy_materialization_bugs

Conversation

@kaka11chen

@kaka11chenkaka11chen commented Jun 4, 2023

Copy link
Copy Markdown
Contributor

Proposed changes

Fix some bugs of orc lazy materialization(#18615)

  • Fix issue causing column size to continuously increase after execute_conjuncts() by calling Block::erase_useless_column().
  • Fix partition issues of orc lazy materialization.
  • Fix lazy materialization will not be used when the predicate column is inconsistent with the orc file.

Further comments

Regression Test:
iceberg_partition_upper_case.groovy

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@kaka11chen

Copy link
Copy Markdown
ContributorAuthor

run buildall

@github-actions

Copy link
Copy Markdown
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@morningmanmorningman self-assigned this Jun 4, 2023

@morningmanmorningman left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actionsgithub-actionsBot added the approved Indicates a PR has been approved by one committer. label Jun 7, 2023
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@morningman
morningman merged commit 845d459 into apache:masterJun 9, 2023
xiaokang pushed a commit that referenced this pull request Jun 9, 2023
Fix some bugs of orc lazy materialization(#18615)
- Fix issue causing column size to continuously increase after `execute_conjuncts()` by calling `Block::erase_useless_column()`.
- Fix partition issues of orc lazy materialization. - Fix lazy materialization will not be used when the predicate column is inconsistent with the orc file.
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approvedIndicates a PR has been approved by one committer.dev/2.0-beta-mergedkind/testreviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@kaka11chen@morningman@xiaokang