Skip to content

MR: Fix IndexOutOfBounds by skip filter translation if there are no leaves - #7123

Merged
pvary merged 1 commit into
apache:masterfrom
edgarRd:hive-between-sargs-fix
Apr 24, 2023
Merged

MR: Fix IndexOutOfBounds by skip filter translation if there are no leaves#7123
pvary merged 1 commit into
apache:masterfrom
edgarRd:hive-between-sargs-fix

Conversation

@edgarRd

Copy link
Copy Markdown
Contributor

Fixes#7122

Handles issues when converting SearchArguments where tree and leaf arrays are not in sync.

The changes in PR make sure that whenever we access certain array indexes they are within bounds expected.

* [mr] Skip filter translation if there are no leaves (#43)
* Skip filter translation if there are no leaves
* Make check generic
* [mr] Check for valid leaf literals
* Add unit test
@edgarRd

Copy link
Copy Markdown
ContributorAuthor

PTAL @pvary

@edgarRd

Copy link
Copy Markdown
ContributorAuthor

PTAL @danielcweeks - Thanks!

@edgarRdedgarRd changed the title MR: Skip filter translation if there are no leavesMR: Fix IndexOutOfBounds by skip filter translation if there are no leavesApr 14, 2023
@pvary

pvary commented Apr 18, 2023

Copy link
Copy Markdown
Contributor

I am not working on MR side lately, so I do not have a current knowledge of the code here
Maybe @deniskuzZ would be interested in reviewing this PR.

@deniskuzZdeniskuzZ left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, note that Hive overrides this class in iceberg-handler module, due to a lack of committer support in iceberg project. Consider opening a similar PR for Hive.

@deniskuzZ

Copy link
Copy Markdown
Member

thanks @pvary for the +1.
@edgarRd if that gets merged soon, the change could be incorporated in Hive with the next Iceberg release, and probably no need for a separate PR in Hive.

@pvary
pvary merged commit 37cb7ca into apache:masterApr 24, 2023
@pvary

Copy link
Copy Markdown
Contributor

Thanks @edgarRd for the PR and @deniskuzZ for the review!

@edgarRd

Copy link
Copy Markdown
ContributorAuthor

Thanks for the review @deniskuzZ and @pvary for the merge!

@edgarRd
edgarRd deleted the hive-between-sargs-fix branch April 24, 2023 14:35
zhangbutao added a commit to zhangbutao/hive that referenced this pull request Apr 25, 2023
zhangbutao added a commit to zhangbutao/hive that referenced this pull request Apr 25, 2023
manisin pushed a commit to Snowflake-Labs/iceberg that referenced this pull request May 9, 2023
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Iceberg table in Hive fails with IndexOutOfBounds when BETWEEN filter used

3 participants

@edgarRd@pvary@deniskuzZ