Skip to content

[Feature](merge-on-write)Support ignore mode for merge-on-write uniqu… - #27365

Closed
yuxuan-luo wants to merge 5 commits into
apache:masterfrom
yuxuan-luo:ignore_master_insert
Closed

[Feature](merge-on-write)Support ignore mode for merge-on-write uniqu…#27365
yuxuan-luo wants to merge 5 commits into
apache:masterfrom
yuxuan-luo:ignore_master_insert

Conversation

@yuxuan-luo

@yuxuan-luoyuxuan-luo commented Nov 21, 2023

Copy link
Copy Markdown
Contributor

…e table (#21773)

Proposed changes

Issue Number: close#24573

fix data lost bug

Further comments

If this is a relatively large or complex change, kick off the discussion at dev@doris.apache.org by explaining why you chose the solution you did and what alternatives you considered, etc...

@github-actionsgithub-actionsBot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

Comment threadbe/src/olap/tablet_meta.cpp Outdated
Comment on lines +1009 to +1010
void DeleteBitmap::subset_ignore(const BitmapKey& start, const BitmapKey& end,
DeleteBitmap* subset_rowset_map) const {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: method 'subset_ignore' can be made static [readability-convert-member-functions-to-static]

Suggested change
voidDeleteBitmap::subset_ignore(const BitmapKey& start, const BitmapKey& end,
DeleteBitmap* subset_rowset_map) const{
staticvoidDeleteBitmap::subset_ignore(const BitmapKey& start, const BitmapKey& end,
DeleteBitmap* subset_rowset_map) {

@github-actionsgithub-actionsBot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clang-tidy made some suggestions

Comment on lines +1009 to +1010
void DeleteBitmap::subset_ignore(const BitmapKey& start, const BitmapKey& end,
DeleteBitmap* subset_rowset_map) const {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

warning: method 'subset_ignore' can be made static [readability-convert-member-functions-to-static]

Suggested change
voidDeleteBitmap::subset_ignore(const BitmapKey& start, const BitmapKey& end,
DeleteBitmap* subset_rowset_map) const{
staticvoidDeleteBitmap::subset_ignore(const BitmapKey& start, const BitmapKey& end,
DeleteBitmap* subset_rowset_map) {

@yuxuan-luo

Copy link
Copy Markdown
ContributorAuthor

run build all

1 similar comment
@yuxuan-luo

Copy link
Copy Markdown
ContributorAuthor

run build all

DeleteBitmap subset_map(tablet_id());
input_delete_bitmap.subset({rowset->rowset_id(), seg_id, start_version},
{rowset->rowset_id(), seg_id, end_version}, &subset_map);
input_delete_bitmap.subset_ignore({rowset->rowset_id(), seg_id, start_version},

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It can't resolve the compaction issue, since the compaction use merge-on-read process to dedup keys, it can't identify which keys should be ignored.

@github-actions

Copy link
Copy Markdown
Contributor

We're closing this PR because it hasn't been updated in a while.
This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable.
If you'd like to revive this PR, please reopen it and feel free a maintainer to remove the Stale tag!

Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] insert into ignore data lost

2 participants

@yuxuan-luo@zhannngchen