Uh oh!
There was an error while loading. Please reload this page.
HBASE-27303 Unnecessary replication to secondary region replicas shou… - #4707
Merged
Conversation
…ld avoid when WAL.sync throws Exception
Apache-HBase
commented
Aug 15, 2022
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 15, 2022
🎊 +1 overall
This message was automatically generated. |
Apache-HBase
commented
Aug 15, 2022
🎊 +1 overall
This message was automatically generated. |
Apache9
reviewed
Aug 16, 2022
| * so there is no need to replicate to secondary replica, for this reason here we attach the | ||
| * region replication action after the {@link HRegion#sync} is successful. | ||
| */ | ||
| this.attachRegionReplicationInWALAppend(batchOp, miniBatchOp, walKey, walEdit, writeEntry); |
Contributor
There was a problem hiding this comment.
For most cases the sync will succeeded, attach it before WAL sync can speed up the replication? No?
ContributorAuthor
There was a problem hiding this comment.
@Apache9 , the replication is fired by MVCC.complete, so seems that attaching it before WAL.sync could not speed up the replication.By the previous discussion in HBASE-27223 and #4633, sync may throws exception(especially for FSHLog, it has no retry and may throws any exception thrown by ProtobufLogWriter.append or ProtobufLogWriter.sync ,and it may not abort the regionServer, HBASE-27231 try to solve this problem), attaching the region replication after sync success could try to avoid data inconsistent between primary and secondary replicas,and if WAL.sync throws exception, we have no need to replicate to secondary region replicas whether RegionServer is aborted or not.
Contributor
There was a problem hiding this comment.
OK, we will complete the MVCC entry after calling this method.
Apache9
approved these changes
Aug 23, 2022
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…ld avoid when WAL.sync throws Exception