Skip to content

HBASE-23275: Track active master's address in ActiveMasterManager (#812) - #1096

Closed
bharathv wants to merge 2 commits into
apache:branch-2from
bharathv:HBASE-23275-actual-branch-2
Closed

HBASE-23275: Track active master's address in ActiveMasterManager (#812)#1096
bharathv wants to merge 2 commits into
apache:branch-2from
bharathv:HBASE-23275-actual-branch-2

Conversation

@bharathv

Copy link
Copy Markdown
Contributor

Currently we just track whether an active master exists.
It helps to also track the address of the active master in
all the masters to help serve the client RPC requests to
know which master is active.

Signed-off-by: Nick Dimiduk ndimiduk@apache.org
Signed-off-by: Andrew Purtell apurtell@apache.org
(cherry picked from commit efebb84)

This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.
RPCs exposing it will come in a separate patch as a part of
HBASE-18095.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
(cherry picked from commit c2e01f2)
…ache#812)
Currently we just track whether an active master exists.
It helps to also track the address of the active master in
all the masters to help serve the client RPC requests to
know which master is active.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit efebb84)
@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec1m 11sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 2 new or modified test files.
_ branch-2 Compile Tests _
+1 💚mvninstall5m 56sbranch-2 passed
+1 💚compile0m 57sbranch-2 passed
+1 💚checkstyle1m 17sbranch-2 passed
+1 💚shadedjars4m 38sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc0m 41sbranch-2 passed
+0 🆗spotbugs3m 30sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs3m 28sbranch-2 passed
_ Patch Compile Tests _
+1 💚mvninstall5m 26sthe patch passed
+1 💚compile0m 59sthe patch passed
+1 💚javac0m 59sthe patch passed
+1 💚checkstyle1m 14shbase-server: The patch generated 0 new + 106 unchanged - 6 fixed = 106 total (was 112)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚shadedjars4m 41spatch has no errors when building our shaded downstream artifacts.
+1 💚hadoopcheck17m 4sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 💚javadoc0m 36sthe patch passed
+1 💚findbugs3m 40sthe patch passed
_ Other Tests _
-1 ❌unit165m 0shbase-server in the patch failed.
+1 💚asflicense0m 27sThe patch does not generate ASF License warnings.
224m 8s
ReasonTests
Failed junit testshadoop.hbase.client.TestAsyncTableGetMultiThreaded
SubsystemReport/Notes
DockerClient=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1096/1/artifact/out/Dockerfile
GITHUB PR#1096
JIRA IssueHBASE-23275
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3474081bae23 4.15.0-74-generic #84-Ubuntu SMP Thu Dec 19 08:06:28 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1096/out/precommit/personality/provided.sh
git revisionbranch-2 / e0f9133
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1096/1/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1096/1/testReport/
Max. process+thread count4823 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1096/1/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

import org.apache.zookeeper.KeeperException;
import org.slf4j.Logger;
import org.slf4j.LoggerFactory;
import org.apache.hadoop.hbase.shaded.protobuf.ProtobufUtil;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this show up as a checkstyle nit?

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess it doesn't, never mind...

private ClusterId clusterId;

// cache stats for testing.
private AtomicInteger cacheMisses = new AtomicInteger(0);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment as per the master version of this change: A bit wasteful just for a unit test? Nit

while (fetchInProgress.get()) {
// We don't want the fetches to block forever, for example if there are bugs
// of missing notifications.
fetchInProgress.wait(MAX_FETCH_TIMEOUT_MS);

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh forgot to mention this while looking at the master patch. You will miss the notification for sure if the Preconditions check above throws an exception. Doesn't seem wrong, just thought I'd mention it.

@bharathv

Copy link
Copy Markdown
ContributorAuthor

Will be merged as a part of #1098

@bharathv
bharathv deleted the HBASE-23275-actual-branch-2 branch January 29, 2020 00:46
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@bharathv@Apache-HBase@apurtell