Skip to content

HBASE-23648: Re-use underlying connection registry in RawAsyncHBaseAd… …min (#994) - #1100

Closed
bharathv wants to merge 6 commits into
apache:branch-2from
bharathv:HBASE-23648-branch-2
Closed

HBASE-23648: Re-use underlying connection registry in RawAsyncHBaseAd… …min (#994)#1100
bharathv wants to merge 6 commits into
apache:branch-2from
bharathv:HBASE-23648-branch-2

Conversation

@bharathv

Copy link
Copy Markdown
Contributor
  • HBASE-23648: Re-use underlying connection registry in RawAsyncHBaseAdmin

No need to create and close a new registry on demand. Audited other
usages of getRegistry() and the code looks fine.

  • Fix checkstyle issues in RawAsyncHBaseAdmin

This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.
RPCs exposing it will come in a separate patch as a part of
HBASE-18095.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
(cherry picked from commit c2e01f2)
…ache#812)
Currently we just track whether an active master exists.
It helps to also track the address of the active master in
all the masters to help serve the client RPC requests to
know which master is active.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit efebb84)
* HBASE-23281: Track meta region changes on masters
This patch adds a simple cache that tracks the meta region replica
locations. It keeps an eye on the region movements so that the
cached locations are not stale.
This information is used for servicing client RPCs for connections
that use master based registry (HBASE-18095). The RPC end points
will be added in a separate patch.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 8571d38)
* HBASE-23304: RPCs needed for client meta information lookup
This patch implements the RPCs needed for the meta information
lookup during connection init. New tests added to cover the RPC
code paths. HBASE-23305 builds on this to implement the client
side logic.
Fixed a bunch of checkstyle nits around the places the patch
touches.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 4f8fbba)
* HBASE-23604: Cleanup AsyncRegistry interface
- Cleans up the method names to make more sense and adds a little
more javadocs for context. In future patches we can revisit
the name of the actual class to make it more self explanatory.
- Does AsyncRegistry -> ConnectionRegistry rename.
"async" ness of the registry is kind of implicit based on
the interface contents and need not be reflected in the name.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 12bb41e)
…min (apache#994)
* HBASE-23648: Re-use underlying connection registry in RawAsyncHBaseAdmin
No need to create and close a new registry on demand. Audited other
usages of getRegistry() and the code looks fine.
* Fix checkstyle issues in RawAsyncHBaseAdmin
(cherry picked from commit 07c3826)
@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
+0 🆗reexec0m 35sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 2sNo case conflicting files found.
+0 🆗prototool0m 0sprototool was not available.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚test4tests0m 0sThe patch appears to include 42 new or modified test files.
_ branch-2 Compile Tests _
+0 🆗mvndep0m 15sMaven dependency ordering for branch
+1 💚mvninstall5m 14sbranch-2 passed
+1 💚compile2m 24sbranch-2 passed
+1 💚checkstyle2m 16sbranch-2 passed
+1 💚shadedjars4m 21sbranch has no errors when building our shaded downstream artifacts.
+1 💚javadoc1m 33sbranch-2 passed
+0 🆗spotbugs0m 34sUsed deprecated FindBugs config; considering switching to SpotBugs.
+1 💚findbugs7m 42sbranch-2 passed
_ Patch Compile Tests _
+0 🆗mvndep0m 15sMaven dependency ordering for patch
+1 💚mvninstall4m 52sthe patch passed
+1 💚compile2m 24sthe patch passed
+1 💚cc2m 24sthe patch passed
+1 💚javac2m 24sthe patch passed
+1 💚checkstyle0m 11sThe patch passed checkstyle in hbase-protocol-shaded
+1 💚checkstyle0m 40shbase-client: The patch generated 0 new + 258 unchanged - 13 fixed = 258 total (was 271)
+1 💚checkstyle0m 14sThe patch passed checkstyle in hbase-zookeeper
+1 💚checkstyle1m 10shbase-server: The patch generated 0 new + 135 unchanged - 13 fixed = 135 total (was 148)
+1 💚whitespace0m 0sThe patch has no whitespace issues.
+1 💚shadedjars4m 18spatch has no errors when building our shaded downstream artifacts.
+1 💚hadoopcheck15m 27sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1 💚hbaseprotoc2m 15sthe patch passed
+1 💚javadoc1m 32sthe patch passed
+1 💚findbugs8m 1sthe patch passed
_ Other Tests _
+1 💚unit0m 42shbase-protocol-shaded in the patch passed.
-1 ❌unit14m 7shbase-client in the patch failed.
+1 💚unit0m 51shbase-zookeeper in the patch passed.
+1 💚unit155m 42shbase-server in the patch passed.
+1 💚asflicense2m 12sThe patch does not generate ASF License warnings.
246m 35s
ReasonTests
Failed junit testshadoop.hbase.client.TestClientNoCluster
SubsystemReport/Notes
DockerClient=19.03.5 Server=19.03.5 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/artifact/out/Dockerfile
GITHUB PR#1100
JIRA IssueHBASE-23648
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile cc hbaseprotoc prototool
unameLinux 5d64d9ac8c9c 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/Base-PreCommit-GitHub-PR_PR-1100/out/precommit/personality/provided.sh
git revisionbranch-2 / 2d5dfeb
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/artifact/out/patch-unit-hbase-client.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/testReport/
Max. process+thread count5635 (vs. ulimit of 10000)
modulesC: hbase-protocol-shaded hbase-client hbase-zookeeper hbase-server U: .
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-1100/1/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.1 https://yetus.apache.org

This message was automatically generated.

@bharathv

Copy link
Copy Markdown
ContributorAuthor

Will be included in #1101

@bharathvbharathv closed this Feb 2, 2020
@bharathv
bharathv deleted the HBASE-23648-branch-2 branch February 2, 2020 01:11
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@bharathv@Apache-HBase