Skip to content

HBASE-22944 Space Quota: TableNotFoundException: hbase:quota is thrown when region server is restarted. - #559

Closed
shardul-cr7 wants to merge 4 commits into
apache:masterfrom
shardul-cr7:HBASE-22944
Closed

HBASE-22944 Space Quota: TableNotFoundException: hbase:quota is thrown when region server is restarted.#559
shardul-cr7 wants to merge 4 commits into
apache:masterfrom
shardul-cr7:HBASE-22944

Conversation

@shardul-cr7

@shardul-cr7shardul-cr7 commented Aug 29, 2019

Copy link
Copy Markdown
Contributor

During Master startup if quota feature is enabled and region server is running TableNotFoundException occurs in regionServer logs

SpaceQuotaRefresherChore does not checks whether hbase:quota table is present,before starting its operation which sometimes may result to TableNotFoundExceptions.

This is because master has not created the hbase:quota table and SpaceQuotaRefresherChore is running.

This is little tricky and will happen in below scenario:

  1. HM & RSs are restarted after enabling Space Quota feature.
  2. SpaceQuotaRefresher chore interval is set as very low say 5 sec
  3. So by the time HMaster creates quota table SpaceQuotaRefresherChore executes and throws TNFE

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec34Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall348master passed
+1compile56master passed
+1checkstyle91master passed
+1shadedjars294branch has no errors when building our shaded downstream artifacts.
+1javadoc37master passed
0spotbugs257Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs254master passed
_ Patch Compile Tests _
+1mvninstall327the patch passed
+1compile58the patch passed
+1javac58the patch passed
+1checkstyle86the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars294patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1007Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc35the patch passed
+1findbugs227the patch passed
_ Other Tests _
-1unit1714hbase-server in the patch failed.
+1asflicense15The patch does not generate ASF License warnings.
5279
ReasonTests
Failed junit testshadoop.hbase.quotas.TestSpaceQuotaViolationPolicyRefresherChore
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/1/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux a444d279a3db 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 56980fb
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/1/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/1/testReport/
Max. process+thread count628 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/1/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec36Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
-0test4tests0The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.
_ master Compile Tests _
+1mvninstall350master passed
+1compile57master passed
+1checkstyle88master passed
+1shadedjars301branch has no errors when building our shaded downstream artifacts.
+1javadoc36master passed
0spotbugs265Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs263master passed
_ Patch Compile Tests _
+1mvninstall327the patch passed
+1compile59the patch passed
+1javac59the patch passed
+1checkstyle88the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars301patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1043Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc33the patch passed
+1findbugs273the patch passed
_ Other Tests _
-1unit1780hbase-server in the patch failed.
+1asflicense15The patch does not generate ASF License warnings.
5458
ReasonTests
Failed junit testshadoop.hbase.quotas.TestSpaceQuotaViolationPolicyRefresherChore
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/2/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux d9f903f0bd2d 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 56980fb
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/2/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/2/testReport/
Max. process+thread count614 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/2/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec109Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall342master passed
+1compile55master passed
+1checkstyle83master passed
+1shadedjars281branch has no errors when building our shaded downstream artifacts.
+1javadoc37master passed
0spotbugs247Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs246master passed
_ Patch Compile Tests _
+1mvninstall318the patch passed
+1compile60the patch passed
+1javac60the patch passed
+1checkstyle83the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars281patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck972Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc36the patch passed
+1findbugs258the patch passed
_ Other Tests _
-1unit14819hbase-server in the patch failed.
+1asflicense27The patch does not generate ASF License warnings.
18382
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/3/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 05ca219f1aee 4.15.0-48-generic #51-Ubuntu SMP Wed Apr 3 08:28:49 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 56980fb
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/3/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/3/testReport/
Max. process+thread count4593 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/3/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec37Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall338master passed
+1compile56master passed
+1checkstyle80master passed
+1shadedjars282branch has no errors when building our shaded downstream artifacts.
+1javadoc37master passed
0spotbugs245Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs243master passed
_ Patch Compile Tests _
+1mvninstall309the patch passed
+1compile56the patch passed
+1javac56the patch passed
+1checkstyle78the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars281patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck975Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc39the patch passed
+1findbugs287the patch passed
_ Other Tests _
-1unit10300hbase-server in the patch failed.
+1asflicense31The patch does not generate ASF License warnings.
13850
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/4/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 11d992ee4e86 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 83e7794
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/4/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/4/testReport/
Max. process+thread count4674 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/4/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec41Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall326master passed
+1compile58master passed
+1checkstyle83master passed
+1shadedjars285branch has no errors when building our shaded downstream artifacts.
+1javadoc36master passed
0spotbugs242Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs240master passed
_ Patch Compile Tests _
+1mvninstall297the patch passed
+1compile55the patch passed
+1javac55the patch passed
+1checkstyle75the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars270patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck920Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc34the patch passed
+1findbugs266the patch passed
_ Other Tests _
-1unit10359hbase-server in the patch failed.
+1asflicense30The patch does not generate ASF License warnings.
13776
ReasonTests
Failed junit testshadoop.hbase.TestSplitMerge
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/5/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 7c228facdfbd 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 090c55f
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/5/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/5/testReport/
Max. process+thread count4966 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/5/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec40Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall345master passed
+1compile55master passed
+1checkstyle78master passed
+1shadedjars290branch has no errors when building our shaded downstream artifacts.
+1javadoc39master passed
0spotbugs261Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs259master passed
_ Patch Compile Tests _
+1mvninstall316the patch passed
+1compile57the patch passed
+1javac57the patch passed
+1checkstyle76the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars299patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1089Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc40the patch passed
+1findbugs295the patch passed
_ Other Tests _
+1unit9537hbase-server in the patch passed.
+1asflicense29The patch does not generate ASF License warnings.
13288
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/6/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux a46eccf22eaf 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 090c55f
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/6/testReport/
Max. process+thread count4458 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/6/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@shardul-cr7

Copy link
Copy Markdown
ContributorAuthor

Hi @jatsakthi, Can you review this? :)

@the-sakthithe-sakthi left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Skimmed through it. Looks good to me. Will come back to take a look again.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec33Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall350master passed
+1compile55master passed
+1checkstyle89master passed
+1shadedjars294branch has no errors when building our shaded downstream artifacts.
+1javadoc36master passed
0spotbugs266Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs265master passed
_ Patch Compile Tests _
+1mvninstall321the patch passed
+1compile57the patch passed
+1javac57the patch passed
+1checkstyle86the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars295patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1032Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc37the patch passed
+1findbugs280the patch passed
_ Other Tests _
-1unit9395hbase-server in the patch failed.
+1asflicense27The patch does not generate ASF License warnings.
13046
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/7/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 26ec83e25d34 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / ee5cf0d
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/7/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/7/testReport/
Max. process+thread count4409 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/7/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec34Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall361master passed
+1compile62master passed
+1checkstyle89master passed
+1shadedjars322branch has no errors when building our shaded downstream artifacts.
+1javadoc42master passed
0spotbugs276Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs274master passed
_ Patch Compile Tests _
+1mvninstall335the patch passed
+1compile59the patch passed
+1javac59the patch passed
+1checkstyle85the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars302patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1039Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc40the patch passed
+1findbugs281the patch passed
_ Other Tests _
+1unit10591hbase-server in the patch passed.
+1asflicense26The patch does not generate ASF License warnings.
14350
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/8/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux fc86ceedf301 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / b642ee0
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/8/testReport/
Max. process+thread count4796 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/8/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec32Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall427master passed
+1compile58master passed
+1checkstyle89master passed
+1shadedjars297branch has no errors when building our shaded downstream artifacts.
+1javadoc38master passed
0spotbugs247Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs245master passed
_ Patch Compile Tests _
+1mvninstall332the patch passed
+1compile63the patch passed
+1javac63the patch passed
+1checkstyle89the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars303patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1052Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc36the patch passed
+1findbugs283the patch passed
_ Other Tests _
-1unit10556hbase-server in the patch failed.
+1asflicense37The patch does not generate ASF License warnings.
14333
ReasonTests
Failed junit testshadoop.hbase.security.token.TestZKSecretWatcher
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/9/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 8fae07c7dd13 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 97fbaa6
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/9/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/9/testReport/
Max. process+thread count4523 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/9/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec73Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall343master passed
+1compile60master passed
+1checkstyle81master passed
+1shadedjars290branch has no errors when building our shaded downstream artifacts.
+1javadoc39master passed
0spotbugs262Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs260master passed
_ Patch Compile Tests _
+1mvninstall313the patch passed
+1compile68the patch passed
+1javac68the patch passed
+1checkstyle79the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars284patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck974Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc38the patch passed
+1findbugs272the patch passed
_ Other Tests _
-1unit18128hbase-server in the patch failed.
+1asflicense48The patch does not generate ASF License warnings.
21741
ReasonTests
Failed junit testshadoop.hbase.client.TestSnapshotTemporaryDirectoryWithRegionReplicas
hadoop.hbase.master.TestSplitWALManager
hadoop.hbase.util.TestFromClientSide3WoUnsafe
hadoop.hbase.client.TestFromClientSide
hadoop.hbase.security.access.TestAccessController3
hadoop.hbase.client.TestFromClientSideWithCoprocessor
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/10/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux a0e859c6a1ec 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / a5ef6b2
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/10/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/10/testReport/
Max. process+thread count4829 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/10/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
0reexec37Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall415master passed
+1compile69master passed
+1checkstyle112master passed
+1shadedjars376branch has no errors when building our shaded downstream artifacts.
+1javadoc44master passed
0spotbugs333Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs331master passed
_ Patch Compile Tests _
+1mvninstall386the patch passed
+1compile70the patch passed
+1javac70the patch passed
+1checkstyle102the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars363patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1218Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc45the patch passed
+1findbugs367the patch passed
_ Other Tests _
+1unit9673hbase-server in the patch passed.
+1asflicense26The patch does not generate ASF License warnings.
14096
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/11/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 3664b1716217 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 13b2edc
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/11/testReport/
Max. process+thread count4760 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/11/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeComment
0reexec31Docker mode activated.
_ Prechecks _
+1dupname0No case conflicting files found.
+1hbaseanti0Patch does not have any anti-patterns.
+1@author0The patch does not contain any @author tags.
+1test4tests0The patch appears to include 1 new or modified test files.
_ master Compile Tests _
+1mvninstall350master passed
+1compile57master passed
+1checkstyle87master passed
+1shadedjars300branch has no errors when building our shaded downstream artifacts.
+1javadoc36master passed
0spotbugs251Used deprecated FindBugs config; considering switching to SpotBugs.
+1findbugs249master passed
_ Patch Compile Tests _
+1mvninstall325the patch passed
+1compile58the patch passed
+1javac58the patch passed
+1checkstyle88the patch passed
+1whitespace0The patch has no whitespace issues.
+1shadedjars298patch has no errors when building our shaded downstream artifacts.
+1hadoopcheck1024Patch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
+1javadoc35the patch passed
+1findbugs264the patch passed
_ Other Tests _
-1unit9746hbase-server in the patch failed.
+1asflicense27The patch does not generate ASF License warnings.
13368
ReasonTests
Failed junit testshadoop.hbase.regionserver.TestHRegionWithInMemoryFlush
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/12/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 1a191c3e466f 4.15.0-54-generic #58-Ubuntu SMP Mon Jun 24 10:55:24 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 8e8bd8b
Default Java1.8.0_181
unithttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/12/artifact/out/patch-unit-hbase-server.txt
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/12/testReport/
Max. process+thread count4573 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/12/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.10.0 http://yetus.apache.org

This message was automatically generated.

protected void chore() {
try {
// check whether Quota table is present or not.
if (!checkQuotaTableExists()) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This will result in a META read. This can be done only once in the life time of an RS right if we found Quota table exists? A Boolean state can help here.
Why do you think we should do a WARN log? It can be just INFO at max IMO.

@shardul-cr7shardul-cr7Sep 6, 2019

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @anoopsjohn , Thanks for the review. Added a boolean state to avoid the Meta read again and added info level log.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
💙reexec0m 45sDocker mode activated.
_ Prechecks _
💚dupname0m 0sNo case conflicting files found.
💚hbaseanti0m 0sPatch does not have any anti-patterns.
💚@author0m 0sThe patch does not contain any @author tags.
💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
💚mvninstall7m 14smaster passed
💚compile1m 10smaster passed
💚checkstyle1m 38smaster passed
💚shadedjars6m 9sbranch has no errors when building our shaded downstream artifacts.
💚javadoc0m 42smaster passed
💙spotbugs4m 47sUsed deprecated FindBugs config; considering switching to SpotBugs.
💚findbugs4m 45smaster passed
_ Patch Compile Tests _
💚mvninstall6m 11sthe patch passed
💚compile1m 6sthe patch passed
💚javac1m 6sthe patch passed
💚checkstyle1m 35sthe patch passed
💚whitespace0m 0sThe patch has no whitespace issues.
💚shadedjars5m 37spatch has no errors when building our shaded downstream artifacts.
💚hadoopcheck20m 9sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
💚javadoc0m 41sthe patch passed
💚findbugs4m 53sthe patch passed
_ Other Tests _
💚unit163m 54shbase-server in the patch passed.
💚asflicense0m 32sThe patch does not generate ASF License warnings.
235m 2s
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/13/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 1f1b8ae260cf 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / fbd5b5e
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/13/testReport/
Max. process+thread count4726 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/13/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.0 https://yetus.apache.org

This message was automatically generated.

@shardul-cr7shardul-cr7 changed the title HBASE-22944 TableNotFoundException: hbase:quota is thrown when region server is restarted.HBASE-22944 Space Quota: TableNotFoundException: hbase:quota is thrown when region server is restarted.Sep 11, 2019
// check whether Quota table is present or not.
if (!quotaTablePresent && !checkQuotaTableExists()) {
LOG.info("Quota table not found, skipping quota manager cache refresh.");
quotaTablePresent = true;

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this right? Setting it to true? Should it be false? The table was 'not found'.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

ohh yes..I should set it after the if condition...my bad :)

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the review. Made the changes. :)

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
💙reexec1m 30sDocker mode activated.
_ Prechecks _
💚dupname0m 1sNo case conflicting files found.
💚hbaseanti0m 0sPatch does not have any anti-patterns.
💚@author0m 0sThe patch does not contain any @author tags.
💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
💚mvninstall5m 36smaster passed
💚compile0m 57smaster passed
💚checkstyle1m 18smaster passed
💚shadedjars4m 47sbranch has no errors when building our shaded downstream artifacts.
💚javadoc0m 39smaster passed
💙spotbugs3m 52sUsed deprecated FindBugs config; considering switching to SpotBugs.
💚findbugs3m 49smaster passed
_ Patch Compile Tests _
💚mvninstall5m 6sthe patch passed
💚compile0m 57sthe patch passed
💚javac0m 57sthe patch passed
💚checkstyle1m 17sthe patch passed
💚whitespace0m 0sThe patch has no whitespace issues.
💚shadedjars4m 41spatch has no errors when building our shaded downstream artifacts.
💚hadoopcheck15m 47sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
💚javadoc0m 36sthe patch passed
💚findbugs3m 48sthe patch passed
_ Other Tests _
💚unit166m 15shbase-server in the patch passed.
💚asflicense0m 35sThe patch does not generate ASF License warnings.
224m 13s
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/14/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux accf7342673f 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 1cb4f68
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/14/testReport/
Max. process+thread count5077 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/14/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeComment
💙reexec0m 35sDocker mode activated.
_ Prechecks _
💚dupname0m 0sNo case conflicting files found.
💚hbaseanti0m 0sPatch does not have any anti-patterns.
💚@author0m 0sThe patch does not contain any @author tags.
💚test4tests0m 0sThe patch appears to include 1 new or modified test files.
_ master Compile Tests _
💚mvninstall5m 27smaster passed
💚compile0m 59smaster passed
💚checkstyle1m 19smaster passed
💚shadedjars4m 45sbranch has no errors when building our shaded downstream artifacts.
💚javadoc0m 40smaster passed
💙spotbugs4m 11sUsed deprecated FindBugs config; considering switching to SpotBugs.
💚findbugs4m 9smaster passed
_ Patch Compile Tests _
💚mvninstall5m 9sthe patch passed
💚compile1m 0sthe patch passed
💚javac1m 0sthe patch passed
💚checkstyle1m 18sthe patch passed
💚whitespace0m 0sThe patch has no whitespace issues.
💚shadedjars4m 51spatch has no errors when building our shaded downstream artifacts.
💚hadoopcheck16m 6sPatch does not cause any errors with Hadoop 2.8.5 2.9.2 or 3.1.2.
💚javadoc0m 36sthe patch passed
💚findbugs4m 21sthe patch passed
_ Other Tests _
💚unit171m 43shbase-server in the patch passed.
💚asflicense0m 36sThe patch does not generate ASF License warnings.
230m 9s
SubsystemReport/Notes
DockerClient=19.03.1 Server=19.03.1 base: https://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/15/artifact/out/Dockerfile
GITHUB PR#559
Optional Testsdupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile
unameLinux 75df86f43dc5 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 GNU/Linux
Build toolmaven
Personality/home/jenkins/jenkins-slave/workspace/HBase-PreCommit-GitHub-PR_PR-559/out/precommit/personality/provided.sh
git revisionmaster / 1cb4f68
Default Java1.8.0_181
Test Resultshttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/15/testReport/
Max. process+thread count4987 (vs. ulimit of 10000)
modulesC: hbase-server U: hbase-server
Console outputhttps://builds.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-559/15/console
versionsgit=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11
Powered byApache Yetus 0.11.0 https://yetus.apache.org

This message was automatically generated.

@saintstacksaintstack left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good by me. Another for your list @joshelser Thanks boss.

@joshelserjoshelser left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Nice little trick on the if-block.

Let me try to get this in.

asfgit pushed a commit that referenced this pull request Sep 20, 2019
…herChore
During startup, it's possible that quotas are enabled but the Master has
not yet created the hbase:quotas table.
Closes#559
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
asfgit pushed a commit that referenced this pull request Sep 20, 2019
…herChore
During startup, it's possible that quotas are enabled but the Master has
not yet created the hbase:quotas table.
Closes#559
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
asfgit pushed a commit that referenced this pull request Sep 20, 2019
…herChore
During startup, it's possible that quotas are enabled but the Master has
not yet created the hbase:quotas table.
Closes#559
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
return;
}
// since quotaTable is present so setting the flag as true.
quotaTablePresent = true;

@pankaj72981pankaj72981Sep 21, 2019

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Better we move flag setting inside checkQuotaTableExists().
Sorry for the late review.

infraio pushed a commit to infraio/hbase that referenced this pull request Aug 17, 2020
…herChore
During startup, it's possible that quotas are enabled but the Master has
not yet created the hbase:quotas table.
Closesapache#559
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
symat pushed a commit to symat/hbase that referenced this pull request Feb 17, 2021
…herChore
During startup, it's possible that quotas are enabled but the Master has
not yet created the hbase:quotas table.
Closesapache#559
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit f1682a1)
Change-Id: Iedb0bfe9591c0957a151acc8d2b3bd31a91237d9
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants

@shardul-cr7@Apache-HBase@saintstack@joshelser@anoopsjohn@the-sakthi@pankaj72981