Skip to content

HBASE-28928 Handle NPE in Split/Merge table when getMasterQuotaManager returns null - #6375

Merged
NihalJain merged 1 commit into
apache:masterfrom
mnpoonia:apache_quota_fix_NPE
Oct 24, 2024
Merged

HBASE-28928 Handle NPE in Split/Merge table when getMasterQuotaManager returns null#6375
NihalJain merged 1 commit into
apache:masterfrom
mnpoonia:apache_quota_fix_NPE

Conversation

@mnpoonia

Copy link
Copy Markdown
Contributor

No description provided.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 29sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ master Compile Tests _
+1 💚mvninstall3m 49smaster passed
+1 💚compile3m 13smaster passed
+1 💚checkstyle0m 45smaster passed
-1 ❌spotbugs1m 57s/branch-spotbugs-hbase-server-warnings.htmlhbase-server in master has 1 extant spotbugs warnings.
+1 💚spotless0m 53sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+1 💚mvninstall3m 28sthe patch passed
+1 💚compile3m 32sthe patch passed
+1 💚javac3m 32sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 40sthe patch passed
+1 💚spotbugs1m 58sthe patch passed
+1 💚hadoopcheck10m 46sPatch does not cause any errors with Hadoop 3.3.6 3.4.0.
+1 💚spotless0m 42spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 10sThe patch does not generate ASF License warnings.
39m 9s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6375/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#6375
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux 88fb3747b398 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 726b2d8
Default JavaEclipse Adoptium-17.0.11+9
Max. process+thread count84 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6375/1/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 40sDocker mode activated.
-0 ⚠️yetus0m 3sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ master Compile Tests _
+1 💚mvninstall3m 3smaster passed
+1 💚compile0m 58smaster passed
+1 💚javadoc0m 31smaster passed
+1 💚shadedjars5m 11sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall2m 56sthe patch passed
+1 💚compile0m 59sthe patch passed
+1 💚javac0m 59sthe patch passed
+1 💚javadoc0m 30sthe patch passed
+1 💚shadedjars5m 10spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit225m 35shbase-server in the patch passed.
250m 20s
SubsystemReport/Notes
DockerClientAPI=1.47 ServerAPI=1.47 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6375/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#6375
Optional Testsjavac javadoc unit compile shadedjars
unameLinux a96bd06cf324 5.4.0-195-generic #215-Ubuntu SMP Fri Aug 2 18:28:05 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionmaster / 726b2d8
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6375/1/testReport/
Max. process+thread count4577 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6375/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@mnpoonia

Copy link
Copy Markdown
ContributorAuthor

Spotbugs failure is unrelated.

// TODO: Clean up split and merge. Currently all over the place.
try {
env.getMasterServices().getMasterQuotaManager().onRegionMerged(this.mergedRegion);
MasterQuotaManager masterQuotaManager = env.getMasterServices().getMasterQuotaManager();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @mnpoonia in which case are you seeing this NPE? Master is starting up and quotas has not yet initialized?

@mnpooniamnpooniaOct 22, 2024

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@NihalJain You are right. A Master was in transition when we got this exception. It was trying to become active. Sequence of events were as noted below for reference

2024-10-14 20:02:11,265 ERROR [PEWorker-31] procedure2.ProcedureExecutor - CODE-BUG: Uncaught runtime exception: pid=58745238, state=RUNNABLE:SPLIT_TABLE_REGION_PRE_OPERATION, locked=true; SplitTableRegionProcedure table=Table1, parent=36dcdeb9044bd0ece2eb046cf7fd7c2f, daughterA=cfba8d001ef9d3640060a4e845d3d013, daughterB=0becd69b7ccdc7e12dcc96cc637dc300
java.lang.NullPointerException
2024-10-14 20:02:11,269 INFO [aster/hmaster-1:61000:becomeActiveMaster] quotas.MasterQuotaManager - Quota support disabled

@NihalJain

Copy link
Copy Markdown
Contributor

+1, LGTM

@mnpoonia

Copy link
Copy Markdown
ContributorAuthor

@NihalJain if everything is good. can you please help me in getting this committed upto branch-2.5.

@NihalJain

Copy link
Copy Markdown
Contributor

@NihalJain if everything is good. can you please help me in getting this committed upto branch-2.5.

Sure let me merge to master and ping back.

@NihalJain
NihalJain merged commit ff9865a into apache:masterOct 24, 2024
@NihalJain

Copy link
Copy Markdown
Contributor

Merged. Thanks for the fix Aman. Could you please raise backports by cherry picking mfrom master.?

mnpoonia added a commit to mnpoonia/hbase that referenced this pull request Oct 24, 2024
…r returns null (apache#6375)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
mnpoonia added a commit to mnpoonia/hbase that referenced this pull request Oct 24, 2024
…r returns null (apache#6375)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
mnpoonia added a commit to mnpoonia/hbase that referenced this pull request Oct 24, 2024
…r returns null (apache#6375)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
NihalJain pushed a commit to NihalJain/hbase that referenced this pull request Oct 28, 2024
…r returns null (apache#6375)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
mnpoonia added a commit to mnpoonia/hbase that referenced this pull request Oct 28, 2024
…r returns null (apache#6375)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
NihalJain pushed a commit that referenced this pull request Oct 29, 2024
…r returns null (#6375) (#6409)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
NihalJain pushed a commit that referenced this pull request Oct 29, 2024
…r returns null (#6375) (#6393)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
NihalJain pushed a commit that referenced this pull request Oct 29, 2024
…r returns null (#6375) (#6394)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
NihalJain pushed a commit that referenced this pull request Oct 29, 2024
…r returns null (#6375) (#6395)
Signed-off-by: Nihal Jain <nihaljain@apache.org>
@mnpoonia
mnpoonia deleted the apache_quota_fix_NPE branch November 13, 2024 09:30
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants

@mnpoonia@Apache-HBase@NihalJain