Skip to content

HBASE-29323 Use Priority Handler for all RegionServerStatus rpc at Master(#6994) - #6998

Merged
NihalJain merged 3 commits into
apache:branch-2from
Umeshkumar9414:HBASE-29323_branch2
May 20, 2025
Merged

HBASE-29323 Use Priority Handler for all RegionServerStatus rpc at Master(#6994)#6998
NihalJain merged 3 commits into
apache:branch-2from
Umeshkumar9414:HBASE-29323_branch2

Conversation

@Umeshkumar9414

Copy link
Copy Markdown
Contributor

HBASE-29323 Use Priority Handler for all RegionServerStatus rpc at Master(#6994)

…ster (apache#6994)
Co-authored-by: ukumawat <ukumawat@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

@Apache-HBase

This comment has been minimized.

splitWalProcedureDoneReport);
checkMethod(conf, "GetLastFlushedSequenceId", HConstants.HIGH_QOS, qosFunction,
lastFlushedSequenceIdRequest);
checkMethod(conf, "RegionServerReport", HConstants.HIGH_QOS, qosFunction,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also add corresponding test for checkMethod(conf, "CompactRegion", HConstants.ADMIN_QOS, qosFunction);?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

won't it make difference in branch-3 and branch-2 ?
While writing I didn't find a good way to add Test for all so just added for some important one.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess the point is previous line 101 has checkMethod(conf, "CompactRegion", HConstants.ADMIN_QOS, qosFunction); and that check would still be valid in branch-2, so you don't need to remove that line here.

Ultimately, I'm not sure how important it is, though, since the method is removed in master branch as part of #3612 (d26bcaa and https://issues.apache.org/jira/browse/HBASE-25288)... and it's probably unnecessarily ADMIN_QOS here in branch-2.

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

added this as well.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure why you didn't just leave it inside the testAnnotations method :)

@NihalJain

NihalJain commented May 19, 2025

Copy link
Copy Markdown
Contributor

LGTM, will merge tomorrow morning IST and pull back upto branch-2.6! Thanks @Umeshkumar9414 !

splitWalProcedureDoneReport);
checkMethod(conf, "GetLastFlushedSequenceId", HConstants.HIGH_QOS, qosFunction,
lastFlushedSequenceIdRequest);
checkMethod(conf, "RegionServerReport", HConstants.HIGH_QOS, qosFunction,

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I guess the point is previous line 101 has checkMethod(conf, "CompactRegion", HConstants.ADMIN_QOS, qosFunction); and that check would still be valid in branch-2, so you don't need to remove that line here.

Ultimately, I'm not sure how important it is, though, since the method is removed in master branch as part of #3612 (d26bcaa and https://issues.apache.org/jira/browse/HBASE-25288)... and it's probably unnecessarily ADMIN_QOS here in branch-2.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec9m 50sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 1scodespell was not available.
+0 🆗detsecrets0m 1sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ branch-2 Compile Tests _
+1 💚mvninstall8m 9sbranch-2 passed
+1 💚compile7m 6sbranch-2 passed
+1 💚checkstyle1m 20sbranch-2 passed
+1 💚spotbugs2m 46sbranch-2 passed
-1 ❌spotless1m 28sbranch has 1 errors when running spotless:check, run spotless:apply to fix.
_ Patch Compile Tests _
+1 💚mvninstall7m 36sthe patch passed
+1 💚compile4m 2sthe patch passed
+1 💚javac4m 2sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 59sthe patch passed
+1 💚spotbugs2m 21sthe patch passed
+1 💚hadoopcheck41m 12sPatch does not cause any errors with Hadoop 2.10.2 or 3.3.6 3.4.0.
-1 ❌spotless1m 19spatch has 1 errors when running spotless:check, run spotless:apply to fix.
_ Other Tests _
+1 💚asflicense0m 27sThe patch does not generate ASF License warnings.
92m 27s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#6998
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux 0f668dedceda 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 0d4934d
Default JavaEclipse Adoptium-11.0.23+9
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/artifact/yetus-general-check/output/branch-spotless.txt
spotlesshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/artifact/yetus-general-check/output/patch-spotless.txt
Max. process+thread count79 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec11m 30sDocker mode activated.
-0 ⚠️yetus0m 13sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall5m 21sbranch-2 passed
+1 💚compile3m 6sbranch-2 passed
+1 💚javadoc0m 49sbranch-2 passed
+1 💚shadedjars8m 27sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall5m 52sthe patch passed
+1 💚compile1m 41sthe patch passed
+1 💚javac1m 41sthe patch passed
+1 💚javadoc0m 48sthe patch passed
+1 💚shadedjars8m 34spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit24m 32s/patch-unit-hbase-server.txthbase-server in the patch failed.
73m 53s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#6998
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 7c6780e320a3 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 0d4934d
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/testReport/
Max. process+thread count1868 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 44sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall2m 35sbranch-2 passed
+1 💚compile0m 41sbranch-2 passed
+1 💚javadoc0m 25sbranch-2 passed
+1 💚shadedjars5m 18sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall2m 26sthe patch passed
+1 💚compile0m 41sthe patch passed
+1 💚javac0m 41sthe patch passed
+1 💚javadoc0m 23sthe patch passed
+1 💚shadedjars5m 17spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit228m 47s/patch-unit-hbase-server.txthbase-server in the patch failed.
251m 45s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#6998
Optional Testsjavac javadoc unit compile shadedjars
unameLinux f5ff37f88446 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 0d4934d
Default JavaTemurin-1.8.0_412-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/testReport/
Max. process+thread count4143 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 42sDocker mode activated.
-0 ⚠️yetus0m 4sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+1 💚mvninstall3m 24sbranch-2 passed
+1 💚compile0m 50sbranch-2 passed
+1 💚javadoc0m 26sbranch-2 passed
+1 💚shadedjars6m 28sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+1 💚mvninstall3m 5sthe patch passed
+1 💚compile0m 50sthe patch passed
+1 💚javac0m 50sthe patch passed
+1 💚javadoc0m 25sthe patch passed
+1 💚shadedjars6m 23spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit222m 9s/patch-unit-hbase-server.txthbase-server in the patch failed.
249m 24s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#6998
Optional Testsjavac javadoc unit compile shadedjars
unameLinux c8b897488c9f 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 0d4934d
Default JavaEclipse Adoptium-11.0.23+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/testReport/
Max. process+thread count4457 (vs. ulimit of 30000)
modulesC: hbase-server U: hbase-server
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-6998/2/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Umeshkumar9414

Copy link
Copy Markdown
ContributorAuthor

These failures caused by " Job manager has been shut down." @NihalJain last run was successful, after that I added that sigle test and that was running fine on local. Can you rerun the build and help me with this PR?

@NihalJain

Copy link
Copy Markdown
Contributor

These failures caused by " Job manager has been shut down." @NihalJain last run was successful, after that I added that sigle test and that was running fine on local. Can you rerun the build and help me with this PR?

I think we are fine as your last commit should not cause the failure. Let me merge this!

@NihalJain
NihalJain merged commit 19440ac into apache:branch-2May 20, 2025
NihalJain pushed a commit that referenced this pull request May 20, 2025
…ster(#6994) (#6998)
Co-authored-by: ukumawat <ukumawat@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
(cherry picked from commit 19440ac)
mokai87 pushed a commit to mokai87/hbase that referenced this pull request Aug 7, 2025
…ster(apache#6994) (apache#6998)
Co-authored-by: ukumawat <ukumawat@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
(cherry picked from commit d187378)
sanjeet006py pushed a commit to sanjeet006py/hbase that referenced this pull request Aug 24, 2025
…ster(apache#6994) (apache#6998)
Co-authored-by: ukumawat <ukumawat@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nihal Jain <nihaljain@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
(cherry picked from commit d187378)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants

@Umeshkumar9414@Apache-HBase@NihalJain@mnpoonia@d-c-manning