Skip to content

HBASE-29802 NPE when shutting down mini cluster cause tests hang (#7604) - #7612

Merged
Apache9 merged 1 commit into
apache:branch-2from
Apache9:HBASE-29802-branch-2
Jan 12, 2026
Merged

HBASE-29802 NPE when shutting down mini cluster cause tests hang (#7604)#7612
Apache9 merged 1 commit into
apache:branch-2from
Apache9:HBASE-29802-branch-2

Conversation

@Apache9

Copy link
Copy Markdown
Contributor

Remove the 'shutdownHook' in SingleProcessHBaseCluster where we close the FileSystem instance of a region server.
Set DistributedFileSystem cache to false when creating MiniMRCluster so when shutting down MiniMRCluster it will not close the shared FileSystem instance.
Also re-enable TestExportSnapshot.

(cherry picked from commit d11ee6a)

@Apache9Apache9 self-assigned this Jan 10, 2026
@Apache9Apache9 added the backport This PR is a back port of some issue or issues already committed to master label Jan 10, 2026
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 19sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ branch-2 Compile Tests _
+0 🆗mvndep0m 15sMaven dependency ordering for branch
+1 💚mvninstall3m 11sbranch-2 passed
+1 💚compile5m 16sbranch-2 passed
+1 💚checkstyle0m 51sbranch-2 passed
+1 💚spotbugs2m 11sbranch-2 passed
+1 💚spotless0m 50sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for patch
+1 💚mvninstall2m 49sthe patch passed
+1 💚compile5m 16sthe patch passed
+1 💚javac5m 16sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 50sthe patch passed
+1 💚spotbugs2m 26sthe patch passed
+1 💚hadoopcheck16m 12sPatch does not cause any errors with Hadoop 2.10.2 or 3.3.6 3.4.1.
+1 💚spotless0m 47spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 21sThe patch does not generate ASF License warnings.
44m 9s
SubsystemReport/Notes
DockerClientAPI=1.52 ServerAPI=1.52 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#7612
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux eda6a31e199e 6.14.0-1018-aws #18~24.04.1-Ubuntu SMP Mon Nov 24 19:46:27 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 5ef4d0c
Default JavaEclipse Adoptium-11.0.23+9
Max. process+thread count80 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 45sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for branch
+1 💚mvninstall3m 28sbranch-2 passed
+1 💚compile1m 13sbranch-2 passed
+1 💚javadoc0m 41sbranch-2 passed
+1 💚shadedjars6m 42sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 20sMaven dependency ordering for patch
+1 💚mvninstall3m 8sthe patch passed
+1 💚compile1m 13sthe patch passed
+1 💚javac1m 13sthe patch passed
+1 💚javadoc0m 40sthe patch passed
+1 💚shadedjars6m 43spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
+1 💚unit234m 27shbase-server in the patch passed.
+1 💚unit22m 2shbase-mapreduce in the patch passed.
287m 27s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#7612
Optional Testsjavac javadoc unit compile shadedjars
unameLinux e2b39dfd455f 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 5ef4d0c
Default JavaEclipse Adoptium-11.0.23+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/testReport/
Max. process+thread count3315 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 19sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for branch
+1 💚mvninstall2m 35sbranch-2 passed
+1 💚compile1m 2sbranch-2 passed
+1 💚javadoc0m 42sbranch-2 passed
+1 💚shadedjars5m 45sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for patch
+1 💚mvninstall2m 20sthe patch passed
+1 💚compile1m 3sthe patch passed
+1 💚javac1m 3sthe patch passed
+1 💚javadoc0m 39sthe patch passed
+1 💚shadedjars5m 42spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit280m 22s/patch-unit-hbase-server.txthbase-server in the patch failed.
+1 💚unit20m 56shbase-mapreduce in the patch passed.
326m 50s
SubsystemReport/Notes
DockerClientAPI=1.52 ServerAPI=1.52 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#7612
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 700133029a93 6.14.0-1018-aws #18~24.04.1-Ubuntu SMP Mon Nov 24 19:46:27 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 5ef4d0c
Default JavaTemurin-1.8.0_412-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/testReport/
Max. process+thread count3396 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 15sDocker mode activated.
-0 ⚠️yetus0m 7sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 14sMaven dependency ordering for branch
+1 💚mvninstall3m 39sbranch-2 passed
+1 💚compile1m 25sbranch-2 passed
+1 💚javadoc0m 45sbranch-2 passed
+1 💚shadedjars7m 21sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 21sMaven dependency ordering for patch
+1 💚mvninstall3m 23sthe patch passed
+1 💚compile1m 25sthe patch passed
+1 💚javac1m 25sthe patch passed
+1 💚javadoc0m 45sthe patch passed
+1 💚shadedjars7m 16spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit296m 22s/patch-unit-hbase-server.txthbase-server in the patch failed.
-1 ❌unit37m 57s/patch-unit-hbase-mapreduce.txthbase-mapreduce in the patch failed.
366m 1s
SubsystemReport/Notes
DockerClientAPI=1.52 ServerAPI=1.52 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#7612
Optional Testsjavac javadoc unit compile shadedjars
unameLinux f9cc8f37cfaa 6.14.0-1018-aws #18~24.04.1-Ubuntu SMP Mon Nov 24 19:46:27 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 5ef4d0c
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/testReport/
Max. process+thread count3617 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/1/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

…che#7604)
Remove the 'shutdownHook' in SingleProcessHBaseCluster where we close
the FileSystem instance of a region server.
Set DistributedFileSystem cache to false when creating MiniMRCluster so
when shutting down MiniMRCluster it will not close the shared FileSystem
instance.
Also re-enable TestExportSnapshot.
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit d11ee6a)
@Apache9
Apache9force-pushed the HBASE-29802-branch-2 branch from 5ef4d0c to 6562936CompareJanuary 12, 2026 08:35
@Apache-HBase

Copy link
Copy Markdown

🎊 +1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 13sDocker mode activated.
_ Prechecks _
+1 💚dupname0m 0sNo case conflicting files found.
+0 🆗codespell0m 0scodespell was not available.
+0 🆗detsecrets0m 0sdetect-secrets was not available.
+1 💚@author0m 0sThe patch does not contain any @author tags.
+1 💚hbaseanti0m 0sPatch does not have any anti-patterns.
_ branch-2 Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for branch
+1 💚mvninstall3m 18sbranch-2 passed
+1 💚compile3m 6sbranch-2 passed
+1 💚checkstyle0m 44sbranch-2 passed
+1 💚spotbugs1m 57sbranch-2 passed
+1 💚spotless0m 39sbranch has no errors when running spotless:check.
_ Patch Compile Tests _
+0 🆗mvndep0m 16sMaven dependency ordering for patch
+1 💚mvninstall2m 40sthe patch passed
+1 💚compile3m 4sthe patch passed
+1 💚javac3m 4sthe patch passed
+1 💚blanks0m 0sThe patch has no blanks issues.
+1 💚checkstyle0m 48sthe patch passed
+1 💚spotbugs2m 15sthe patch passed
+1 💚hadoopcheck13m 36sPatch does not cause any errors with Hadoop 2.10.2 or 3.3.6 3.4.1.
+1 💚spotless0m 44spatch has no errors when running spotless:check.
_ Other Tests _
+1 💚asflicense0m 18sThe patch does not generate ASF License warnings.
35m 29s
SubsystemReport/Notes
DockerClientAPI=1.48 ServerAPI=1.48 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/artifact/yetus-general-check/output/Dockerfile
GITHUB PR#7612
Optional Testsdupname asflicense javac spotbugs checkstyle codespell detsecrets compile hadoopcheck hbaseanti spotless
unameLinux 58b1b0eb3991 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 6562936
Default JavaEclipse Adoptium-11.0.23+9
Max. process+thread count79 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/console
versionsgit=2.34.1 maven=3.9.8 spotbugs=4.7.3
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 17sDocker mode activated.
-0 ⚠️yetus0m 5sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 12sMaven dependency ordering for branch
+1 💚mvninstall3m 12sbranch-2 passed
+1 💚compile1m 21sbranch-2 passed
+1 💚javadoc0m 41sbranch-2 passed
+1 💚shadedjars5m 45sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 17sMaven dependency ordering for patch
+1 💚mvninstall2m 41sthe patch passed
+1 💚compile1m 24sthe patch passed
+1 💚javac1m 24sthe patch passed
+1 💚javadoc0m 45sthe patch passed
+1 💚shadedjars5m 30spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit278m 16s/patch-unit-hbase-server.txthbase-server in the patch failed.
-1 ❌unit23m 7s/patch-unit-hbase-mapreduce.txthbase-mapreduce in the patch failed.
328m 7s
SubsystemReport/Notes
DockerClientAPI=1.52 ServerAPI=1.52 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile
GITHUB PR#7612
Optional Testsjavac javadoc unit compile shadedjars
unameLinux fa152c8cfb56 6.14.0-1018-aws #18~24.04.1-Ubuntu SMP Mon Nov 24 19:46:27 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 6562936
Default JavaEclipse Adoptium-17.0.11+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/testReport/
Max. process+thread count3610 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 54sDocker mode activated.
-0 ⚠️yetus0m 6sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 13sMaven dependency ordering for branch
+1 💚mvninstall3m 44sbranch-2 passed
+1 💚compile1m 34sbranch-2 passed
+1 💚javadoc0m 57sbranch-2 passed
+1 💚shadedjars8m 6sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 19sMaven dependency ordering for patch
+1 💚mvninstall3m 6sthe patch passed
+1 💚compile1m 12sthe patch passed
+1 💚javac1m 12sthe patch passed
+1 💚javadoc0m 59sthe patch passed
+1 💚shadedjars7m 49spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit268m 36s/patch-unit-hbase-server.txthbase-server in the patch failed.
+1 💚unit27m 36shbase-mapreduce in the patch passed.
331m 19s
SubsystemReport/Notes
DockerClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile
GITHUB PR#7612
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 792c00855269 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 6562936
Default JavaEclipse Adoptium-11.0.23+9
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/testReport/
Max. process+thread count3204 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache-HBase

Copy link
Copy Markdown

💔 -1 overall

VoteSubsystemRuntimeLogfileComment
+0 🆗reexec0m 19sDocker mode activated.
-0 ⚠️yetus0m 7sUnprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --author-ignore-list --blanks-eol-ignore-file --blanks-tabs-ignore-file --quick-hadoopcheck
_ Prechecks _
_ branch-2 Compile Tests _
+0 🆗mvndep0m 15sMaven dependency ordering for branch
+1 💚mvninstall2m 41sbranch-2 passed
+1 💚compile1m 4sbranch-2 passed
+1 💚javadoc0m 42sbranch-2 passed
+1 💚shadedjars5m 51sbranch has no errors when building our shaded downstream artifacts.
_ Patch Compile Tests _
+0 🆗mvndep0m 14sMaven dependency ordering for patch
+1 💚mvninstall2m 30sthe patch passed
+1 💚compile1m 5sthe patch passed
+1 💚javac1m 5sthe patch passed
+1 💚javadoc0m 40sthe patch passed
+1 💚shadedjars5m 48spatch has no errors when building our shaded downstream artifacts.
_ Other Tests _
-1 ❌unit292m 40s/patch-unit-hbase-server.txthbase-server in the patch failed.
+1 💚unit21m 50shbase-mapreduce in the patch passed.
340m 36s
SubsystemReport/Notes
DockerClientAPI=1.52 ServerAPI=1.52 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile
GITHUB PR#7612
Optional Testsjavac javadoc unit compile shadedjars
unameLinux 9c8187923e99 6.14.0-1018-aws #18~24.04.1-Ubuntu SMP Mon Nov 24 19:46:27 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
Build toolmaven
Personalitydev-support/hbase-personality.sh
git revisionbranch-2 / 6562936
Default JavaTemurin-1.8.0_412-b08
Test Resultshttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/testReport/
Max. process+thread count3396 (vs. ulimit of 30000)
modulesC: hbase-server hbase-mapreduce U: .
Console outputhttps://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-7612/2/console
versionsgit=2.34.1 maven=3.9.8
Powered byApache Yetus 0.15.0 https://yetus.apache.org

This message was automatically generated.

@Apache9

Copy link
Copy Markdown
ContributorAuthor

The failed UTs should not be related, and also fail in nightly build for branch-2.

Let me merge and file other issue for fixing branch-2 builds.

@Apache9
Apache9 merged commit 8841deb into apache:branch-2Jan 12, 2026
1 check failed
Apache9 added a commit that referenced this pull request Jan 12, 2026
…) (#7612)
Remove the 'shutdownHook' in SingleProcessHBaseCluster where we close
the FileSystem instance of a region server.
Set DistributedFileSystem cache to false when creating MiniMRCluster so
when shutting down MiniMRCluster it will not close the shared FileSystem
instance.
Also re-enable TestExportSnapshot.
(cherry picked from commit d11ee6a)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 8841deb)
Apache9 added a commit that referenced this pull request Jan 12, 2026
…) (#7612)
Remove the 'shutdownHook' in SingleProcessHBaseCluster where we close
the FileSystem instance of a region server.
Set DistributedFileSystem cache to false when creating MiniMRCluster so
when shutting down MiniMRCluster it will not close the shared FileSystem
instance.
Also re-enable TestExportSnapshot.
(cherry picked from commit d11ee6a)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 8841deb)
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backportThis PR is a back port of some issue or issues already committed to master

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants

@Apache9@Apache-HBase